Started by upstream project "osmo-gsm-tester_build-osmo-sgsn" build number 30106 originally caused by: Started by upstream project "master-osmo-sgsn" build number 37282 originally caused by: Started by upstream project "master-osmo-iuh" build number 12881 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-msc" build number 29319 originally caused by: Started by upstream project "master-osmo-msc" build number 34287 originally caused by: Started by upstream project "master-osmo-iuh" build number 12881 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17689 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7515 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6695 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8719 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2999 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29319 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5157 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30106 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4687 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12996 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9261 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4714 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5196 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3913 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins667741583973728324.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 12:53:08 + trial_dir_prefix=trial- + rm -rf trial-2404 trial-2404-bin.tgz trial-2404-run.tgz + trial_dir=trial-2405 + mkdir -p trial-2405 + mv open5gs.build-8.tgz osmo-bsc.build-17689.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6695.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2999.tgz osmo-mgw.build-8965.tgz osmo-msc.build-29319.tgz osmo-nitb.build-12996.tgz osmo-pcu-oc2g.build-3913.tgz osmo-pcu-sysmo.build-5196.tgz osmo-pcu.build-5157.tgz osmo-sgsn.build-30106.tgz osmo-stp.build-9261.tgz osmo-trx.build-4687.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz trial-2405 + cat open5gs.build-8.md5 osmo-bsc.build-17689.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6695.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2999.md5 osmo-mgw.build-8965.md5 osmo-msc.build-29319.md5 osmo-nitb.build-12996.md5 osmo-pcu-oc2g.build-3913.md5 osmo-pcu-sysmo.build-5196.md5 osmo-pcu.build-5157.md5 osmo-sgsn.build-30106.md5 osmo-stp.build-9261.md5 osmo-trx.build-4687.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17689.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6695.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2999.md5 osmo-mgw.build-8965.md5 osmo-msc.build-29319.md5 osmo-nitb.build-12996.md5 osmo-pcu-oc2g.build-3913.md5 osmo-pcu-sysmo.build-5196.md5 osmo-pcu.build-5157.md5 osmo-sgsn.build-30106.md5 osmo-stp.build-9261.md5 osmo-trx.build-4687.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2405 combinations: None trial: 'trial-2405' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2405 -------------------------------------------------------------------------------------------- 12:53:19.983975 tst trial-2405: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/log --------------------------------------------------------------------- trial-2405 nitb_sms:sysmo --------------------------------------------------------------------- 12:55:28.184701 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:28.189466 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 12:55:28.211054 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 12:55:28.218518 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 12:55:28.275045 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 12:55:28.295996 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 12:55:28.302760 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 12:55:28.838128 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 12:55:28.845617 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 12:55:28.857445 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 12:55:29.242182 tst mo_mt_sms.py: using LAC 41040 12:55:29.487402 tst mo_mt_sms.py: using RAC 240 12:55:29.603621 tst mo_mt_sms.py: using CellId 41040 12:55:29.730729 tst mo_mt_sms.py: using BVCI 41041 12:55:29.847467 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 12:55:30.028659 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 12:55:30.143779 tst mo_mt_sms.py:9: start nitb and bts... 12:55:30.346015 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:55:32.730095 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24312): Launched 12:55:33.060067 run osmo-nitb_10.42.42.2(pid=24313): Launched 12:55:33.239186 run osmo-nitb_10.42.42.2(pid=24313): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24313)] 12:55:33.373248 run osmo-nitb_10.42.42.2(pid=24313): stdout: | (launched: 2022-12-14_12:55:32.998857) 12:55:33.508668 run osmo-nitb_10.42.42.2(pid=24313): stderr: | (launched: 2022-12-14_12:55:33.047980) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:55:33.643891 run osmo-nitb_10.42.42.2(pid=24313): stdout: | (launched: 2022-12-14_12:55:32.998857) 12:55:33.773733 run osmo-nitb_10.42.42.2(pid=24313): stderr: | (launched: 2022-12-14_12:55:33.047980) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:55:33.928744 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24313): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24313) [trial-2405↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24313)] [trial-2405↪nitb_sms:sysmo↪mo_mt_sms.py:11] 12:55:33.937772 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 12:55:33.944816 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24312): Terminating (SIGTERM) 12:55:34.156099 --- ParallelTerminationStrategy: PID 24312 died... 12:55:34.177727 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24312): Terminated: ok {rc=0} 12:55:34.267333 bus /sierra_3: Setting Powered False 12:55:35.366821 bus /sierra_3: Setting Powered False 12:55:36.484295 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 sms:sysmo --------------------------------------------------------------------- 12:55:37.665979 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:37.670335 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 12:55:37.691636 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 12:55:37.720196 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 12:55:37.773048 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 12:55:37.794316 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 12:55:37.821691 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 12:55:38.369515 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 sms:sysmo mo_mt_sms.py ---------------------------------------------- 12:55:38.374939 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:55:38.386206 tst sms:sysmo: Using 1 x bts (candidates: 1) 12:55:38.421092 tst mo_mt_sms.py: using LAC 41041 12:55:38.547888 tst mo_mt_sms.py: using RAC 241 12:55:38.674668 tst mo_mt_sms.py: using CellId 41041 12:55:38.804273 tst mo_mt_sms.py: using BVCI 41042 12:55:38.924095 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:55:38.935262 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:55:38.946456 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:55:38.957320 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:55:38.969342 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 12:55:38.981060 tst sms:sysmo: Using 1 x modem (candidates: 2) 12:55:39.097993 tst sms:sysmo: Using 1 x modem (candidates: 2) 12:55:39.220021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:55:40.977044 run create_hlr_db(pid=24318): Launched 12:55:41.102258 bus /sierra_2: Setting Powered False 12:55:42.166269 run create_hlr_db(pid=24318): Terminated: ok {rc=0} 12:55:42.605207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24320): Launched 12:55:42.912128 run osmo-hlr_10.42.42.2(pid=24321): Launched 12:55:43.028559 run osmo-stp_10.42.42.5: Starting osmo-stp 12:55:45.513120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24323): Launched 12:55:45.818997 run osmo-stp_10.42.42.5(pid=24324): Launched 12:55:46.105491 run osmo-msc_10.42.42.6: Starting osmo-msc 12:55:51.650738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24326): Launched 12:55:51.978849 run osmo-msc_10.42.42.6(pid=24327): Launched 12:55:52.169888 run osmo-stp_10.42.42.5(pid=24324): ERR: Terminated: ERROR {rc=1} [trial-2405↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24324)] 12:55:52.307990 run osmo-stp_10.42.42.5(pid=24324): stdout: | (launched: 2022-12-14_12:55:45.760554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:52.446683 run osmo-stp_10.42.42.5(pid=24324): stderr: | 20221214125545995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125545995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125545995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125545996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125545998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125545998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125545998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:52.583921 run osmo-stp_10.42.42.5(pid=24324): stdout: | (launched: 2022-12-14_12:55:45.760554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:55:52.714323 run osmo-stp_10.42.42.5(pid=24324): stderr: | 20221214125545995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125545995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125545995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125545996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125545998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125545998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125545998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:55:52.869887 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24324): Process ended prematurely: osmo-stp_10.42.42.5(pid=24324) [trial-2405↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24324)] [trial-2405↪sms:sysmo↪mo_mt_sms.py:16] 12:55:52.878893 tst mo_mt_sms.py:16: Test FAILED (14.5 sec) 12:55:52.906562 run osmo-hlr_10.42.42.2(pid=24321): ERR: Terminated: ERROR {rc=237} [trial-2405↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24321)] 12:55:52.958037 run osmo-hlr_10.42.42.2(pid=24321): stdout: | (launched: 2022-12-14_12:55:42.854187) 12:55:53.011192 run osmo-hlr_10.42.42.2(pid=24321): stderr: | 20221214125543031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125543032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125543032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125543032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125543032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125543032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125543044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125543052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125543052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125543052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:55:53.084929 run osmo-msc_10.42.42.6(pid=24327): ERR: Terminated: ERROR {rc=2} [trial-2405↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24327)] 12:55:53.135851 run osmo-msc_10.42.42.6(pid=24327): stdout: | (launched: 2022-12-14_12:55:51.917351) 12:55:53.189255 run osmo-msc_10.42.42.6(pid=24327): stderr: | 20221214125552249 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125552249 DLGLOBAL DEBUG validating counter group 0x7fa1a9ab5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125552249 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125552249 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125552249 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125552250 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125552251 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125552252 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125552252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125552252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:55:53.242149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24320): Terminating (SIGTERM) 12:55:53.284759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24323): Terminating (SIGTERM) 12:55:53.327680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24326): Terminating (SIGTERM) 12:55:53.370906 --- ParallelTerminationStrategy: PID 24320 died... 12:55:53.391664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24320): Terminated: ok {rc=0} 12:55:53.439694 --- ParallelTerminationStrategy: PID 24323 died... 12:55:53.460019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24323): Terminated: ok {rc=0} 12:55:53.507324 --- ParallelTerminationStrategy: PID 24326 died... 12:55:53.527545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24326): Terminated: ok {rc=0} 12:55:53.617333 bus /sierra_3: Setting Powered False 12:55:54.717440 bus /sierra_3: Setting Powered False 12:55:55.832621 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_ussd:sysmo --------------------------------------------------------------------- 12:55:57.052599 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:55:57.056545 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 12:55:57.077946 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 12:55:57.085044 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 12:55:57.122908 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 12:55:57.144362 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 12:55:57.151305 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 12:55:57.670409 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 12:55:57.676577 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 12:55:57.687914 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 12:55:57.722621 tst assert_extension.py: using LAC 41042 12:55:57.853445 tst assert_extension.py: using RAC 242 12:55:57.974161 tst assert_extension.py: using CellId 41042 12:55:58.095811 tst assert_extension.py: using BVCI 41043 12:55:58.207447 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 12:55:58.325952 tst assert_extension.py:10: start nitb and bts... 12:55:58.546686 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:55:59.212533 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24334): Launched 12:55:59.540336 run osmo-nitb_10.42.42.2(pid=24335): Launched 12:55:59.720391 run osmo-nitb_10.42.42.2(pid=24335): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24335)] 12:55:59.865751 run osmo-nitb_10.42.42.2(pid=24335): stdout: | (launched: 2022-12-14_12:55:59.478885) 12:56:00.012917 run osmo-nitb_10.42.42.2(pid=24335): stderr: | (launched: 2022-12-14_12:55:59.527286) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:56:00.160619 run osmo-nitb_10.42.42.2(pid=24335): stdout: | (launched: 2022-12-14_12:55:59.478885) 12:56:00.302041 run osmo-nitb_10.42.42.2(pid=24335): stderr: | (launched: 2022-12-14_12:55:59.527286) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24335): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24335) [trial-2405↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24335)] 12:56:00.663605 tst osmo-nitb_10.42.42.2(pid=24335): stdout: | (launched: 2022-12-14_12:55:59.478885) 12:56:00.795789 tst osmo-nitb_10.42.42.2(pid=24335): stderr: | (launched: 2022-12-14_12:55:59.527286) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:56:00.962751 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24335): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24335) [trial-2405↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24335)] [trial-2405↪nitb_ussd:sysmo↪assert_extension.py:12] 12:56:00.972290 tst assert_extension.py:12: Test FAILED (3.3 sec) 12:56:00.980192 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24334): Terminating (SIGTERM) 12:56:01.192769 --- ParallelTerminationStrategy: PID 24334 died... 12:56:01.215647 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24334): Terminated: ok {rc=0} 12:56:01.306679 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 ussd:sysmo --------------------------------------------------------------------- 12:56:02.473636 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:02.478033 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 12:56:02.499565 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 12:56:02.528242 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 12:56:02.565021 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 12:56:02.586787 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 12:56:02.613655 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 12:56:03.140548 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 ussd:sysmo assert_extension.py ---------------------------------------------- 12:56:03.146219 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:56:03.157213 tst ussd:sysmo: Using 1 x bts (candidates: 1) 12:56:03.191956 tst assert_extension.py: using LAC 41043 12:56:03.320710 tst assert_extension.py: using RAC 243 12:56:03.447633 tst assert_extension.py: using CellId 41043 12:56:03.577649 tst assert_extension.py: using BVCI 41044 12:56:03.689639 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:56:03.700162 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:56:03.710674 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:56:03.721015 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:56:03.731319 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 12:56:03.742104 tst ussd:sysmo: Using 1 x modem (candidates: 1) 12:56:03.861049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:04.372145 run create_hlr_db(pid=24340): Launched 12:56:04.500190 bus /sierra_2: Setting Powered False 12:56:05.565189 run create_hlr_db(pid=24340): Terminated: ok {rc=0} 12:56:06.022130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24342): Launched 12:56:06.351677 run osmo-hlr_10.42.42.2(pid=24343): Launched 12:56:06.476277 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:07.044876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24345): Launched 12:56:07.374042 run osmo-stp_10.42.42.5(pid=24346): Launched 12:56:07.498967 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:08.088717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24348): Launched 12:56:08.417559 run osmo-msc_10.42.42.6(pid=24349): Launched 12:56:08.599018 run osmo-stp_10.42.42.5(pid=24346): ERR: Terminated: ERROR {rc=1} [trial-2405↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24346)] 12:56:08.738137 run osmo-stp_10.42.42.5(pid=24346): stdout: | (launched: 2022-12-14_12:56:07.312357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:08.877981 run osmo-stp_10.42.42.5(pid=24346): stderr: | 20221214125607508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125607508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125607509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125607509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125607511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125607512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125607512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:09.015669 run osmo-stp_10.42.42.5(pid=24346): stdout: | (launched: 2022-12-14_12:56:07.312357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:09.147174 run osmo-stp_10.42.42.5(pid=24346): stderr: | 20221214125607508 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125607508 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125607509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125607509 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125607511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125607512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125607512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:09.304656 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24346): Process ended prematurely: osmo-stp_10.42.42.5(pid=24346) [trial-2405↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24346)] [trial-2405↪ussd:sysmo↪assert_extension.py:17] 12:56:09.314013 tst assert_extension.py:17: Test FAILED (6.2 sec) 12:56:09.341750 run osmo-hlr_10.42.42.2(pid=24343): ERR: Terminated: ERROR {rc=237} [trial-2405↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24343)] 12:56:09.394028 run osmo-hlr_10.42.42.2(pid=24343): stdout: | (launched: 2022-12-14_12:56:06.289743) 12:56:09.446970 run osmo-hlr_10.42.42.2(pid=24343): stderr: | 20221214125606490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125606490 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125606490 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125606490 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125606490 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125606490 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125606505 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125606513 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125606513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125606513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:09.520690 run osmo-msc_10.42.42.6(pid=24349): ERR: Terminated: ERROR {rc=2} [trial-2405↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24349)] 12:56:09.571192 run osmo-msc_10.42.42.6(pid=24349): stdout: | (launched: 2022-12-14_12:56:08.355811) 12:56:09.623949 run osmo-msc_10.42.42.6(pid=24349): stderr: | 20221214125608680 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125608680 DLGLOBAL DEBUG validating counter group 0x7f8edbc1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125608680 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125608680 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125608681 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125608681 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125608683 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125608683 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125608683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125608683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:09.676794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24342): Terminating (SIGTERM) 12:56:09.719457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24345): Terminating (SIGTERM) 12:56:09.762764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24348): Terminating (SIGTERM) 12:56:09.805853 --- ParallelTerminationStrategy: PID 24342 died... 12:56:09.826664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24342): Terminated: ok {rc=0} 12:56:09.873878 --- ParallelTerminationStrategy: PID 24345 died... 12:56:09.894391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24345): Terminated: ok {rc=0} 12:56:09.941414 --- ParallelTerminationStrategy: PID 24348 died... 12:56:09.961680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24348): Terminated: ok {rc=0} 12:56:10.051422 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:56:11.245766 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:11.252219 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:56:11.273168 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:56:11.300753 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:56:11.353012 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:56:11.375084 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:56:11.403311 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:56:11.950925 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:56:12.003156 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:12.014395 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:56:12.070543 tst mo_mt_call.py: using LAC 41044 12:56:12.194248 tst mo_mt_call.py: using RAC 244 12:56:12.316774 tst mo_mt_call.py: using CellId 41044 12:56:12.447000 tst mo_mt_call.py: using BVCI 41045 12:56:12.568772 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:12.580592 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:12.592282 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:12.603849 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:12.615919 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:12.627717 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:56:12.747273 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:56:12.865597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:13.383620 run create_hlr_db(pid=24354): Launched 12:56:13.510189 bus /sierra_2: Setting Powered False 12:56:14.574259 run create_hlr_db(pid=24354): Terminated: ok {rc=0} 12:56:15.021650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24356): Launched 12:56:15.333881 run osmo-hlr_10.42.42.2(pid=24357): Launched 12:56:15.451802 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:16.030352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24359): Launched 12:56:16.385650 run osmo-stp_10.42.42.5(pid=24360): Launched 12:56:16.654768 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:17.338823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24362): Launched 12:56:17.651709 run osmo-msc_10.42.42.6(pid=24363): Launched 12:56:17.824563 run osmo-stp_10.42.42.5(pid=24360): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24360)] 12:56:17.956059 run osmo-stp_10.42.42.5(pid=24360): stdout: | (launched: 2022-12-14_12:56:16.315635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:18.086352 run osmo-stp_10.42.42.5(pid=24360): stderr: | 20221214125616618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125616618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125616618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125616619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125616619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125616619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125616619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:18.215353 run osmo-stp_10.42.42.5(pid=24360): stdout: | (launched: 2022-12-14_12:56:16.315635) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:18.338083 run osmo-stp_10.42.42.5(pid=24360): stderr: | 20221214125616618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125616618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125616618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125616619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125616619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125616619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125616619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:18.485539 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24360): Process ended prematurely: osmo-stp_10.42.42.5(pid=24360) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24360)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:56:18.494258 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:56:18.520580 run osmo-hlr_10.42.42.2(pid=24357): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24357)] 12:56:18.568591 run osmo-hlr_10.42.42.2(pid=24357): stdout: | (launched: 2022-12-14_12:56:15.274359) 12:56:18.618514 run osmo-hlr_10.42.42.2(pid=24357): stderr: | 20221214125615453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125615453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125615453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125615453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125615453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125615453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125615466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125615474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125615474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125615474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:18.688315 run osmo-msc_10.42.42.6(pid=24363): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24363)] 12:56:18.736317 run osmo-msc_10.42.42.6(pid=24363): stdout: | (launched: 2022-12-14_12:56:17.592481) 12:56:18.785986 run osmo-msc_10.42.42.6(pid=24363): stderr: | 20221214125617869 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125617870 DLGLOBAL DEBUG validating counter group 0x7fc79deacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125617870 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125617870 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125617870 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125617870 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125617872 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125617872 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125617872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125617872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:18.836153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24356): Terminating (SIGTERM) 12:56:18.875902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24359): Terminating (SIGTERM) 12:56:18.915751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24362): Terminating (SIGTERM) 12:56:18.955749 --- ParallelTerminationStrategy: PID 24356 died... 12:56:18.974953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24356): Terminated: ok {rc=0} 12:56:19.019126 --- ParallelTerminationStrategy: PID 24359 died... 12:56:19.037845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24359): Terminated: ok {rc=0} 12:56:19.082111 --- ParallelTerminationStrategy: PID 24362 died... 12:56:19.100828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24362): Terminated: ok {rc=0} 12:56:19.185597 bus /sierra_3: Setting Powered False 12:56:20.285174 bus /sierra_3: Setting Powered False 12:56:21.406117 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:56:22.555922 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:22.567841 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:56:22.622918 tst mo_mt_call_osmux.py: using LAC 41045 12:56:22.742807 tst mo_mt_call_osmux.py: using RAC 245 12:56:22.863579 tst mo_mt_call_osmux.py: using CellId 41045 12:56:22.993389 tst mo_mt_call_osmux.py: using BVCI 41046 12:56:23.115130 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:23.126991 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:23.138701 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:23.150312 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:23.162488 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:56:23.174643 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:56:23.296258 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:56:23.413580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:23.897537 run create_hlr_db(pid=24365): Launched 12:56:24.024429 bus /sierra_2: Setting Powered False 12:56:25.086587 run create_hlr_db(pid=24365): Terminated: ok {rc=0} 12:56:25.538061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24367): Launched 12:56:25.849435 run osmo-hlr_10.42.42.2(pid=24368): Launched 12:56:25.966511 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:26.501569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24370): Launched 12:56:26.813476 run osmo-stp_10.42.42.5(pid=24371): Launched 12:56:26.931637 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:27.494378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24373): Launched 12:56:27.805204 run osmo-msc_10.42.42.6(pid=24374): Launched 12:56:27.977317 run osmo-stp_10.42.42.5(pid=24371): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24371)] 12:56:28.107507 run osmo-stp_10.42.42.5(pid=24371): stdout: | (launched: 2022-12-14_12:56:26.754612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:28.238255 run osmo-stp_10.42.42.5(pid=24371): stderr: | 20221214125626932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125626932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125626932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125626932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125626933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125626933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125626933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:28.367204 run osmo-stp_10.42.42.5(pid=24371): stdout: | (launched: 2022-12-14_12:56:26.754612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:28.490303 run osmo-stp_10.42.42.5(pid=24371): stderr: | 20221214125626932 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125626932 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125626932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125626932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125626933 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125626933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125626933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:28.637965 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24371): Process ended prematurely: osmo-stp_10.42.42.5(pid=24371) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24371)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:56:28.646752 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:56:28.673518 run osmo-hlr_10.42.42.2(pid=24368): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24368)] 12:56:28.722264 run osmo-hlr_10.42.42.2(pid=24368): stdout: | (launched: 2022-12-14_12:56:25.790500) 12:56:28.772610 run osmo-hlr_10.42.42.2(pid=24368): stderr: | 20221214125625971 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125625971 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125625971 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125625971 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125625971 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125625971 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125625985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125625994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125625994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125625994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:28.842851 run osmo-msc_10.42.42.6(pid=24374): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24374)] 12:56:28.891412 run osmo-msc_10.42.42.6(pid=24374): stdout: | (launched: 2022-12-14_12:56:27.746673) 12:56:28.941904 run osmo-msc_10.42.42.6(pid=24374): stderr: | 20221214125628024 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125628024 DLGLOBAL DEBUG validating counter group 0x7f0b20038c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125628024 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125628024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125628024 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125628025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125628026 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125628027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125628027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125628027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:28.992353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24367): Terminating (SIGTERM) 12:56:29.032425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24370): Terminating (SIGTERM) 12:56:29.072438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24373): Terminating (SIGTERM) 12:56:29.112909 --- ParallelTerminationStrategy: PID 24367 died... 12:56:29.132275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24367): Terminated: ok {rc=0} 12:56:29.176751 --- ParallelTerminationStrategy: PID 24370 died... 12:56:29.195547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24370): Terminated: ok {rc=0} 12:56:29.240076 --- ParallelTerminationStrategy: PID 24373 died... 12:56:29.258782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24373): Terminated: ok {rc=0} 12:56:29.343391 bus /sierra_3: Setting Powered False 12:56:30.441762 bus /sierra_3: Setting Powered False 12:56:31.562599 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:56:32.818165 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:32.825690 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:56:32.847192 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:56:32.875732 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:56:32.928290 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:56:32.949225 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:56:32.975764 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:56:33.530815 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:56:33.581568 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:33.592700 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:56:33.647529 tst mo_mt_call.py: using LAC 41046 12:56:33.778663 tst mo_mt_call.py: using RAC 246 12:56:33.909754 tst mo_mt_call.py: using CellId 41046 12:56:34.040226 tst mo_mt_call.py: using BVCI 41047 12:56:34.163364 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:34.175081 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:34.186659 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:34.197985 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:34.209716 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:34.221383 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:56:34.338792 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:56:34.455065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:34.936558 run create_hlr_db(pid=24379): Launched 12:56:35.063827 bus /sierra_2: Setting Powered False 12:56:36.125937 run create_hlr_db(pid=24379): Terminated: ok {rc=0} 12:56:36.580777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24381): Launched 12:56:36.915354 run osmo-hlr_10.42.42.2(pid=24382): Launched 12:56:37.043981 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:37.618757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24384): Launched 12:56:37.952492 run osmo-stp_10.42.42.5(pid=24385): Launched 12:56:38.079649 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:38.680582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24387): Launched 12:56:39.014952 run osmo-msc_10.42.42.6(pid=24388): Launched 12:56:39.200095 run osmo-stp_10.42.42.5(pid=24385): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24385)] 12:56:39.340135 run osmo-stp_10.42.42.5(pid=24385): stdout: | (launched: 2022-12-14_12:56:37.890492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:39.481123 run osmo-stp_10.42.42.5(pid=24385): stderr: | 20221214125638085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125638085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125638085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125638086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125638086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125638086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125638086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:39.619899 run osmo-stp_10.42.42.5(pid=24385): stdout: | (launched: 2022-12-14_12:56:37.890492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:39.752533 run osmo-stp_10.42.42.5(pid=24385): stderr: | 20221214125638085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125638085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125638085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125638086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125638086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125638086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125638086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:39.911381 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24385): Process ended prematurely: osmo-stp_10.42.42.5(pid=24385) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24385)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:56:39.920899 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:56:39.948659 run osmo-hlr_10.42.42.2(pid=24382): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24382)] 12:56:39.999849 run osmo-hlr_10.42.42.2(pid=24382): stdout: | (launched: 2022-12-14_12:56:36.853453) 12:56:40.052223 run osmo-hlr_10.42.42.2(pid=24382): stderr: | 20221214125637054 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125637054 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125637054 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125637054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125637054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125637054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125637099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125637109 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125637109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125637109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:40.125787 run osmo-msc_10.42.42.6(pid=24388): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24388)] 12:56:40.175958 run osmo-msc_10.42.42.6(pid=24388): stdout: | (launched: 2022-12-14_12:56:38.952447) 12:56:40.228903 run osmo-msc_10.42.42.6(pid=24388): stderr: | 20221214125639277 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125639277 DLGLOBAL DEBUG validating counter group 0x7f68c602fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125639277 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125639277 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125639277 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125639278 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125639279 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125639280 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125639280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125639280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:40.282147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24381): Terminating (SIGTERM) 12:56:40.324460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24384): Terminating (SIGTERM) 12:56:40.367619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24387): Terminating (SIGTERM) 12:56:40.410661 --- ParallelTerminationStrategy: PID 24381 died... 12:56:40.431409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24381): Terminated: ok {rc=0} 12:56:40.478838 --- ParallelTerminationStrategy: PID 24384 died... 12:56:40.499291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24384): Terminated: ok {rc=0} 12:56:40.546567 --- ParallelTerminationStrategy: PID 24387 died... 12:56:40.567034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24387): Terminated: ok {rc=0} 12:56:40.657041 bus /sierra_3: Setting Powered False 12:56:41.757559 bus /sierra_3: Setting Powered False 12:56:42.876751 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:56:44.024698 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:44.036578 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:56:44.093302 tst mo_mt_call_osmux.py: using LAC 41047 12:56:44.216503 tst mo_mt_call_osmux.py: using RAC 247 12:56:44.339841 tst mo_mt_call_osmux.py: using CellId 41047 12:56:44.463376 tst mo_mt_call_osmux.py: using BVCI 41048 12:56:44.577395 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:44.588701 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:44.599527 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:44.610313 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:44.621076 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:56:44.631902 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:56:44.748106 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:56:44.870004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:45.388547 run create_hlr_db(pid=24390): Launched 12:56:45.515714 bus /sierra_2: Setting Powered False 12:56:46.598085 run create_hlr_db(pid=24390): Terminated: ok {rc=0} 12:56:47.101976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24392): Launched 12:56:47.425267 run osmo-hlr_10.42.42.2(pid=24393): Launched 12:56:47.544227 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:48.086056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24395): Launched 12:56:48.397302 run osmo-stp_10.42.42.5(pid=24396): Launched 12:56:48.514985 run osmo-msc_10.42.42.6: Starting osmo-msc 12:56:49.077196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24398): Launched 12:56:49.389298 run osmo-msc_10.42.42.6(pid=24399): Launched 12:56:49.563021 run osmo-stp_10.42.42.5(pid=24396): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24396)] 12:56:49.695049 run osmo-stp_10.42.42.5(pid=24396): stdout: | (launched: 2022-12-14_12:56:48.338696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:49.826244 run osmo-stp_10.42.42.5(pid=24396): stderr: | 20221214125648515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125648515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125648515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125648516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125648516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125648516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125648516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:49.954881 run osmo-stp_10.42.42.5(pid=24396): stdout: | (launched: 2022-12-14_12:56:48.338696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:56:50.078281 run osmo-stp_10.42.42.5(pid=24396): stderr: | 20221214125648515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125648515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125648515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125648516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125648516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125648516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125648516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:56:50.226342 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24396): Process ended prematurely: osmo-stp_10.42.42.5(pid=24396) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24396)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:56:50.235281 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:56:50.261640 run osmo-hlr_10.42.42.2(pid=24393): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24393)] 12:56:50.309750 run osmo-hlr_10.42.42.2(pid=24393): stdout: | (launched: 2022-12-14_12:56:47.365505) 12:56:50.359536 run osmo-hlr_10.42.42.2(pid=24393): stderr: | 20221214125647547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125647547 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125647547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125647547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125647547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125647547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125647559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125647570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125647570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125647570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:56:50.428529 run osmo-msc_10.42.42.6(pid=24399): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24399)] 12:56:50.476270 run osmo-msc_10.42.42.6(pid=24399): stdout: | (launched: 2022-12-14_12:56:49.330236) 12:56:50.525733 run osmo-msc_10.42.42.6(pid=24399): stderr: | 20221214125649603 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125649604 DLGLOBAL DEBUG validating counter group 0x7f7e613f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125649604 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125649604 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125649604 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125649604 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125649606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125649606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125649606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125649607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:56:50.575347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24392): Terminating (SIGTERM) 12:56:50.615353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24395): Terminating (SIGTERM) 12:56:50.654883 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24398): Terminating (SIGTERM) 12:56:50.695303 --- ParallelTerminationStrategy: PID 24392 died... 12:56:50.714680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24392): Terminated: ok {rc=0} 12:56:50.759187 --- ParallelTerminationStrategy: PID 24395 died... 12:56:50.778133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24395): Terminated: ok {rc=0} 12:56:50.822249 --- ParallelTerminationStrategy: PID 24398 died... 12:56:50.841340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24398): Terminated: ok {rc=0} 12:56:50.927709 bus /sierra_3: Setting Powered False 12:56:52.027407 bus /sierra_3: Setting Powered False 12:56:53.142906 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:56:54.378514 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:56:54.385612 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:56:54.407057 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:56:54.435330 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:56:54.493010 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:56:54.515243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:56:54.543059 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:56:55.089134 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:56:55.143619 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:56:55.155244 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:56:55.212141 tst mo_mt_call.py: using LAC 41048 12:56:55.342143 tst mo_mt_call.py: using RAC 248 12:56:55.470858 tst mo_mt_call.py: using CellId 41048 12:56:55.601197 tst mo_mt_call.py: using BVCI 41049 12:56:55.722858 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:56:55.734794 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:56:55.746478 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:56:55.758054 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:56:55.770110 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:56:55.782258 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:56:55.904148 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:56:56.023941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:56:56.508538 run create_hlr_db(pid=24404): Launched 12:56:56.636015 bus /sierra_2: Setting Powered False 12:56:57.697854 run create_hlr_db(pid=24404): Terminated: ok {rc=0} 12:56:58.132360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24406): Launched 12:56:58.444369 run osmo-hlr_10.42.42.2(pid=24407): Launched 12:56:58.563103 run osmo-stp_10.42.42.5: Starting osmo-stp 12:56:59.118116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24409): Launched 12:56:59.429549 run osmo-stp_10.42.42.5(pid=24410): Launched 12:56:59.547194 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:00.110055 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24412): Launched 12:57:00.422635 run osmo-msc_10.42.42.6(pid=24413): Launched 12:57:00.595867 run osmo-stp_10.42.42.5(pid=24410): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24410)] 12:57:00.727313 run osmo-stp_10.42.42.5(pid=24410): stdout: | (launched: 2022-12-14_12:56:59.370743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:00.872000 run osmo-stp_10.42.42.5(pid=24410): stderr: | 20221214125659546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125659546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125659546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125659547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125659547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125659547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125659547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:01.012929 run osmo-stp_10.42.42.5(pid=24410): stdout: | (launched: 2022-12-14_12:56:59.370743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:01.139118 run osmo-stp_10.42.42.5(pid=24410): stderr: | 20221214125659546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125659546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125659546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125659547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125659547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125659547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125659547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:01.289999 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24410): Process ended prematurely: osmo-stp_10.42.42.5(pid=24410) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24410)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:57:01.299181 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:57:01.326341 run osmo-hlr_10.42.42.2(pid=24407): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24407)] 12:57:01.375562 run osmo-hlr_10.42.42.2(pid=24407): stdout: | (launched: 2022-12-14_12:56:58.385726) 12:57:01.426271 run osmo-hlr_10.42.42.2(pid=24407): stderr: | 20221214125658564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125658564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125658564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125658564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125658565 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125658565 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125658577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125658585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125658585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125658585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:01.496915 run osmo-msc_10.42.42.6(pid=24413): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24413)] 12:57:01.546511 run osmo-msc_10.42.42.6(pid=24413): stdout: | (launched: 2022-12-14_12:57:00.362904) 12:57:01.597366 run osmo-msc_10.42.42.6(pid=24413): stderr: | 20221214125700639 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125700640 DLGLOBAL DEBUG validating counter group 0x7f2b72c64c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125700640 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125700640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125700640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125700640 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125700642 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125700642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125700642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125700642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:01.648815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24406): Terminating (SIGTERM) 12:57:01.690622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24409): Terminating (SIGTERM) 12:57:01.733933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24412): Terminating (SIGTERM) 12:57:01.777381 --- ParallelTerminationStrategy: PID 24406 died... 12:57:01.797166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24406): Terminated: ok {rc=0} 12:57:01.844028 --- ParallelTerminationStrategy: PID 24409 died... 12:57:01.863341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24409): Terminated: ok {rc=0} 12:57:01.908063 --- ParallelTerminationStrategy: PID 24412 died... 12:57:01.927079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24412): Terminated: ok {rc=0} 12:57:02.017180 bus /sierra_3: Setting Powered False 12:57:03.125156 bus /sierra_3: Setting Powered False 12:57:04.243804 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:57:05.395757 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:05.408088 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:57:05.466812 tst mo_mt_call_osmux.py: using LAC 41049 12:57:05.596869 tst mo_mt_call_osmux.py: using RAC 249 12:57:05.726285 tst mo_mt_call_osmux.py: using CellId 41049 12:57:05.855623 tst mo_mt_call_osmux.py: using BVCI 41050 12:57:05.976036 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:05.987970 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:05.999416 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:06.010735 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:06.022430 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:57:06.034133 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:57:06.152261 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:57:06.273513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:06.791426 run create_hlr_db(pid=24415): Launched 12:57:06.918036 bus /sierra_2: Setting Powered False 12:57:07.982590 run create_hlr_db(pid=24415): Terminated: ok {rc=0} 12:57:08.428328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24417): Launched 12:57:08.741521 run osmo-hlr_10.42.42.2(pid=24418): Launched 12:57:08.859836 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:09.395650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24420): Launched 12:57:09.707419 run osmo-stp_10.42.42.5(pid=24421): Launched 12:57:09.826132 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:10.388373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24423): Launched 12:57:10.725039 run osmo-msc_10.42.42.6(pid=24424): Launched 12:57:10.910597 run osmo-stp_10.42.42.5(pid=24421): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24421)] 12:57:11.051063 run osmo-stp_10.42.42.5(pid=24421): stdout: | (launched: 2022-12-14_12:57:09.648601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:11.193039 run osmo-stp_10.42.42.5(pid=24421): stderr: | 20221214125709823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125709823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125709823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125709824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125709824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125709824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125709824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:11.335558 run osmo-stp_10.42.42.5(pid=24421): stdout: | (launched: 2022-12-14_12:57:09.648601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:11.469268 run osmo-stp_10.42.42.5(pid=24421): stderr: | 20221214125709823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125709823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125709823 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125709824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125709824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125709824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125709824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:11.629217 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24421): Process ended prematurely: osmo-stp_10.42.42.5(pid=24421) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24421)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:57:11.639079 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:57:11.667139 run osmo-hlr_10.42.42.2(pid=24418): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24418)] 12:57:11.719308 run osmo-hlr_10.42.42.2(pid=24418): stdout: | (launched: 2022-12-14_12:57:08.682640) 12:57:11.772592 run osmo-hlr_10.42.42.2(pid=24418): stderr: | 20221214125708862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125708862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125708862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125708862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125708862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125708862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125708878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125708888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125708888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125708888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:11.846351 run osmo-msc_10.42.42.6(pid=24424): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24424)] 12:57:11.897449 run osmo-msc_10.42.42.6(pid=24424): stdout: | (launched: 2022-12-14_12:57:10.662876) 12:57:11.950205 run osmo-msc_10.42.42.6(pid=24424): stderr: | 20221214125710986 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125710986 DLGLOBAL DEBUG validating counter group 0x7f25b2f0ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125710986 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125710986 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125710986 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125710986 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125710988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125710988 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125710988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125710989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:12.003521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24417): Terminating (SIGTERM) 12:57:12.046332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24420): Terminating (SIGTERM) 12:57:12.089578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24423): Terminating (SIGTERM) 12:57:12.132732 --- ParallelTerminationStrategy: PID 24417 died... 12:57:12.153744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24417): Terminated: ok {rc=0} 12:57:12.201173 --- ParallelTerminationStrategy: PID 24420 died... 12:57:12.221632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24420): Terminated: ok {rc=0} 12:57:12.269097 --- ParallelTerminationStrategy: PID 24423 died... 12:57:12.289419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24423): Terminated: ok {rc=0} 12:57:12.378400 bus /sierra_3: Setting Powered False 12:57:13.477738 bus /sierra_3: Setting Powered False 12:57:14.594353 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:57:15.846381 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:15.857493 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:57:15.889861 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:57:15.923042 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:57:15.978251 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:57:16.009350 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:57:16.046810 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:57:16.606203 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:57:16.676688 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:16.692446 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:57:16.757522 tst mo_mt_call.py: using LAC 41050 12:57:16.899696 tst mo_mt_call.py: using RAC 250 12:57:17.030813 tst mo_mt_call.py: using CellId 41050 12:57:17.193032 tst mo_mt_call.py: using BVCI 41051 12:57:17.305690 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:17.316885 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:17.328024 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:17.339048 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:17.350137 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:17.361225 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:57:17.483814 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:57:17.604787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:18.123124 run create_hlr_db(pid=24429): Launched 12:57:18.251780 bus /sierra_2: Setting Powered False 12:57:19.317671 run create_hlr_db(pid=24429): Terminated: ok {rc=0} 12:57:19.789651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24431): Launched 12:57:20.125206 run osmo-hlr_10.42.42.2(pid=24432): Launched 12:57:20.252218 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:20.827017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24434): Launched 12:57:21.161998 run osmo-stp_10.42.42.5(pid=24435): Launched 12:57:21.289552 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:21.892097 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24437): Launched 12:57:22.228016 run osmo-msc_10.42.42.6(pid=24438): Launched 12:57:22.413258 run osmo-stp_10.42.42.5(pid=24435): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24435)] 12:57:22.553687 run osmo-stp_10.42.42.5(pid=24435): stdout: | (launched: 2022-12-14_12:57:21.099462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:22.694677 run osmo-stp_10.42.42.5(pid=24435): stderr: | 20221214125721296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125721296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125721297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125721297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125721297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125721297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125721298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:22.833937 run osmo-stp_10.42.42.5(pid=24435): stdout: | (launched: 2022-12-14_12:57:21.099462) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:22.966586 run osmo-stp_10.42.42.5(pid=24435): stderr: | 20221214125721296 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125721296 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125721297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125721297 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125721297 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125721297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125721298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:23.126026 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24435): Process ended prematurely: osmo-stp_10.42.42.5(pid=24435) [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24435)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:57:23.135607 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:57:23.163401 run osmo-hlr_10.42.42.2(pid=24432): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24432)] 12:57:23.214142 run osmo-hlr_10.42.42.2(pid=24432): stdout: | (launched: 2022-12-14_12:57:20.062537) 12:57:23.266214 run osmo-hlr_10.42.42.2(pid=24432): stderr: | 20221214125720264 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125720264 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125720264 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125720264 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125720264 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125720264 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125720279 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125720287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125720288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125720288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:23.339064 run osmo-msc_10.42.42.6(pid=24438): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24438)] 12:57:23.389351 run osmo-msc_10.42.42.6(pid=24438): stdout: | (launched: 2022-12-14_12:57:22.165665) 12:57:23.441904 run osmo-msc_10.42.42.6(pid=24438): stderr: | 20221214125722488 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125722488 DLGLOBAL DEBUG validating counter group 0x7fe2d2f95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125722488 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125722488 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125722488 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125722489 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125722490 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125722491 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125722491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125722491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:23.494291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24431): Terminating (SIGTERM) 12:57:23.536304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24434): Terminating (SIGTERM) 12:57:23.578724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24437): Terminating (SIGTERM) 12:57:23.621048 --- ParallelTerminationStrategy: PID 24431 died... 12:57:23.641402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24431): Terminated: ok {rc=0} 12:57:23.687810 --- ParallelTerminationStrategy: PID 24434 died... 12:57:23.707711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24434): Terminated: ok {rc=0} 12:57:23.754332 --- ParallelTerminationStrategy: PID 24437 died... 12:57:23.774224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24437): Terminated: ok {rc=0} 12:57:23.863651 bus /sierra_3: Setting Powered False 12:57:24.963577 bus /sierra_3: Setting Powered False 12:57:26.084131 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:57:27.238105 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:27.250584 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:57:27.312267 tst mo_mt_call_osmux.py: using LAC 41051 12:57:27.434082 tst mo_mt_call_osmux.py: using RAC 251 12:57:27.554397 tst mo_mt_call_osmux.py: using CellId 41051 12:57:27.676624 tst mo_mt_call_osmux.py: using BVCI 41052 12:57:27.789316 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:27.800393 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:27.811457 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:27.822545 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:27.833629 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:57:27.844611 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:57:27.966576 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:57:28.083917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:28.566975 run create_hlr_db(pid=24440): Launched 12:57:28.693582 bus /sierra_2: Setting Powered False 12:57:29.755611 run create_hlr_db(pid=24440): Terminated: ok {rc=0} 12:57:30.213663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24442): Launched 12:57:30.549629 run osmo-hlr_10.42.42.2(pid=24443): Launched 12:57:30.677296 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:31.278769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24445): Launched 12:57:31.617699 run osmo-stp_10.42.42.5(pid=24446): Launched 12:57:31.851099 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:32.568397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24448): Launched 12:57:32.881407 run osmo-msc_10.42.42.6(pid=24449): Launched 12:57:33.054683 run osmo-stp_10.42.42.5(pid=24446): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24446)] 12:57:33.185584 run osmo-stp_10.42.42.5(pid=24446): stdout: | (launched: 2022-12-14_12:57:31.551117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:33.316264 run osmo-stp_10.42.42.5(pid=24446): stderr: | 20221214125731882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125731882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125731883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125731883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125731883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125731883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125731884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:33.446091 run osmo-stp_10.42.42.5(pid=24446): stdout: | (launched: 2022-12-14_12:57:31.551117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:33.569567 run osmo-stp_10.42.42.5(pid=24446): stderr: | 20221214125731882 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125731882 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125731883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125731883 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125731883 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125731883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125731884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:33.717283 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24446): Process ended prematurely: osmo-stp_10.42.42.5(pid=24446) [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24446)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:57:33.726129 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:57:33.752641 run osmo-hlr_10.42.42.2(pid=24443): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24443)] 12:57:33.800937 run osmo-hlr_10.42.42.2(pid=24443): stdout: | (launched: 2022-12-14_12:57:30.487058) 12:57:33.851124 run osmo-hlr_10.42.42.2(pid=24443): stderr: | 20221214125730692 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125730692 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125730692 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125730692 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125730692 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125730693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125730705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125730715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125730715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125730715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:33.920542 run osmo-msc_10.42.42.6(pid=24449): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24449)] 12:57:33.968925 run osmo-msc_10.42.42.6(pid=24449): stdout: | (launched: 2022-12-14_12:57:32.822777) 12:57:34.018731 run osmo-msc_10.42.42.6(pid=24449): stderr: | 20221214125733098 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125733098 DLGLOBAL DEBUG validating counter group 0x7f47cd96ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125733098 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125733098 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125733098 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125733098 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125733100 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125733100 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125733101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125733101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:34.068708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24442): Terminating (SIGTERM) 12:57:34.108542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24445): Terminating (SIGTERM) 12:57:34.148665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24448): Terminating (SIGTERM) 12:57:34.188781 --- ParallelTerminationStrategy: PID 24442 died... 12:57:34.208245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24442): Terminated: ok {rc=0} 12:57:34.252765 --- ParallelTerminationStrategy: PID 24445 died... 12:57:34.271681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24445): Terminated: ok {rc=0} 12:57:34.315719 --- ParallelTerminationStrategy: PID 24448 died... 12:57:34.334389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24448): Terminated: ok {rc=0} 12:57:34.420233 bus /sierra_3: Setting Powered False 12:57:35.519885 bus /sierra_3: Setting Powered False 12:57:36.636045 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:57:37.871707 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:37.878206 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:57:37.898968 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:57:37.925759 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:57:37.976517 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:57:37.997535 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:57:38.024257 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:57:38.573304 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:57:38.624291 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:38.635500 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:57:38.692200 tst mo_mt_call.py: using LAC 41052 12:57:38.815609 tst mo_mt_call.py: using RAC 252 12:57:38.940180 tst mo_mt_call.py: using CellId 41052 12:57:39.062503 tst mo_mt_call.py: using BVCI 41053 12:57:39.177316 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:39.188411 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:39.199485 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:39.210478 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:39.221366 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:39.232385 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:57:39.353767 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:57:39.474780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:39.994224 run create_hlr_db(pid=24454): Launched 12:57:40.123608 bus /sierra_2: Setting Powered False 12:57:41.188738 run create_hlr_db(pid=24454): Terminated: ok {rc=0} 12:57:41.654220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24456): Launched 12:57:41.989384 run osmo-hlr_10.42.42.2(pid=24457): Launched 12:57:42.118614 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:42.696398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24459): Launched 12:57:43.031554 run osmo-stp_10.42.42.5(pid=24460): Launched 12:57:43.159030 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:43.761570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24462): Launched 12:57:44.097326 run osmo-msc_10.42.42.6(pid=24463): Launched 12:57:44.283279 run osmo-stp_10.42.42.5(pid=24460): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24460)] 12:57:44.424333 run osmo-stp_10.42.42.5(pid=24460): stdout: | (launched: 2022-12-14_12:57:42.969202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:44.566134 run osmo-stp_10.42.42.5(pid=24460): stderr: | 20221214125743163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125743163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125743163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125743164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125743164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125743164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125743164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:44.706011 run osmo-stp_10.42.42.5(pid=24460): stdout: | (launched: 2022-12-14_12:57:42.969202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:44.839444 run osmo-stp_10.42.42.5(pid=24460): stderr: | 20221214125743163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125743163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125743163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125743164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125743164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125743164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125743164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:44.999389 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24460): Process ended prematurely: osmo-stp_10.42.42.5(pid=24460) [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24460)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:57:45.008931 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:57:45.036818 run osmo-hlr_10.42.42.2(pid=24457): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24457)] 12:57:45.088245 run osmo-hlr_10.42.42.2(pid=24457): stdout: | (launched: 2022-12-14_12:57:41.926832) 12:57:45.141594 run osmo-hlr_10.42.42.2(pid=24457): stderr: | 20221214125742130 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125742130 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125742130 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125742130 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125742130 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125742130 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125742146 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125742155 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125742156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125742156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:45.214297 run osmo-msc_10.42.42.6(pid=24463): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24463)] 12:57:45.264645 run osmo-msc_10.42.42.6(pid=24463): stdout: | (launched: 2022-12-14_12:57:44.034862) 12:57:45.317215 run osmo-msc_10.42.42.6(pid=24463): stderr: | 20221214125744359 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125744359 DLGLOBAL DEBUG validating counter group 0x7ff0a894cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125744359 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125744359 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125744359 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125744360 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125744361 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125744362 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125744362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125744362 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:45.370368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24456): Terminating (SIGTERM) 12:57:45.412834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24459): Terminating (SIGTERM) 12:57:45.455582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24462): Terminating (SIGTERM) 12:57:45.498629 --- ParallelTerminationStrategy: PID 24456 died... 12:57:45.519471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24456): Terminated: ok {rc=0} 12:57:45.566863 --- ParallelTerminationStrategy: PID 24459 died... 12:57:45.587395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24459): Terminated: ok {rc=0} 12:57:45.634655 --- ParallelTerminationStrategy: PID 24462 died... 12:57:45.654954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24462): Terminated: ok {rc=0} 12:57:45.745934 bus /sierra_3: Setting Powered False 12:57:46.848023 bus /sierra_3: Setting Powered False 12:57:47.968320 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:57:49.116077 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:49.128033 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:57:49.184795 tst mo_mt_call_osmux.py: using LAC 41053 12:57:49.307791 tst mo_mt_call_osmux.py: using RAC 253 12:57:49.431625 tst mo_mt_call_osmux.py: using CellId 41053 12:57:49.557574 tst mo_mt_call_osmux.py: using BVCI 41054 12:57:49.671232 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:49.682367 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:49.693311 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:49.704102 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:49.714939 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:57:49.725859 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:57:49.843217 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:57:49.969301 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:57:50.488107 run create_hlr_db(pid=24465): Launched 12:57:50.615541 bus /sierra_2: Setting Powered False 12:57:51.680520 run create_hlr_db(pid=24465): Terminated: ok {rc=0} 12:57:52.145368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24467): Launched 12:57:52.479909 run osmo-hlr_10.42.42.2(pid=24468): Launched 12:57:52.606804 run osmo-stp_10.42.42.5: Starting osmo-stp 12:57:53.179336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24470): Launched 12:57:53.513607 run osmo-stp_10.42.42.5(pid=24471): Launched 12:57:53.641350 run osmo-msc_10.42.42.6: Starting osmo-msc 12:57:54.244472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24473): Launched 12:57:54.580265 run osmo-msc_10.42.42.6(pid=24474): Launched 12:57:54.765552 run osmo-stp_10.42.42.5(pid=24471): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24471)] 12:57:54.905902 run osmo-stp_10.42.42.5(pid=24471): stdout: | (launched: 2022-12-14_12:57:53.451142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:55.046911 run osmo-stp_10.42.42.5(pid=24471): stderr: | 20221214125753650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125753650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125753650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125753651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125753651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125753651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125753651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:55.187759 run osmo-stp_10.42.42.5(pid=24471): stdout: | (launched: 2022-12-14_12:57:53.451142) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:57:55.321159 run osmo-stp_10.42.42.5(pid=24471): stderr: | 20221214125753650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125753650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125753650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125753651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125753651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125753651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125753651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:57:55.480674 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24471): Process ended prematurely: osmo-stp_10.42.42.5(pid=24471) [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24471)] [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:57:55.490493 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:57:55.518342 run osmo-hlr_10.42.42.2(pid=24468): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24468)] 12:57:55.569591 run osmo-hlr_10.42.42.2(pid=24468): stdout: | (launched: 2022-12-14_12:57:52.417538) 12:57:55.622885 run osmo-hlr_10.42.42.2(pid=24468): stderr: | 20221214125752618 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125752618 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125752618 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125752618 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125752618 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125752618 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125752629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125752637 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125752637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125752637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:57:55.695831 run osmo-msc_10.42.42.6(pid=24474): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24474)] 12:57:55.745842 run osmo-msc_10.42.42.6(pid=24474): stdout: | (launched: 2022-12-14_12:57:54.517828) 12:57:55.798303 run osmo-msc_10.42.42.6(pid=24474): stderr: | 20221214125754842 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125754842 DLGLOBAL DEBUG validating counter group 0x7f46ac3d2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125754842 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125754842 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125754842 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125754843 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125754844 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125754845 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125754845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125754845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:57:55.851168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24467): Terminating (SIGTERM) 12:57:55.893157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24470): Terminating (SIGTERM) 12:57:55.935768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24473): Terminating (SIGTERM) 12:57:55.978309 --- ParallelTerminationStrategy: PID 24467 died... 12:57:55.998855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24467): Terminated: ok {rc=0} 12:57:56.045684 --- ParallelTerminationStrategy: PID 24470 died... 12:57:56.065803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24470): Terminated: ok {rc=0} 12:57:56.113184 --- ParallelTerminationStrategy: PID 24473 died... 12:57:56.133338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24473): Terminated: ok {rc=0} 12:57:56.222753 bus /sierra_3: Setting Powered False 12:57:57.321615 bus /sierra_3: Setting Powered False 12:57:58.437820 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:57:59.677753 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:57:59.684788 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:57:59.706309 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:57:59.734714 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:57:59.787333 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:57:59.808872 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:57:59.836587 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:58:00.386464 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:58:00.436027 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:00.447162 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:58:00.502973 tst mo_mt_call.py: using LAC 41054 12:58:00.625908 tst mo_mt_call.py: using RAC 254 12:58:00.746453 tst mo_mt_call.py: using CellId 41054 12:58:00.871842 tst mo_mt_call.py: using BVCI 41055 12:58:00.992371 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:01.004173 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:01.015724 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:01.027214 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:01.038739 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:01.051818 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:58:01.177058 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:58:01.326200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:01.881815 run create_hlr_db(pid=24479): Launched 12:58:02.049558 bus /sierra_2: Setting Powered False 12:58:03.116312 run create_hlr_db(pid=24479): Terminated: ok {rc=0} 12:58:03.585257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24481): Launched 12:58:03.922331 run osmo-hlr_10.42.42.2(pid=24482): Launched 12:58:04.049983 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:04.630218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24484): Launched 12:58:04.965936 run osmo-stp_10.42.42.5(pid=24485): Launched 12:58:05.094012 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:05.700182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24487): Launched 12:58:06.035917 run osmo-msc_10.42.42.6(pid=24488): Launched 12:58:06.221787 run osmo-stp_10.42.42.5(pid=24485): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24485)] 12:58:06.362223 run osmo-stp_10.42.42.5(pid=24485): stdout: | (launched: 2022-12-14_12:58:04.903220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:06.503666 run osmo-stp_10.42.42.5(pid=24485): stderr: | 20221214125805097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125805098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125805098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125805098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125805099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125805099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125805099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:06.643240 run osmo-stp_10.42.42.5(pid=24485): stdout: | (launched: 2022-12-14_12:58:04.903220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:06.776821 run osmo-stp_10.42.42.5(pid=24485): stderr: | 20221214125805097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125805098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125805098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125805098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125805099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125805099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125805099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:06.936630 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24485): Process ended prematurely: osmo-stp_10.42.42.5(pid=24485) [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24485)] [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:58:06.946548 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:58:06.974559 run osmo-hlr_10.42.42.2(pid=24482): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24482)] 12:58:07.026489 run osmo-hlr_10.42.42.2(pid=24482): stdout: | (launched: 2022-12-14_12:58:03.859679) 12:58:07.079431 run osmo-hlr_10.42.42.2(pid=24482): stderr: | 20221214125804065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125804065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125804065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125804065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125804066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125804066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125804078 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125804086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125804086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125804086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:07.153377 run osmo-msc_10.42.42.6(pid=24488): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24488)] 12:58:07.203965 run osmo-msc_10.42.42.6(pid=24488): stdout: | (launched: 2022-12-14_12:58:05.973475) 12:58:07.256656 run osmo-msc_10.42.42.6(pid=24488): stderr: | 20221214125806298 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125806298 DLGLOBAL DEBUG validating counter group 0x7f15fde1ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125806298 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125806299 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125806299 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125806299 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125806301 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125806301 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125806301 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125806301 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:07.310009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24481): Terminating (SIGTERM) 12:58:07.352513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24484): Terminating (SIGTERM) 12:58:07.395402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24487): Terminating (SIGTERM) 12:58:07.438569 --- ParallelTerminationStrategy: PID 24481 died... 12:58:07.459397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24481): Terminated: ok {rc=0} 12:58:07.506906 --- ParallelTerminationStrategy: PID 24484 died... 12:58:07.527270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24484): Terminated: ok {rc=0} 12:58:07.574685 --- ParallelTerminationStrategy: PID 24487 died... 12:58:07.595071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24487): Terminated: ok {rc=0} 12:58:07.684257 bus /sierra_3: Setting Powered False 12:58:08.784757 bus /sierra_3: Setting Powered False 12:58:09.901417 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:58:11.054020 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:11.066596 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:58:11.129246 tst mo_mt_call_osmux.py: using LAC 41055 12:58:11.259781 tst mo_mt_call_osmux.py: using RAC 255 12:58:11.390577 tst mo_mt_call_osmux.py: using CellId 41055 12:58:11.519044 tst mo_mt_call_osmux.py: using BVCI 41056 12:58:11.640626 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:11.652609 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:11.664088 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:11.675493 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:11.687422 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:58:11.699468 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:58:11.816804 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:58:11.939680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:12.460396 run create_hlr_db(pid=24490): Launched 12:58:12.587083 bus /sierra_2: Setting Powered False 12:58:13.652305 run create_hlr_db(pid=24490): Terminated: ok {rc=0} 12:58:14.119233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24492): Launched 12:58:14.456139 run osmo-hlr_10.42.42.2(pid=24493): Launched 12:58:14.583477 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:15.163413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24495): Launched 12:58:15.499552 run osmo-stp_10.42.42.5(pid=24496): Launched 12:58:15.629683 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:16.250273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24498): Launched 12:58:16.588165 run osmo-msc_10.42.42.6(pid=24499): Launched 12:58:16.948812 run osmo-stp_10.42.42.5(pid=24496): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24496)] 12:58:17.220415 run osmo-stp_10.42.42.5(pid=24496): stdout: | (launched: 2022-12-14_12:58:15.437030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:17.361959 run osmo-stp_10.42.42.5(pid=24496): stderr: | 20221214125815633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125815633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125815633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125815634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125815634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125815634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125815634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:17.501660 run osmo-stp_10.42.42.5(pid=24496): stdout: | (launched: 2022-12-14_12:58:15.437030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:17.635292 run osmo-stp_10.42.42.5(pid=24496): stderr: | 20221214125815633 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125815633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125815633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125815634 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125815634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125815634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125815634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:17.795655 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24496): Process ended prematurely: osmo-stp_10.42.42.5(pid=24496) [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24496)] [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:58:17.805714 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 12:58:17.834068 run osmo-hlr_10.42.42.2(pid=24493): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24493)] 12:58:17.886143 run osmo-hlr_10.42.42.2(pid=24493): stdout: | (launched: 2022-12-14_12:58:14.393587) 12:58:17.939381 run osmo-hlr_10.42.42.2(pid=24493): stderr: | 20221214125814595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125814595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125814595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125814595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125814596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125814596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125814608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125814617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125814617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125814617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:18.013061 run osmo-msc_10.42.42.6(pid=24499): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24499)] 12:58:18.063703 run osmo-msc_10.42.42.6(pid=24499): stdout: | (launched: 2022-12-14_12:58:16.524344) 12:58:18.117363 run osmo-msc_10.42.42.6(pid=24499): stderr: | 20221214125817111 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125817111 DLGLOBAL DEBUG validating counter group 0x7f502ea17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125817112 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125817112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125817112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125817112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125817114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125817114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125817114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125817114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:18.170530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24492): Terminating (SIGTERM) 12:58:18.212931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24495): Terminating (SIGTERM) 12:58:18.255834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24498): Terminating (SIGTERM) 12:58:18.298769 --- ParallelTerminationStrategy: PID 24492 died... 12:58:18.319719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24492): Terminated: ok {rc=0} 12:58:18.367883 --- ParallelTerminationStrategy: PID 24495 died... 12:58:18.388292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24495): Terminated: ok {rc=0} 12:58:18.435616 --- ParallelTerminationStrategy: PID 24498 died... 12:58:18.456037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24498): Terminated: ok {rc=0} 12:58:18.546212 bus /sierra_3: Setting Powered False 12:58:19.644019 bus /sierra_3: Setting Powered False 12:58:20.758934 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:58:22.001939 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:58:22.008676 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:58:22.030781 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:58:22.059220 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:58:22.113836 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:58:22.135776 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:58:22.163482 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:58:22.709886 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:58:22.763768 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:22.775218 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:58:22.832750 tst mo_mt_call.py: using LAC 41056 12:58:22.954519 tst mo_mt_call.py: using RAC 1 12:58:23.077588 tst mo_mt_call.py: using CellId 41056 12:58:23.199259 tst mo_mt_call.py: using BVCI 41057 12:58:23.313374 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:23.324377 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:23.335151 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:23.345845 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:23.356383 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:23.367605 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:58:23.489546 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:58:23.610415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:24.095254 run create_hlr_db(pid=24506): Launched 12:58:24.221697 bus /sierra_2: Setting Powered False 12:58:25.283677 run create_hlr_db(pid=24506): Terminated: ok {rc=0} 12:58:25.718986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24508): Launched 12:58:26.030484 run osmo-hlr_10.42.42.2(pid=24509): Launched 12:58:26.148388 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:26.700092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24511): Launched 12:58:27.012802 run osmo-stp_10.42.42.5(pid=24512): Launched 12:58:27.132062 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:27.695632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24514): Launched 12:58:28.007937 run osmo-msc_10.42.42.6(pid=24515): Launched 12:58:28.181944 run osmo-stp_10.42.42.5(pid=24512): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24512)] 12:58:28.314107 run osmo-stp_10.42.42.5(pid=24512): stdout: | (launched: 2022-12-14_12:58:26.954036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:28.446675 run osmo-stp_10.42.42.5(pid=24512): stderr: | 20221214125827127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125827127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125827127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125827128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125827130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125827130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125827130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:28.576072 run osmo-stp_10.42.42.5(pid=24512): stdout: | (launched: 2022-12-14_12:58:26.954036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:28.700046 run osmo-stp_10.42.42.5(pid=24512): stderr: | 20221214125827127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125827127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125827127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125827128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125827130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125827130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125827130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:28.848274 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24512): Process ended prematurely: osmo-stp_10.42.42.5(pid=24512) [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24512)] [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:58:28.857409 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:58:28.883964 run osmo-hlr_10.42.42.2(pid=24509): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24509)] 12:58:28.932072 run osmo-hlr_10.42.42.2(pid=24509): stdout: | (launched: 2022-12-14_12:58:25.971390) 12:58:28.981495 run osmo-hlr_10.42.42.2(pid=24509): stderr: | 20221214125826149 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125826149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125826149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125826149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125826149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125826149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125826161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125826169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125826170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125826170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:29.050421 run osmo-msc_10.42.42.6(pid=24515): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24515)] 12:58:29.098064 run osmo-msc_10.42.42.6(pid=24515): stdout: | (launched: 2022-12-14_12:58:27.948564) 12:58:29.147198 run osmo-msc_10.42.42.6(pid=24515): stderr: | 20221214125828224 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125828224 DLGLOBAL DEBUG validating counter group 0x7fd052df7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125828224 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125828224 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125828224 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125828225 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125828226 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125828227 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125828227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125828227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:29.197226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24508): Terminating (SIGTERM) 12:58:29.237099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24511): Terminating (SIGTERM) 12:58:29.276764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24514): Terminating (SIGTERM) 12:58:29.316746 --- ParallelTerminationStrategy: PID 24508 died... 12:58:29.335952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24508): Terminated: ok {rc=0} 12:58:29.380039 --- ParallelTerminationStrategy: PID 24511 died... 12:58:29.398723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24511): Terminated: ok {rc=0} 12:58:29.442799 --- ParallelTerminationStrategy: PID 24514 died... 12:58:29.461514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24514): Terminated: ok {rc=0} 12:58:29.545112 bus /sierra_3: Setting Powered False 12:58:30.642592 bus /sierra_3: Setting Powered False 12:58:31.764835 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:58:32.932738 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:32.944736 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:58:33.005150 tst mo_mt_call_osmux.py: using LAC 41057 12:58:33.139817 tst mo_mt_call_osmux.py: using RAC 2 12:58:33.269365 tst mo_mt_call_osmux.py: using CellId 41057 12:58:33.398967 tst mo_mt_call_osmux.py: using BVCI 41058 12:58:33.520581 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:33.532019 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:33.543204 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:33.554395 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:33.565846 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:58:33.577423 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:58:33.699193 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:58:33.816675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:34.300532 run create_hlr_db(pid=24517): Launched 12:58:34.428695 bus /sierra_2: Setting Powered False 12:58:35.491263 run create_hlr_db(pid=24517): Terminated: ok {rc=0} 12:58:35.947378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24519): Launched 12:58:36.268917 run osmo-hlr_10.42.42.2(pid=24520): Launched 12:58:36.388160 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:36.925982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24522): Launched 12:58:37.239258 run osmo-stp_10.42.42.5(pid=24523): Launched 12:58:37.357277 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:37.919331 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24525): Launched 12:58:38.231185 run osmo-msc_10.42.42.6(pid=24526): Launched 12:58:38.405756 run osmo-stp_10.42.42.5(pid=24523): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24523)] 12:58:38.537895 run osmo-stp_10.42.42.5(pid=24523): stdout: | (launched: 2022-12-14_12:58:37.180357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:38.668850 run osmo-stp_10.42.42.5(pid=24523): stderr: | 20221214125837354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125837354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125837355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125837355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125837356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125837356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125837356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:38.797590 run osmo-stp_10.42.42.5(pid=24523): stdout: | (launched: 2022-12-14_12:58:37.180357) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:38.921123 run osmo-stp_10.42.42.5(pid=24523): stderr: | 20221214125837354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125837354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125837355 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125837355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125837356 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125837356 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125837356 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:39.068559 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24523): Process ended prematurely: osmo-stp_10.42.42.5(pid=24523) [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24523)] [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:58:39.077426 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:58:39.103596 run osmo-hlr_10.42.42.2(pid=24520): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24520)] 12:58:39.152115 run osmo-hlr_10.42.42.2(pid=24520): stdout: | (launched: 2022-12-14_12:58:36.209750) 12:58:39.201568 run osmo-hlr_10.42.42.2(pid=24520): stderr: | 20221214125836390 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125836390 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125836390 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125836390 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125836390 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125836390 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125836402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125836410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125836411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125836411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:39.270545 run osmo-msc_10.42.42.6(pid=24526): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24526)] 12:58:39.318234 run osmo-msc_10.42.42.6(pid=24526): stdout: | (launched: 2022-12-14_12:58:38.172269) 12:58:39.367666 run osmo-msc_10.42.42.6(pid=24526): stderr: | 20221214125838450 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125838450 DLGLOBAL DEBUG validating counter group 0x7ff096a83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125838451 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125838451 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125838451 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125838451 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125838453 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125838453 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125838453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125838453 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:39.417547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24519): Terminating (SIGTERM) 12:58:39.457124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24522): Terminating (SIGTERM) 12:58:39.496790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24525): Terminating (SIGTERM) 12:58:39.536789 --- ParallelTerminationStrategy: PID 24519 died... 12:58:39.555950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24519): Terminated: ok {rc=0} 12:58:39.600055 --- ParallelTerminationStrategy: PID 24522 died... 12:58:39.618691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24522): Terminated: ok {rc=0} 12:58:39.662633 --- ParallelTerminationStrategy: PID 24525 died... 12:58:39.681761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24525): Terminated: ok {rc=0} 12:58:39.767947 bus /sierra_3: Setting Powered False 12:58:40.868372 bus /sierra_3: Setting Powered False 12:58:41.982760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 emergency:sysmo --------------------------------------------------------------------- 12:58:43.222824 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:58:43.227564 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 12:58:43.249089 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 12:58:43.277820 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 12:58:43.365488 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 12:58:43.386537 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 12:58:43.413097 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 12:58:43.996390 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2405 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 12:58:44.001645 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:44.012314 tst emergency:sysmo: Using 1 x bts (candidates: 1) 12:58:44.047141 tst emergency_mo_mt_call.py: using LAC 41058 12:58:44.166897 tst emergency_mo_mt_call.py: using RAC 3 12:58:44.286827 tst emergency_mo_mt_call.py: using CellId 41058 12:58:44.406214 tst emergency_mo_mt_call.py: using BVCI 41059 12:58:44.518843 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:44.529600 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:44.540087 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:44.550560 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:44.560899 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:44.571404 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:58:44.691047 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:58:44.807984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:45.285435 run create_hlr_db(pid=24531): Launched 12:58:45.410508 bus /sierra_2: Setting Powered False 12:58:46.474110 run create_hlr_db(pid=24531): Terminated: ok {rc=0} 12:58:46.912522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24533): Launched 12:58:47.298226 run osmo-hlr_10.42.42.2(pid=24534): Launched 12:58:47.416043 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:47.950796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24536): Launched 12:58:48.258431 run osmo-stp_10.42.42.5(pid=24537): Launched 12:58:48.384160 tst emergency_mo_mt_call.py: using MSISDN 8700 12:58:48.542861 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:49.094327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24539): Launched 12:58:49.401938 run osmo-msc_10.42.42.6(pid=24540): Launched 12:58:49.571876 run osmo-stp_10.42.42.5(pid=24537): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24537)] 12:58:49.700778 run osmo-stp_10.42.42.5(pid=24537): stdout: | (launched: 2022-12-14_12:58:48.199959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:49.829682 run osmo-stp_10.42.42.5(pid=24537): stderr: | 20221214125848374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125848374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125848375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125848375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125848376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125848377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125848377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:49.956337 run osmo-stp_10.42.42.5(pid=24537): stdout: | (launched: 2022-12-14_12:58:48.199959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:58:50.078340 run osmo-stp_10.42.42.5(pid=24537): stderr: | 20221214125848374 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125848374 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125848375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125848375 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125848376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125848377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125848377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:58:50.223784 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=24537): Process ended prematurely: osmo-stp_10.42.42.5(pid=24537) [trial-2405↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24537)] [trial-2405↪emergency:sysmo↪emergency_mo_mt_call.py:19] 12:58:50.232046 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 12:58:50.258115 run osmo-hlr_10.42.42.2(pid=24534): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24534)] 12:58:50.306789 run osmo-hlr_10.42.42.2(pid=24534): stdout: | (launched: 2022-12-14_12:58:47.239456) 12:58:50.356529 run osmo-hlr_10.42.42.2(pid=24534): stderr: | 20221214125847421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125847421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125847421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125847421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125847421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125847421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125847434 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125847442 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125847442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125847442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:58:50.426043 run osmo-msc_10.42.42.6(pid=24540): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24540)] 12:58:50.474128 run osmo-msc_10.42.42.6(pid=24540): stdout: | (launched: 2022-12-14_12:58:49.343611) 12:58:50.523822 run osmo-msc_10.42.42.6(pid=24540): stderr: | 20221214125849618 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125849618 DLGLOBAL DEBUG validating counter group 0x7f1520f99c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125849619 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125849619 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125849619 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125849619 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125849621 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125849621 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125849621 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125849621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:58:50.574583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24533): Terminating (SIGTERM) 12:58:50.614664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24536): Terminating (SIGTERM) 12:58:50.654746 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24539): Terminating (SIGTERM) 12:58:50.695349 --- ParallelTerminationStrategy: PID 24533 died... 12:58:50.714536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24533): Terminated: ok {rc=0} 12:58:50.758917 --- ParallelTerminationStrategy: PID 24536 died... 12:58:50.777702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24536): Terminated: ok {rc=0} 12:58:50.822055 --- ParallelTerminationStrategy: PID 24539 died... 12:58:50.840797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24539): Terminated: ok {rc=0} 12:58:50.927556 bus /sierra_3: Setting Powered False 12:58:52.028425 bus /sierra_3: Setting Powered False 12:58:53.148033 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 12:58:54.237260 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:54.248739 tst emergency:sysmo: Using 1 x bts (candidates: 1) 12:58:54.286827 tst emergency_preemptive_call.py: using LAC 41059 12:58:54.407246 tst emergency_preemptive_call.py: using RAC 4 12:58:54.528340 tst emergency_preemptive_call.py: using CellId 41059 12:58:54.649626 tst emergency_preemptive_call.py: using BVCI 41060 12:58:54.762185 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:54.772786 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:54.783421 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:54.793917 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:54.804324 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 12:58:54.815338 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:58:54.937611 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:58:55.055773 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:58:55.175752 tst emergency:sysmo: Using 1 x modem (candidates: 4) 12:58:55.292180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:58:55.767225 run create_hlr_db(pid=24542): Launched 12:58:55.892718 bus /sierra_2: Setting Powered False 12:58:56.953492 run create_hlr_db(pid=24542): Terminated: ok {rc=0} 12:58:57.403968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24544): Launched 12:58:57.736118 run osmo-hlr_10.42.42.2(pid=24545): Launched 12:58:57.862470 run osmo-stp_10.42.42.5: Starting osmo-stp 12:58:58.433264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24547): Launched 12:58:58.764273 run osmo-stp_10.42.42.5(pid=24548): Launched 12:58:58.898137 tst emergency_preemptive_call.py: using MSISDN 8701 12:58:59.072797 run osmo-msc_10.42.42.6: Starting osmo-msc 12:58:59.664305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24550): Launched 12:58:59.995100 run osmo-msc_10.42.42.6(pid=24551): Launched 12:59:00.185509 run osmo-stp_10.42.42.5(pid=24548): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24548)] 12:59:00.324508 run osmo-stp_10.42.42.5(pid=24548): stdout: | (launched: 2022-12-14_12:58:58.702311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:00.463597 run osmo-stp_10.42.42.5(pid=24548): stderr: | 20221214125858899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125858899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125858899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125858899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125858900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125858900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125858900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:00.600932 run osmo-stp_10.42.42.5(pid=24548): stdout: | (launched: 2022-12-14_12:58:58.702311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:00.732640 run osmo-stp_10.42.42.5(pid=24548): stderr: | 20221214125858899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125858899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125858899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125858899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125858900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125858900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125858900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:00.907029 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=24548): Process ended prematurely: osmo-stp_10.42.42.5(pid=24548) [trial-2405↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24548)] [trial-2405↪emergency:sysmo↪emergency_preemptive_call.py:32] 12:59:00.921335 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 12:59:00.948727 run osmo-hlr_10.42.42.2(pid=24545): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24545)] 12:59:00.997783 run osmo-hlr_10.42.42.2(pid=24545): stdout: | (launched: 2022-12-14_12:58:57.674174) 12:59:01.051046 run osmo-hlr_10.42.42.2(pid=24545): stderr: | 20221214125857876 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125857876 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125857876 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125857876 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125857876 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125857876 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125857889 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125857897 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125857897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125857898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:01.122247 run osmo-msc_10.42.42.6(pid=24551): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24551)] 12:59:01.171652 run osmo-msc_10.42.42.6(pid=24551): stdout: | (launched: 2022-12-14_12:58:59.933056) 12:59:01.223130 run osmo-msc_10.42.42.6(pid=24551): stderr: | 20221214125900258 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214125900258 DLGLOBAL DEBUG validating counter group 0x7f593d1e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214125900259 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214125900259 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214125900259 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214125900259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214125900261 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214125900261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214125900261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214125900261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:59:01.273866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24544): Terminating (SIGTERM) 12:59:01.315533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24547): Terminating (SIGTERM) 12:59:01.359183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24550): Terminating (SIGTERM) 12:59:01.402969 --- ParallelTerminationStrategy: PID 24544 died... 12:59:01.423810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24544): Terminated: ok {rc=0} 12:59:01.470666 --- ParallelTerminationStrategy: PID 24547 died... 12:59:01.490095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24547): Terminated: ok {rc=0} 12:59:01.535925 --- ParallelTerminationStrategy: PID 24550 died... 12:59:01.555563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24550): Terminated: ok {rc=0} 12:59:01.642320 bus /sierra_9: Setting Powered False 12:59:02.740419 bus /sierra_9: Setting Powered False 12:59:03.857371 bus /sierra_8: Setting Powered False 12:59:04.955141 bus /sierra_8: Setting Powered False 12:59:06.070144 bus /sierra_3: Setting Powered False 12:59:07.167745 bus /sierra_3: Setting Powered False 12:59:08.283822 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:sysmo --------------------------------------------------------------------- 12:59:09.541743 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:59:09.546441 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 12:59:09.567686 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 12:59:09.608271 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 12:59:09.698039 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 12:59:09.719233 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 12:59:09.758725 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 12:59:10.349847 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 12:59:10.404572 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:10.415405 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:59:10.450466 tst cs_paging_gprs_active.py: using LAC 41060 12:59:10.579945 tst cs_paging_gprs_active.py: using RAC 5 12:59:10.705697 tst cs_paging_gprs_active.py: using CellId 41060 12:59:10.833312 tst cs_paging_gprs_active.py: using BVCI 41061 12:59:10.952350 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:10.963219 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:10.974007 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:10.984661 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:10.995698 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:11.006783 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:11.017971 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:11.028866 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:11.040076 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:59:11.155801 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:59:11.274973 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:59:11.498794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:11.831352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24556): Launched 12:59:12.118394 run iperf3-srv_10.42.42.10(pid=24557): Launched 12:59:12.242089 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:59:12.464528 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:12.796105 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24558): Launched 12:59:13.082129 run iperf3-srv_10.42.42.10(pid=24559): Launched 12:59:13.205748 tst cs_paging_gprs_active.py:38: start network... 12:59:13.427735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:13.938259 run create_hlr_db(pid=24560): Launched 12:59:14.071427 bus /sierra_2: Setting Powered False 12:59:15.136883 run create_hlr_db(pid=24560): Terminated: ok {rc=0} 12:59:15.576901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24562): Launched 12:59:15.887780 run osmo-hlr_10.42.42.2(pid=24563): Launched 12:59:16.133615 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:16.838219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24565): Launched 12:59:17.193642 run osmo-stp_10.42.42.5(pid=24566): Launched 12:59:17.327810 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:18.859484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24568): Launched 12:59:18.976229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:19.236355 run patchelf(pid=24569): Launched 12:59:19.407192 run osmo-stp_10.42.42.5(pid=24566): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24566)] 12:59:19.535959 run osmo-stp_10.42.42.5(pid=24566): stdout: | (launched: 2022-12-14_12:59:17.122978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:19.666749 run osmo-stp_10.42.42.5(pid=24566): stderr: | 20221214125917442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125917442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125917442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125917443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125917443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125917443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125917443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:19.797537 run osmo-stp_10.42.42.5(pid=24566): stdout: | (launched: 2022-12-14_12:59:17.122978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:19.922401 run osmo-stp_10.42.42.5(pid=24566): stderr: | 20221214125917442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125917442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125917442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125917443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125917443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125917443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125917443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:20.070709 run patchelf(pid=24569): Terminating (SIGINT) 12:59:20.241674 run patchelf(pid=24569): Terminated: ok {rc=0} 12:59:20.365189 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24566): Process ended prematurely: osmo-stp_10.42.42.5(pid=24566) [trial-2405↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24566)] [trial-2405↪gprs:sysmo↪cs_paging_gprs_active.py:38] 12:59:20.374297 tst cs_paging_gprs_active.py:38: Test FAILED (10.0 sec) 12:59:20.401401 run osmo-hlr_10.42.42.2(pid=24563): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24563)] 12:59:20.449197 run osmo-hlr_10.42.42.2(pid=24563): stdout: | (launched: 2022-12-14_12:59:15.825877) 12:59:20.498414 run osmo-hlr_10.42.42.2(pid=24563): stderr: | 20221214125916053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125916053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125916053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125916053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125916053 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125916053 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125916096 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125916110 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125916114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125916116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:20.547997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24556): Terminating (SIGTERM) 12:59:20.587701 run iperf3-srv_10.42.42.10(pid=24557): Terminating (SIGTERM) 12:59:20.627314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24558): Terminating (SIGTERM) 12:59:20.666982 run iperf3-srv_10.42.42.10(pid=24559): Terminating (SIGTERM) 12:59:20.706542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24562): Terminating (SIGTERM) 12:59:20.746267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24565): Terminating (SIGTERM) 12:59:20.786413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24568): Terminating (SIGTERM) 12:59:20.826674 --- ParallelTerminationStrategy: PID 24556 died... 12:59:20.845943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24556): Terminated: ok {rc=0} 12:59:20.890126 --- ParallelTerminationStrategy: PID 24557 died... 12:59:20.908734 run iperf3-srv_10.42.42.10(pid=24557): Terminated {rc=256} 12:59:20.952496 --- ParallelTerminationStrategy: PID 24558 died... 12:59:20.971224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24558): Terminated: ok {rc=0} 12:59:21.015341 --- ParallelTerminationStrategy: PID 24559 died... 12:59:21.034002 run iperf3-srv_10.42.42.10(pid=24559): Terminated {rc=256} 12:59:21.077920 --- ParallelTerminationStrategy: PID 24562 died... 12:59:21.096676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24562): Terminated: ok {rc=0} 12:59:21.141287 --- ParallelTerminationStrategy: PID 24565 died... 12:59:21.160010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24565): Terminated: ok {rc=0} 12:59:21.203964 --- ParallelTerminationStrategy: PID 24568 died... 12:59:21.222754 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24568): Terminated: ok {rc=0} 12:59:21.309527 bus /gobi_0: Setting Powered False 12:59:22.408771 bus /gobi_0: Setting Powered False 12:59:23.523383 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo iperf3.py ---------------------------------------------- 12:59:24.671440 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:24.682662 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:59:24.719297 tst iperf3.py: using LAC 41061 12:59:24.839422 tst iperf3.py: using RAC 6 12:59:24.960488 tst iperf3.py: using CellId 41061 12:59:25.081759 tst iperf3.py: using BVCI 41062 12:59:25.204101 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:25.215376 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:25.226556 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:25.237558 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:25.248908 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:25.260374 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:25.271962 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:25.283180 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:25.294624 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:59:25.410217 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:59:25.615910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:25.923769 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24570): Launched 12:59:26.191021 run iperf3-srv_10.42.42.10(pid=24571): Launched 12:59:26.305163 tst iperf3.py:8: start network... 12:59:26.508714 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:26.982154 run create_hlr_db(pid=24572): Launched 12:59:27.106367 bus /gobi_6: Setting Powered False 12:59:28.167397 run create_hlr_db(pid=24572): Terminated: ok {rc=0} 12:59:28.593847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24574): Launched 12:59:28.901429 run osmo-hlr_10.42.42.2(pid=24575): Launched 12:59:29.017982 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:29.558467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24577): Launched 12:59:29.863494 run osmo-stp_10.42.42.5(pid=24578): Launched 12:59:29.979124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:30.503979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24580): Launched 12:59:30.620835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:30.901730 run patchelf(pid=24581): Launched 12:59:31.076798 run osmo-stp_10.42.42.5(pid=24578): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24578)] 12:59:31.208413 run osmo-stp_10.42.42.5(pid=24578): stdout: | (launched: 2022-12-14_12:59:29.805701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:31.341188 run osmo-stp_10.42.42.5(pid=24578): stderr: | 20221214125929976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125929976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125929976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125929977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125929979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125929979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125929979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:31.474849 run osmo-stp_10.42.42.5(pid=24578): stdout: | (launched: 2022-12-14_12:59:29.805701) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:31.602425 run osmo-stp_10.42.42.5(pid=24578): stderr: | 20221214125929976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125929976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125929976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125929977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125929979 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125929979 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125929979 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:31.753595 run patchelf(pid=24581): Terminating (SIGINT) 12:59:31.928322 run patchelf(pid=24581): Terminated: ok {rc=0} 12:59:32.054338 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24578): Process ended prematurely: osmo-stp_10.42.42.5(pid=24578) [trial-2405↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24578)] [trial-2405↪gprs:sysmo↪iperf3.py:8] 12:59:32.064874 tst iperf3.py:8: Test FAILED (7.4 sec) 12:59:32.093237 run osmo-hlr_10.42.42.2(pid=24575): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24575)] 12:59:32.142692 run osmo-hlr_10.42.42.2(pid=24575): stdout: | (launched: 2022-12-14_12:59:28.843375) 12:59:32.192885 run osmo-hlr_10.42.42.2(pid=24575): stderr: | 20221214125929025 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125929025 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125929025 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125929025 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125929025 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125929025 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125929038 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125929046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125929047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125929047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:32.243864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24570): Terminating (SIGTERM) 12:59:32.283905 run iperf3-srv_10.42.42.10(pid=24571): Terminating (SIGTERM) 12:59:32.323862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24574): Terminating (SIGTERM) 12:59:32.364072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24577): Terminating (SIGTERM) 12:59:32.404058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24580): Terminating (SIGTERM) 12:59:32.444241 --- ParallelTerminationStrategy: PID 24570 died... 12:59:32.463662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24570): Terminated: ok {rc=0} 12:59:32.507680 --- ParallelTerminationStrategy: PID 24571 died... 12:59:32.526464 run iperf3-srv_10.42.42.10(pid=24571): Terminated {rc=256} 12:59:32.570384 --- ParallelTerminationStrategy: PID 24574 died... 12:59:32.589139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24574): Terminated: ok {rc=0} 12:59:32.633245 --- ParallelTerminationStrategy: PID 24577 died... 12:59:32.652079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24577): Terminated: ok {rc=0} 12:59:32.696298 --- ParallelTerminationStrategy: PID 24580 died... 12:59:32.715208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24580): Terminated: ok {rc=0} 12:59:32.801110 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo iperf3m4.py ---------------------------------------------- 12:59:33.948669 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:33.959909 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:59:33.998706 tst iperf3m4.py: using LAC 41062 12:59:34.118642 tst iperf3m4.py: using RAC 7 12:59:34.236349 tst iperf3m4.py: using CellId 41062 12:59:34.354256 tst iperf3m4.py: using BVCI 41063 12:59:34.466084 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:34.476496 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:34.486885 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:34.497141 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:34.507244 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:34.517338 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:34.527707 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:34.537906 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:34.548194 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:59:34.661263 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:59:34.783626 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:59:34.905539 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:59:35.024366 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:59:35.247715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:35.580124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24583): Launched 12:59:35.863804 run iperf3-srv_10.42.42.10(pid=24584): Launched 12:59:35.977860 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:59:36.180925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:36.485028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24585): Launched 12:59:36.749232 run iperf3-srv_10.42.42.10(pid=24586): Launched 12:59:36.862785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:59:37.065563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:37.369354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24587): Launched 12:59:37.633482 run iperf3-srv_10.42.42.10(pid=24588): Launched 12:59:37.746299 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:59:37.947673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:59:38.250582 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24589): Launched 12:59:38.529351 run iperf3-srv_10.42.42.10(pid=24590): Launched 12:59:38.642664 tst iperf3m4.py:8: start network... 12:59:38.844770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:39.314017 run create_hlr_db(pid=24591): Launched 12:59:39.437823 bus /gobi_6: Setting Powered False 12:59:40.498086 run create_hlr_db(pid=24591): Terminated: ok {rc=0} 12:59:40.920684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24593): Launched 12:59:41.225942 run osmo-hlr_10.42.42.2(pid=24594): Launched 12:59:41.340181 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:41.863457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24596): Launched 12:59:42.165870 run osmo-stp_10.42.42.5(pid=24597): Launched 12:59:42.280802 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:42.801046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24599): Launched 12:59:42.916461 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:43.173088 run patchelf(pid=24600): Launched 12:59:43.341722 run osmo-stp_10.42.42.5(pid=24597): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24597)] 12:59:43.469259 run osmo-stp_10.42.42.5(pid=24597): stdout: | (launched: 2022-12-14_12:59:42.109865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:43.598382 run osmo-stp_10.42.42.5(pid=24597): stderr: | 20221214125942282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125942283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125942283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125942283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125942284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125942284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125942284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:43.728143 run osmo-stp_10.42.42.5(pid=24597): stdout: | (launched: 2022-12-14_12:59:42.109865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:43.852036 run osmo-stp_10.42.42.5(pid=24597): stderr: | 20221214125942282 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125942283 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125942283 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125942283 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125942284 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125942284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125942284 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:43.999004 run patchelf(pid=24600): Terminating (SIGINT) 12:59:44.168071 run patchelf(pid=24600): Terminated: ok {rc=0} 12:59:44.289897 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24597): Process ended prematurely: osmo-stp_10.42.42.5(pid=24597) [trial-2405↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24597)] [trial-2405↪gprs:sysmo↪iperf3m4.py:8] 12:59:44.299437 tst iperf3m4.py:8: Test FAILED (10.4 sec) 12:59:44.326673 run osmo-hlr_10.42.42.2(pid=24594): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24594)] 12:59:44.374583 run osmo-hlr_10.42.42.2(pid=24594): stdout: | (launched: 2022-12-14_12:59:41.169103) 12:59:44.423949 run osmo-hlr_10.42.42.2(pid=24594): stderr: | 20221214125941346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125941346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125941346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125941346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125941346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125941346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125941358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125941367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125941367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125941367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:44.473734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24583): Terminating (SIGTERM) 12:59:44.513454 run iperf3-srv_10.42.42.10(pid=24584): Terminating (SIGTERM) 12:59:44.553292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24585): Terminating (SIGTERM) 12:59:44.593241 run iperf3-srv_10.42.42.10(pid=24586): Terminating (SIGTERM) 12:59:44.633068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24587): Terminating (SIGTERM) 12:59:44.672892 run iperf3-srv_10.42.42.10(pid=24588): Terminating (SIGTERM) 12:59:44.712730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24589): Terminating (SIGTERM) 12:59:44.752668 run iperf3-srv_10.42.42.10(pid=24590): Terminating (SIGTERM) 12:59:44.792342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24593): Terminating (SIGTERM) 12:59:44.832710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24596): Terminating (SIGTERM) 12:59:44.872461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24599): Terminating (SIGTERM) 12:59:44.912473 --- ParallelTerminationStrategy: PID 24583 died... 12:59:44.931807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24583): Terminated: ok {rc=0} 12:59:44.976069 --- ParallelTerminationStrategy: PID 24584 died... 12:59:44.995112 run iperf3-srv_10.42.42.10(pid=24584): Terminated {rc=256} 12:59:45.038838 --- ParallelTerminationStrategy: PID 24585 died... 12:59:45.057735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24585): Terminated: ok {rc=0} 12:59:45.101519 --- ParallelTerminationStrategy: PID 24586 died... 12:59:45.120044 run iperf3-srv_10.42.42.10(pid=24586): Terminated {rc=256} 12:59:45.164038 --- ParallelTerminationStrategy: PID 24587 died... 12:59:45.182888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24587): Terminated: ok {rc=0} 12:59:45.226838 --- ParallelTerminationStrategy: PID 24588 died... 12:59:45.245660 run iperf3-srv_10.42.42.10(pid=24588): Terminated {rc=256} 12:59:45.289328 --- ParallelTerminationStrategy: PID 24589 died... 12:59:45.308091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24589): Terminated: ok {rc=0} 12:59:45.351874 --- ParallelTerminationStrategy: PID 24590 died... 12:59:45.370665 run iperf3-srv_10.42.42.10(pid=24590): Terminated {rc=256} 12:59:45.414319 --- ParallelTerminationStrategy: PID 24593 died... 12:59:45.433179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24593): Terminated: ok {rc=0} 12:59:45.476848 --- ParallelTerminationStrategy: PID 24596 died... 12:59:45.496001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24596): Terminated: ok {rc=0} 12:59:45.540296 --- ParallelTerminationStrategy: PID 24599 died... 12:59:45.559328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24599): Terminated: ok {rc=0} 12:59:45.642997 bus /gobi_4: Setting Powered False 12:59:46.750583 bus /gobi_4: Setting Powered False 12:59:47.882459 bus /gobi_1: Setting Powered False 12:59:48.983324 bus /gobi_1: Setting Powered False 12:59:50.101895 bus /gobi_0: Setting Powered False 12:59:51.200595 bus /gobi_0: Setting Powered False 12:59:52.316082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo ping.py ---------------------------------------------- 12:59:53.419643 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:53.430834 tst gprs:sysmo: Using 1 x bts (candidates: 1) 12:59:53.465199 tst ping.py: using LAC 41063 12:59:53.582018 tst ping.py: using RAC 8 12:59:53.698242 tst ping.py: using CellId 41063 12:59:53.816780 tst ping.py: using BVCI 41064 12:59:53.923960 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:53.934620 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:53.945215 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:53.955556 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:53.966044 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:53.976247 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:53.987209 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 12:59:53.997648 tst gprs:sysmo: Using 1 x modem (candidates: 4) 12:59:54.117579 tst ping.py:19: start network... 12:59:54.332865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:59:54.827073 run create_hlr_db(pid=24601): Launched 12:59:54.949410 bus /gobi_6: Setting Powered False 12:59:56.012387 run create_hlr_db(pid=24601): Terminated: ok {rc=0} 12:59:56.437859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24603): Launched 12:59:56.733710 run osmo-hlr_10.42.42.2(pid=24604): Launched 12:59:56.846139 run osmo-stp_10.42.42.5: Starting osmo-stp 12:59:57.354959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24606): Launched 12:59:57.649080 run osmo-stp_10.42.42.5(pid=24607): Launched 12:59:57.762740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:59:58.271773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24609): Launched 12:59:58.384804 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:59:58.634154 run patchelf(pid=24610): Launched 12:59:58.798375 run osmo-stp_10.42.42.5(pid=24607): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24607)] 12:59:58.923439 run osmo-stp_10.42.42.5(pid=24607): stdout: | (launched: 2022-12-14_12:59:57.594928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:59.050138 run osmo-stp_10.42.42.5(pid=24607): stderr: | 20221214125957764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125957764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125957764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125957765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125957765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125957765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125957765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:59.178215 run osmo-stp_10.42.42.5(pid=24607): stdout: | (launched: 2022-12-14_12:59:57.594928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:59:59.300033 run osmo-stp_10.42.42.5(pid=24607): stderr: | 20221214125957764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214125957764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214125957764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214125957765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214125957765 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214125957765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214125957765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:59:59.443922 run patchelf(pid=24610): Terminating (SIGINT) 12:59:59.609373 run patchelf(pid=24610): Terminated: ok {rc=0} 12:59:59.728454 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24607): Process ended prematurely: osmo-stp_10.42.42.5(pid=24607) [trial-2405↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24607)] [trial-2405↪gprs:sysmo↪ping.py:22] 12:59:59.737472 tst ping.py:22: Test FAILED (6.3 sec) 12:59:59.763985 run osmo-hlr_10.42.42.2(pid=24604): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24604)] 12:59:59.811915 run osmo-hlr_10.42.42.2(pid=24604): stdout: | (launched: 2022-12-14_12:59:56.679590) 12:59:59.861556 run osmo-hlr_10.42.42.2(pid=24604): stderr: | 20221214125956854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214125956854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214125956854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214125956854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214125956854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214125956854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214125956867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214125956877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214125956877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214125956877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:59:59.911417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24603): Terminating (SIGTERM) 12:59:59.951510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24606): Terminating (SIGTERM) 12:59:59.991704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24609): Terminating (SIGTERM) 13:00:00.032009 --- ParallelTerminationStrategy: PID 24603 died... 13:00:00.051306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24603): Terminated: ok {rc=0} 13:00:00.095830 --- ParallelTerminationStrategy: PID 24606 died... 13:00:00.114691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24606): Terminated: ok {rc=0} 13:00:00.158865 --- ParallelTerminationStrategy: PID 24609 died... 13:00:00.178073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24609): Terminated: ok {rc=0} 13:00:00.263884 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 13:00:01.354701 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:00:01.366883 tst gprs:sysmo: Using 1 x bts (candidates: 1) 13:00:01.404192 tst ping_idle_ping.py: using LAC 41064 13:00:01.560096 tst ping_idle_ping.py: using RAC 9 13:00:01.678236 tst ping_idle_ping.py: using CellId 41064 13:00:01.852642 tst ping_idle_ping.py: using BVCI 41065 13:00:01.973219 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:00:01.985160 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:00:01.996940 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:00:02.009279 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:00:02.023109 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:00:02.035929 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:00:02.048625 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 13:00:02.062923 tst gprs:sysmo: Using 1 x modem (candidates: 4) 13:00:02.196682 tst ping_idle_ping.py:24: start network... 13:00:02.418939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:02.913353 run create_hlr_db(pid=24614): Launched 13:00:03.035263 bus /gobi_6: Setting Powered False 13:00:04.098387 run create_hlr_db(pid=24614): Terminated: ok {rc=0} 13:00:04.523591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24616): Launched 13:00:04.820159 run osmo-hlr_10.42.42.2(pid=24617): Launched 13:00:04.932732 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:05.442777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24619): Launched 13:00:05.737380 run osmo-stp_10.42.42.5(pid=24620): Launched 13:00:05.850053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:06.359766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24622): Launched 13:00:06.473229 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:06.723306 run patchelf(pid=24623): Launched 13:00:06.887326 run osmo-stp_10.42.42.5(pid=24620): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24620)] 13:00:07.012352 run osmo-stp_10.42.42.5(pid=24620): stdout: | (launched: 2022-12-14_13:00:05.683284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:07.139560 run osmo-stp_10.42.42.5(pid=24620): stderr: | 20221214130005853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130005853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130005853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130005853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130005855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130005856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130005856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:07.267569 run osmo-stp_10.42.42.5(pid=24620): stdout: | (launched: 2022-12-14_13:00:05.683284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:07.389178 run osmo-stp_10.42.42.5(pid=24620): stderr: | 20221214130005853 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130005853 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130005853 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130005853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130005855 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130005856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130005856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:07.533178 run patchelf(pid=24623): Terminating (SIGINT) 13:00:07.698751 run patchelf(pid=24623): Terminated: ok {rc=0} 13:00:07.818460 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24620): Process ended prematurely: osmo-stp_10.42.42.5(pid=24620) [trial-2405↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24620)] [trial-2405↪gprs:sysmo↪ping_idle_ping.py:27] 13:00:07.827055 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:00:07.853183 run osmo-hlr_10.42.42.2(pid=24617): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24617)] 13:00:07.900645 run osmo-hlr_10.42.42.2(pid=24617): stdout: | (launched: 2022-12-14_13:00:04.765548) 13:00:07.949421 run osmo-hlr_10.42.42.2(pid=24617): stderr: | 20221214130004941 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130004941 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130004941 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130004941 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130004941 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130004941 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130004956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130004966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130004966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130004966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:07.998721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24616): Terminating (SIGTERM) 13:00:08.038478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24619): Terminating (SIGTERM) 13:00:08.077829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24622): Terminating (SIGTERM) 13:00:08.117660 --- ParallelTerminationStrategy: PID 24616 died... 13:00:08.136433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24616): Terminated: ok {rc=0} 13:00:08.180393 --- ParallelTerminationStrategy: PID 24619 died... 13:00:08.199239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24619): Terminated: ok {rc=0} 13:00:08.243351 --- ParallelTerminationStrategy: PID 24622 died... 13:00:08.262118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24622): Terminated: ok {rc=0} 13:00:08.347725 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 13:00:09.630894 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:00:09.636004 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:00:09.656423 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:00:09.694930 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:00:09.781682 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:00:09.802598 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:00:09.840163 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:00:10.430852 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:00:10.479947 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:10.490752 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:00:10.527362 tst cs_paging_gprs_active.py: using LAC 41065 13:00:10.656032 tst cs_paging_gprs_active.py: using RAC 10 13:00:10.784581 tst cs_paging_gprs_active.py: using CellId 41065 13:00:10.904916 tst cs_paging_gprs_active.py: using BVCI 41066 13:00:11.015166 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:11.026045 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:11.036686 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:11.047328 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:11.057856 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:11.069673 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:11.080914 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:11.092194 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:11.103484 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:11.224273 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:11.344586 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:00:11.565385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:11.891785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24628): Launched 13:00:12.174147 run iperf3-srv_10.42.42.10(pid=24629): Launched 13:00:12.295721 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:00:12.516166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:12.842486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24630): Launched 13:00:13.124526 run iperf3-srv_10.42.42.10(pid=24631): Launched 13:00:13.247187 tst cs_paging_gprs_active.py:38: start network... 13:00:13.466931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:13.969246 run create_hlr_db(pid=24632): Launched 13:00:14.093574 bus /gobi_6: Setting Powered False 13:00:15.157978 run create_hlr_db(pid=24632): Terminated: ok {rc=0} 13:00:15.591751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24634): Launched 13:00:15.927626 run osmo-hlr_10.42.42.2(pid=24635): Launched 13:00:16.109378 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:16.823252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24637): Launched 13:00:17.171102 run osmo-stp_10.42.42.5(pid=24638): Launched 13:00:17.295216 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:17.815310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24640): Launched 13:00:17.931015 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:18.185093 run patchelf(pid=24641): Launched 13:00:18.352587 run osmo-stp_10.42.42.5(pid=24638): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24638)] 13:00:18.479940 run osmo-stp_10.42.42.5(pid=24638): stdout: | (launched: 2022-12-14_13:00:17.107319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:18.608747 run osmo-stp_10.42.42.5(pid=24638): stderr: | 20221214130017293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130017293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130017293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130017294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130017294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130017294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130017294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:18.738008 run osmo-stp_10.42.42.5(pid=24638): stdout: | (launched: 2022-12-14_13:00:17.107319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:18.861641 run osmo-stp_10.42.42.5(pid=24638): stderr: | 20221214130017293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130017293 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130017293 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130017294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130017294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130017294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130017294 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:19.007746 run patchelf(pid=24641): Terminating (SIGINT) 13:00:19.175926 run patchelf(pid=24641): Terminated: ok {rc=0} 13:00:19.297831 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24638): Process ended prematurely: osmo-stp_10.42.42.5(pid=24638) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24638)] [trial-2405↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:00:19.307128 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:00:19.334074 run osmo-hlr_10.42.42.2(pid=24635): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24635)] 13:00:19.382458 run osmo-hlr_10.42.42.2(pid=24635): stdout: | (launched: 2022-12-14_13:00:15.847706) 13:00:19.431635 run osmo-hlr_10.42.42.2(pid=24635): stderr: | 20221214130016222 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130016222 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130016222 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130016222 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130016222 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130016222 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130016236 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130016252 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130016252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130016252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:19.481170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24628): Terminating (SIGTERM) 13:00:19.520506 run iperf3-srv_10.42.42.10(pid=24629): Terminating (SIGTERM) 13:00:19.559807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24630): Terminating (SIGTERM) 13:00:19.599085 run iperf3-srv_10.42.42.10(pid=24631): Terminating (SIGTERM) 13:00:19.638270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24634): Terminating (SIGTERM) 13:00:19.677556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24637): Terminating (SIGTERM) 13:00:19.716911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24640): Terminating (SIGTERM) 13:00:19.756310 --- ParallelTerminationStrategy: PID 24628 died... 13:00:19.775487 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24628): Terminated: ok {rc=0} 13:00:19.819370 --- ParallelTerminationStrategy: PID 24629 died... 13:00:19.838103 run iperf3-srv_10.42.42.10(pid=24629): Terminated {rc=256} 13:00:19.881657 --- ParallelTerminationStrategy: PID 24630 died... 13:00:19.900272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24630): Terminated: ok {rc=0} 13:00:19.943511 --- ParallelTerminationStrategy: PID 24631 died... 13:00:19.961940 run iperf3-srv_10.42.42.10(pid=24631): Terminated {rc=256} 13:00:20.005153 --- ParallelTerminationStrategy: PID 24634 died... 13:00:20.023473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24634): Terminated: ok {rc=0} 13:00:20.066721 --- ParallelTerminationStrategy: PID 24637 died... 13:00:20.085062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24637): Terminated: ok {rc=0} 13:00:20.128515 --- ParallelTerminationStrategy: PID 24640 died... 13:00:20.146953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24640): Terminated: ok {rc=0} 13:00:20.231569 bus /gobi_0: Setting Powered False 13:00:21.331753 bus /gobi_0: Setting Powered False 13:00:22.446358 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:00:23.591283 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:23.602447 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:00:23.638730 tst iperf3.py: using LAC 41066 13:00:23.757241 tst iperf3.py: using RAC 11 13:00:23.874663 tst iperf3.py: using CellId 41066 13:00:23.995369 tst iperf3.py: using BVCI 41067 13:00:24.105556 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:24.116130 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:24.126650 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:24.136993 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:24.147325 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:24.157825 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:24.168366 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:24.178837 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:24.189571 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:24.310193 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:00:24.529683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:24.853902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24642): Launched 13:00:25.134381 run iperf3-srv_10.42.42.10(pid=24643): Launched 13:00:25.256284 tst iperf3.py:8: start network... 13:00:25.475980 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:25.976857 run create_hlr_db(pid=24644): Launched 13:00:26.100871 bus /gobi_6: Setting Powered False 13:00:27.165326 run create_hlr_db(pid=24644): Terminated: ok {rc=0} 13:00:27.616420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24646): Launched 13:00:27.939208 run osmo-hlr_10.42.42.2(pid=24647): Launched 13:00:28.063080 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:28.618048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24649): Launched 13:00:28.940889 run osmo-stp_10.42.42.5(pid=24650): Launched 13:00:29.065366 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:29.625919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24652): Launched 13:00:29.749974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:30.023407 run patchelf(pid=24653): Launched 13:00:30.192454 run osmo-stp_10.42.42.5(pid=24650): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24650)] 13:00:30.319915 run osmo-stp_10.42.42.5(pid=24650): stdout: | (launched: 2022-12-14_13:00:28.882460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:30.449127 run osmo-stp_10.42.42.5(pid=24650): stderr: | 20221214130029074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130029074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130029075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130029075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130029076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130029076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130029076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:30.578562 run osmo-stp_10.42.42.5(pid=24650): stdout: | (launched: 2022-12-14_13:00:28.882460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:30.702107 run osmo-stp_10.42.42.5(pid=24650): stderr: | 20221214130029074 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130029074 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130029075 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130029075 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130029076 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130029076 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130029076 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:30.861496 run patchelf(pid=24653): Terminating (SIGINT) 13:00:31.055924 run patchelf(pid=24653): Terminated: ok {rc=0} 13:00:31.181266 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24650): Process ended prematurely: osmo-stp_10.42.42.5(pid=24650) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24650)] [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 13:00:31.191647 tst iperf3.py:8: Test FAILED (7.6 sec) 13:00:31.219898 run osmo-hlr_10.42.42.2(pid=24647): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24647)] 13:00:31.269045 run osmo-hlr_10.42.42.2(pid=24647): stdout: | (launched: 2022-12-14_13:00:27.880788) 13:00:31.319562 run osmo-hlr_10.42.42.2(pid=24647): stderr: | 20221214130028078 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130028078 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130028078 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130028078 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130028078 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130028078 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130028091 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130028099 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130028099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130028099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:31.371857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24642): Terminating (SIGTERM) 13:00:31.413102 run iperf3-srv_10.42.42.10(pid=24643): Terminating (SIGTERM) 13:00:31.457138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24646): Terminating (SIGTERM) 13:00:31.499009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24649): Terminating (SIGTERM) 13:00:31.541893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24652): Terminating (SIGTERM) 13:00:31.585178 --- ParallelTerminationStrategy: PID 24642 died... 13:00:31.605202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24642): Terminated: ok {rc=0} 13:00:31.651457 --- ParallelTerminationStrategy: PID 24643 died... 13:00:31.670787 run iperf3-srv_10.42.42.10(pid=24643): Terminated {rc=256} 13:00:31.715654 --- ParallelTerminationStrategy: PID 24646 died... 13:00:31.734833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24646): Terminated: ok {rc=0} 13:00:31.779688 --- ParallelTerminationStrategy: PID 24649 died... 13:00:31.799441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24649): Terminated: ok {rc=0} 13:00:31.844188 --- ParallelTerminationStrategy: PID 24652 died... 13:00:31.863619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24652): Terminated: ok {rc=0} 13:00:31.949223 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:00:33.100876 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:33.113046 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:00:33.148825 tst iperf3m4.py: using LAC 41067 13:00:33.267276 tst iperf3m4.py: using RAC 12 13:00:33.384936 tst iperf3m4.py: using CellId 41067 13:00:33.503493 tst iperf3m4.py: using BVCI 41068 13:00:33.613689 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:33.624172 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:33.634725 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:33.644896 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:33.655195 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:33.665489 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:33.675916 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:33.686196 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:33.696571 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:33.815727 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:33.934326 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:34.054631 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:34.168490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:00:34.371616 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:34.676310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24654): Launched 13:00:34.939321 run iperf3-srv_10.42.42.10(pid=24655): Launched 13:00:35.051767 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:00:35.253304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:35.555683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24656): Launched 13:00:35.818306 run iperf3-srv_10.42.42.10(pid=24657): Launched 13:00:35.930796 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:00:36.132011 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:36.434222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24658): Launched 13:00:36.696693 run iperf3-srv_10.42.42.10(pid=24659): Launched 13:00:36.808916 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:00:37.010969 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:00:37.313477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24660): Launched 13:00:37.576241 run iperf3-srv_10.42.42.10(pid=24661): Launched 13:00:37.689397 tst iperf3m4.py:8: start network... 13:00:37.890623 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:38.356264 run create_hlr_db(pid=24662): Launched 13:00:38.480363 bus /gobi_6: Setting Powered False 13:00:39.541390 run create_hlr_db(pid=24662): Terminated: ok {rc=0} 13:00:39.984156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24664): Launched 13:00:40.309202 run osmo-hlr_10.42.42.2(pid=24665): Launched 13:00:40.433465 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:40.991079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24667): Launched 13:00:41.297997 run osmo-stp_10.42.42.5(pid=24668): Launched 13:00:41.411890 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:41.930334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24670): Launched 13:00:42.063642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:42.337685 run patchelf(pid=24671): Launched 13:00:42.517570 run osmo-stp_10.42.42.5(pid=24668): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24668)] 13:00:42.655044 run osmo-stp_10.42.42.5(pid=24668): stdout: | (launched: 2022-12-14_13:00:41.242893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:42.794035 run osmo-stp_10.42.42.5(pid=24668): stderr: | 20221214130041415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130041415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130041415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130041416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130041416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130041416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130041416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:42.933112 run osmo-stp_10.42.42.5(pid=24668): stdout: | (launched: 2022-12-14_13:00:41.242893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:43.065866 run osmo-stp_10.42.42.5(pid=24668): stderr: | 20221214130041415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130041415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130041415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130041416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130041416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130041416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130041416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:43.224094 run patchelf(pid=24671): Terminating (SIGINT) 13:00:43.405881 run patchelf(pid=24671): Terminated: ok {rc=0} 13:00:43.537016 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24668): Process ended prematurely: osmo-stp_10.42.42.5(pid=24668) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24668)] [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 13:00:43.547290 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:00:43.576052 run osmo-hlr_10.42.42.2(pid=24665): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24665)] 13:00:43.627090 run osmo-hlr_10.42.42.2(pid=24665): stdout: | (launched: 2022-12-14_13:00:40.250697) 13:00:43.680029 run osmo-hlr_10.42.42.2(pid=24665): stderr: | 20221214130040449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130040449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130040449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130040449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130040450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130040450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130040461 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130040470 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130040470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130040470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:43.733311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24654): Terminating (SIGTERM) 13:00:43.774917 run iperf3-srv_10.42.42.10(pid=24655): Terminating (SIGTERM) 13:00:43.817770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24656): Terminating (SIGTERM) 13:00:43.859513 run iperf3-srv_10.42.42.10(pid=24657): Terminating (SIGTERM) 13:00:43.902495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24658): Terminating (SIGTERM) 13:00:43.944675 run iperf3-srv_10.42.42.10(pid=24659): Terminating (SIGTERM) 13:00:43.986883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24660): Terminating (SIGTERM) 13:00:44.029217 run iperf3-srv_10.42.42.10(pid=24661): Terminating (SIGTERM) 13:00:44.070926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24664): Terminating (SIGTERM) 13:00:44.113275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24667): Terminating (SIGTERM) 13:00:44.155369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24670): Terminating (SIGTERM) 13:00:44.197761 --- ParallelTerminationStrategy: PID 24654 died... 13:00:44.217577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24654): Terminated: ok {rc=0} 13:00:44.264091 --- ParallelTerminationStrategy: PID 24655 died... 13:00:44.283678 run iperf3-srv_10.42.42.10(pid=24655): Terminated {rc=256} 13:00:44.329944 --- ParallelTerminationStrategy: PID 24656 died... 13:00:44.349798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24656): Terminated: ok {rc=0} 13:00:44.395791 --- ParallelTerminationStrategy: PID 24657 died... 13:00:44.415478 run iperf3-srv_10.42.42.10(pid=24657): Terminated {rc=256} 13:00:44.461549 --- ParallelTerminationStrategy: PID 24658 died... 13:00:44.481318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24658): Terminated: ok {rc=0} 13:00:44.527603 --- ParallelTerminationStrategy: PID 24659 died... 13:00:44.547385 run iperf3-srv_10.42.42.10(pid=24659): Terminated {rc=256} 13:00:44.593474 --- ParallelTerminationStrategy: PID 24660 died... 13:00:44.613318 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24660): Terminated: ok {rc=0} 13:00:44.659567 --- ParallelTerminationStrategy: PID 24661 died... 13:00:44.679406 run iperf3-srv_10.42.42.10(pid=24661): Terminated {rc=256} 13:00:44.725632 --- ParallelTerminationStrategy: PID 24664 died... 13:00:44.745410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24664): Terminated: ok {rc=0} 13:00:44.791600 --- ParallelTerminationStrategy: PID 24667 died... 13:00:44.811564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24667): Terminated: ok {rc=0} 13:00:44.857846 --- ParallelTerminationStrategy: PID 24670 died... 13:00:44.877724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24670): Terminated: ok {rc=0} 13:00:44.966100 bus /gobi_4: Setting Powered False 13:00:46.072117 bus /gobi_4: Setting Powered False 13:00:47.201293 bus /gobi_1: Setting Powered False 13:00:48.302763 bus /gobi_1: Setting Powered False 13:00:49.420144 bus /gobi_0: Setting Powered False 13:00:50.519002 bus /gobi_0: Setting Powered False 13:00:51.634022 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 13:00:52.737313 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:52.748312 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:00:52.785382 tst ping.py: using LAC 41068 13:00:52.902014 tst ping.py: using RAC 13 13:00:53.018909 tst ping.py: using CellId 41068 13:00:53.136776 tst ping.py: using BVCI 41069 13:00:53.243433 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:53.254087 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:53.264629 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:53.275057 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:53.285450 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:53.295805 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:53.306445 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:00:53.316848 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:00:53.437830 tst ping.py:19: start network... 13:00:53.637145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:00:54.095508 run create_hlr_db(pid=24674): Launched 13:00:54.216264 bus /gobi_6: Setting Powered False 13:00:55.275789 run create_hlr_db(pid=24674): Terminated: ok {rc=0} 13:00:55.710130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24676): Launched 13:00:56.028280 run osmo-hlr_10.42.42.2(pid=24677): Launched 13:00:56.149701 run osmo-stp_10.42.42.5: Starting osmo-stp 13:00:56.699514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24679): Launched 13:00:57.016842 run osmo-stp_10.42.42.5(pid=24680): Launched 13:00:57.139492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:00:57.689611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24682): Launched 13:00:57.811172 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:00:58.079668 run patchelf(pid=24683): Launched 13:00:58.256818 run osmo-stp_10.42.42.5(pid=24680): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24680)] 13:00:58.391509 run osmo-stp_10.42.42.5(pid=24680): stdout: | (launched: 2022-12-14_13:00:56.959155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:58.527467 run osmo-stp_10.42.42.5(pid=24680): stderr: | 20221214130057152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130057152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130057153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130057153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130057153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130057154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130057154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:58.664018 run osmo-stp_10.42.42.5(pid=24680): stdout: | (launched: 2022-12-14_13:00:56.959155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:00:58.795133 run osmo-stp_10.42.42.5(pid=24680): stderr: | 20221214130057152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130057152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130057153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130057153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130057153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130057154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130057154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:00:58.950505 run patchelf(pid=24683): Terminating (SIGINT) 13:00:59.128126 run patchelf(pid=24683): Terminated: ok {rc=0} 13:00:59.256472 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24680): Process ended prematurely: osmo-stp_10.42.42.5(pid=24680) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24680)] [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 13:00:59.266023 tst ping.py:22: Test FAILED (6.5 sec) 13:00:59.293955 run osmo-hlr_10.42.42.2(pid=24677): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24677)] 13:00:59.344416 run osmo-hlr_10.42.42.2(pid=24677): stdout: | (launched: 2022-12-14_13:00:55.970320) 13:00:59.395949 run osmo-hlr_10.42.42.2(pid=24677): stderr: | 20221214130056168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130056168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130056168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130056168 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130056168 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130056168 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130056181 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130056189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130056189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130056189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:00:59.447951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24676): Terminating (SIGTERM) 13:00:59.489960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24679): Terminating (SIGTERM) 13:00:59.531746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24682): Terminating (SIGTERM) 13:00:59.574338 --- ParallelTerminationStrategy: PID 24676 died... 13:00:59.594569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24676): Terminated: ok {rc=0} 13:00:59.641086 --- ParallelTerminationStrategy: PID 24679 died... 13:00:59.660818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24679): Terminated: ok {rc=0} 13:00:59.706914 --- ParallelTerminationStrategy: PID 24682 died... 13:00:59.726772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24682): Terminated: ok {rc=0} 13:00:59.815047 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:01:00.913793 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:00.926456 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:01:00.964880 tst ping_idle_ping.py: using LAC 41069 13:01:01.099383 tst ping_idle_ping.py: using RAC 14 13:01:01.254224 tst ping_idle_ping.py: using CellId 41069 13:01:01.383209 tst ping_idle_ping.py: using BVCI 41070 13:01:01.503405 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:01.515600 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:01.527712 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:01.539740 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:01.553117 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:01.566036 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:01.579416 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:01:01.592079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:01:01.720610 tst ping_idle_ping.py:24: start network... 13:01:01.941950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:02.435024 run create_hlr_db(pid=24684): Launched 13:01:02.557188 bus /gobi_6: Setting Powered False 13:01:03.617455 run create_hlr_db(pid=24684): Terminated: ok {rc=0} 13:01:04.031018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24686): Launched 13:01:04.327612 run osmo-hlr_10.42.42.2(pid=24687): Launched 13:01:04.440535 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:04.947925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24689): Launched 13:01:05.243509 run osmo-stp_10.42.42.5(pid=24690): Launched 13:01:05.355959 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:05.868678 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24692): Launched 13:01:05.981825 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:06.231668 run patchelf(pid=24693): Launched 13:01:06.395829 run osmo-stp_10.42.42.5(pid=24690): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24690)] 13:01:06.521239 run osmo-stp_10.42.42.5(pid=24690): stdout: | (launched: 2022-12-14_13:01:05.189274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:06.647881 run osmo-stp_10.42.42.5(pid=24690): stderr: | 20221214130105358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130105359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130105359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130105359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130105360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130105360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130105360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:06.775937 run osmo-stp_10.42.42.5(pid=24690): stdout: | (launched: 2022-12-14_13:01:05.189274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:06.897226 run osmo-stp_10.42.42.5(pid=24690): stderr: | 20221214130105358 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130105359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130105359 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130105359 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130105360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130105360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130105360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:07.040756 run patchelf(pid=24693): Terminating (SIGINT) 13:01:07.206877 run patchelf(pid=24693): Terminated: ok {rc=0} 13:01:07.326855 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24690): Process ended prematurely: osmo-stp_10.42.42.5(pid=24690) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24690)] [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 13:01:07.335584 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:01:07.361853 run osmo-hlr_10.42.42.2(pid=24687): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24687)] 13:01:07.409671 run osmo-hlr_10.42.42.2(pid=24687): stdout: | (launched: 2022-12-14_13:01:04.273303) 13:01:07.458850 run osmo-hlr_10.42.42.2(pid=24687): stderr: | 20221214130104451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130104451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130104451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130104451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130104451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130104451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130104464 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130104474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130104474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130104474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:07.508157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24686): Terminating (SIGTERM) 13:01:07.547636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24689): Terminating (SIGTERM) 13:01:07.587036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24692): Terminating (SIGTERM) 13:01:07.626821 --- ParallelTerminationStrategy: PID 24686 died... 13:01:07.646223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24686): Terminated: ok {rc=0} 13:01:07.690171 --- ParallelTerminationStrategy: PID 24689 died... 13:01:07.708837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24689): Terminated: ok {rc=0} 13:01:07.752534 --- ParallelTerminationStrategy: PID 24692 died... 13:01:07.771380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24692): Terminated: ok {rc=0} 13:01:07.856312 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:01:09.140068 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:01:09.145974 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:01:09.166314 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:01:09.204659 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:01:09.296347 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:01:09.317054 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:01:09.354588 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:01:09.939679 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:01:09.988431 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:09.999312 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:01:10.057123 tst cs_paging_gprs_active.py: using LAC 41070 13:01:10.174790 tst cs_paging_gprs_active.py: using RAC 15 13:01:10.295594 tst cs_paging_gprs_active.py: using CellId 41070 13:01:10.411587 tst cs_paging_gprs_active.py: using BVCI 41071 13:01:10.520191 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:10.530952 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:10.541529 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:10.551794 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:10.562177 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:10.573214 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:10.584503 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:10.595157 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:10.606072 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:10.727015 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:10.844044 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:01:11.046423 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:11.349329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24697): Launched 13:01:11.610937 run iperf3-srv_10.42.42.10(pid=24698): Launched 13:01:11.724256 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:01:11.927140 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:12.229011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24699): Launched 13:01:12.490163 run iperf3-srv_10.42.42.10(pid=24700): Launched 13:01:12.602529 tst cs_paging_gprs_active.py:38: start network... 13:01:12.803468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:13.268445 run create_hlr_db(pid=24701): Launched 13:01:13.391292 bus /gobi_6: Setting Powered False 13:01:14.451250 run create_hlr_db(pid=24701): Terminated: ok {rc=0} 13:01:14.871308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24703): Launched 13:01:15.172053 run osmo-hlr_10.42.42.2(pid=24704): Launched 13:01:15.286843 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:15.805133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24706): Launched 13:01:16.143192 run osmo-stp_10.42.42.5(pid=24707): Launched 13:01:16.373276 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:17.026769 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24709): Launched 13:01:17.164514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:17.440548 run patchelf(pid=24710): Launched 13:01:17.620653 run osmo-stp_10.42.42.5(pid=24707): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24707)] 13:01:17.758689 run osmo-stp_10.42.42.5(pid=24707): stdout: | (launched: 2022-12-14_13:01:16.078408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:17.898628 run osmo-stp_10.42.42.5(pid=24707): stderr: | 20221214130116392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130116392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130116392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130116393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130116393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130116393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130116393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:18.038360 run osmo-stp_10.42.42.5(pid=24707): stdout: | (launched: 2022-12-14_13:01:16.078408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:18.171757 run osmo-stp_10.42.42.5(pid=24707): stderr: | 20221214130116392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130116392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130116392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130116393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130116393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130116393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130116393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:18.330243 run patchelf(pid=24710): Terminating (SIGINT) 13:01:18.512461 run patchelf(pid=24710): Terminated: ok {rc=0} 13:01:18.643764 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24707): Process ended prematurely: osmo-stp_10.42.42.5(pid=24707) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24707)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:01:18.653846 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:01:18.682258 run osmo-hlr_10.42.42.2(pid=24704): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24704)] 13:01:18.732418 run osmo-hlr_10.42.42.2(pid=24704): stdout: | (launched: 2022-12-14_13:01:15.117076) 13:01:18.784036 run osmo-hlr_10.42.42.2(pid=24704): stderr: | 20221214130115295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130115296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130115296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130115296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130115296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130115296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130115307 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130115318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130115318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130115318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:18.836099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24697): Terminating (SIGTERM) 13:01:18.878179 run iperf3-srv_10.42.42.10(pid=24698): Terminating (SIGTERM) 13:01:18.920509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24699): Terminating (SIGTERM) 13:01:18.962503 run iperf3-srv_10.42.42.10(pid=24700): Terminating (SIGTERM) 13:01:19.004816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24703): Terminating (SIGTERM) 13:01:19.047206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24706): Terminating (SIGTERM) 13:01:19.089634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24709): Terminating (SIGTERM) 13:01:19.132183 --- ParallelTerminationStrategy: PID 24697 died... 13:01:19.152385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24697): Terminated: ok {rc=0} 13:01:19.199052 --- ParallelTerminationStrategy: PID 24698 died... 13:01:19.218746 run iperf3-srv_10.42.42.10(pid=24698): Terminated {rc=256} 13:01:19.264710 --- ParallelTerminationStrategy: PID 24699 died... 13:01:19.284431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24699): Terminated: ok {rc=0} 13:01:19.330373 --- ParallelTerminationStrategy: PID 24700 died... 13:01:19.349970 run iperf3-srv_10.42.42.10(pid=24700): Terminated {rc=256} 13:01:19.395961 --- ParallelTerminationStrategy: PID 24703 died... 13:01:19.415580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24703): Terminated: ok {rc=0} 13:01:19.461363 --- ParallelTerminationStrategy: PID 24706 died... 13:01:19.481131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24706): Terminated: ok {rc=0} 13:01:19.526840 --- ParallelTerminationStrategy: PID 24709 died... 13:01:19.546478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24709): Terminated: ok {rc=0} 13:01:19.634064 bus /gobi_0: Setting Powered False 13:01:20.728853 bus /gobi_0: Setting Powered False 13:01:21.841463 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:01:22.989775 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:23.001577 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:01:23.062741 tst iperf3.py: using LAC 41071 13:01:23.190342 tst iperf3.py: using RAC 16 13:01:23.321384 tst iperf3.py: using CellId 41071 13:01:23.448283 tst iperf3.py: using BVCI 41072 13:01:23.565529 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:23.576762 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:23.587770 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:23.598829 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:23.610109 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:23.621456 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:23.632767 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:23.643926 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:23.655293 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:23.770767 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:01:23.974259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:24.277535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24711): Launched 13:01:24.540426 run iperf3-srv_10.42.42.10(pid=24712): Launched 13:01:24.653904 tst iperf3.py:8: start network... 13:01:24.856088 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:25.320925 run create_hlr_db(pid=24713): Launched 13:01:25.444537 bus /gobi_6: Setting Powered False 13:01:26.504507 run create_hlr_db(pid=24713): Terminated: ok {rc=0} 13:01:26.946369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24715): Launched 13:01:27.272128 run osmo-hlr_10.42.42.2(pid=24716): Launched 13:01:27.396064 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:27.955509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24718): Launched 13:01:28.279365 run osmo-stp_10.42.42.5(pid=24719): Launched 13:01:28.402900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:28.958705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24721): Launched 13:01:29.082170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:29.355257 run patchelf(pid=24722): Launched 13:01:29.534738 run osmo-stp_10.42.42.5(pid=24719): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24719)] 13:01:29.672002 run osmo-stp_10.42.42.5(pid=24719): stdout: | (launched: 2022-12-14_13:01:28.220740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:29.811264 run osmo-stp_10.42.42.5(pid=24719): stderr: | 20221214130128412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130128412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130128412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130128413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130128413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130128413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130128413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:29.950774 run osmo-stp_10.42.42.5(pid=24719): stdout: | (launched: 2022-12-14_13:01:28.220740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:30.083950 run osmo-stp_10.42.42.5(pid=24719): stderr: | 20221214130128412 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130128412 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130128412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130128413 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130128413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130128413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130128413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:30.242384 run patchelf(pid=24722): Terminating (SIGINT) 13:01:30.424047 run patchelf(pid=24722): Terminated: ok {rc=0} 13:01:30.555113 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24719): Process ended prematurely: osmo-stp_10.42.42.5(pid=24719) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24719)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 13:01:30.565274 tst iperf3.py:8: Test FAILED (7.6 sec) 13:01:30.593558 run osmo-hlr_10.42.42.2(pid=24716): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24716)] 13:01:30.643666 run osmo-hlr_10.42.42.2(pid=24716): stdout: | (launched: 2022-12-14_13:01:27.213480) 13:01:30.695172 run osmo-hlr_10.42.42.2(pid=24716): stderr: | 20221214130127409 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130127409 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130127409 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130127409 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130127409 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130127409 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130127423 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130127432 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130127433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130127433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:30.746900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24711): Terminating (SIGTERM) 13:01:30.788440 run iperf3-srv_10.42.42.10(pid=24712): Terminating (SIGTERM) 13:01:30.832189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24715): Terminating (SIGTERM) 13:01:30.876330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24718): Terminating (SIGTERM) 13:01:30.928741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24721): Terminating (SIGTERM) 13:01:30.971925 --- ParallelTerminationStrategy: PID 24711 died... 13:01:30.992853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24711): Terminated: ok {rc=0} 13:01:31.040402 --- ParallelTerminationStrategy: PID 24712 died... 13:01:31.061305 run iperf3-srv_10.42.42.10(pid=24712): Terminated {rc=256} 13:01:31.122637 --- ParallelTerminationStrategy: PID 24715 died... 13:01:31.144252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24715): Terminated: ok {rc=0} 13:01:31.191704 --- ParallelTerminationStrategy: PID 24718 died... 13:01:31.213588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24718): Terminated: ok {rc=0} 13:01:31.261842 --- ParallelTerminationStrategy: PID 24721 died... 13:01:31.283443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24721): Terminated: ok {rc=0} 13:01:31.380718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:01:32.543231 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:32.555095 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:01:32.616804 tst iperf3m4.py: using LAC 41072 13:01:32.742671 tst iperf3m4.py: using RAC 17 13:01:32.867435 tst iperf3m4.py: using CellId 41072 13:01:32.992191 tst iperf3m4.py: using BVCI 41073 13:01:33.109922 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:33.121253 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:33.132256 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:33.143326 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:33.154583 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:33.165909 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:33.177499 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:33.188622 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:33.200128 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:33.317400 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:33.438183 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:33.552443 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:33.672181 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:01:33.892384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:34.218607 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24723): Launched 13:01:34.499327 run iperf3-srv_10.42.42.10(pid=24724): Launched 13:01:34.620685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:01:34.839513 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:35.163485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24725): Launched 13:01:35.445397 run iperf3-srv_10.42.42.10(pid=24726): Launched 13:01:35.566438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:01:35.785183 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:36.110075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24727): Launched 13:01:36.391479 run iperf3-srv_10.42.42.10(pid=24728): Launched 13:01:36.512646 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:01:36.731365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:01:37.055356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24729): Launched 13:01:37.337480 run iperf3-srv_10.42.42.10(pid=24730): Launched 13:01:37.458699 tst iperf3m4.py:8: start network... 13:01:37.676869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:38.176477 run create_hlr_db(pid=24731): Launched 13:01:38.299548 bus /gobi_6: Setting Powered False 13:01:39.362899 run create_hlr_db(pid=24731): Terminated: ok {rc=0} 13:01:39.811836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24733): Launched 13:01:40.134484 run osmo-hlr_10.42.42.2(pid=24734): Launched 13:01:40.258740 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:40.788929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24736): Launched 13:01:41.088883 run osmo-stp_10.42.42.5(pid=24737): Launched 13:01:41.203483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:41.718775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24739): Launched 13:01:41.833370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:42.086931 run patchelf(pid=24740): Launched 13:01:42.254046 run osmo-stp_10.42.42.5(pid=24737): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24737)] 13:01:42.380684 run osmo-stp_10.42.42.5(pid=24737): stdout: | (launched: 2022-12-14_13:01:41.034143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:42.508851 run osmo-stp_10.42.42.5(pid=24737): stderr: | 20221214130141203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130141204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130141204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130141204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130141205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130141205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130141205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:42.639373 run osmo-stp_10.42.42.5(pid=24737): stdout: | (launched: 2022-12-14_13:01:41.034143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:42.762040 run osmo-stp_10.42.42.5(pid=24737): stderr: | 20221214130141203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130141204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130141204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130141204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130141205 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130141205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130141205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:42.908072 run patchelf(pid=24740): Terminating (SIGINT) 13:01:43.075817 run patchelf(pid=24740): Terminated: ok {rc=0} 13:01:43.196722 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24737): Process ended prematurely: osmo-stp_10.42.42.5(pid=24737) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24737)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:01:43.206107 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:01:43.233237 run osmo-hlr_10.42.42.2(pid=24734): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24734)] 13:01:43.280477 run osmo-hlr_10.42.42.2(pid=24734): stdout: | (launched: 2022-12-14_13:01:40.075856) 13:01:43.329538 run osmo-hlr_10.42.42.2(pid=24734): stderr: | 20221214130140276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130140276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130140276 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130140276 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130140276 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130140276 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130140288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130140296 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130140296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130140296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:43.378645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24723): Terminating (SIGTERM) 13:01:43.417948 run iperf3-srv_10.42.42.10(pid=24724): Terminating (SIGTERM) 13:01:43.457188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24725): Terminating (SIGTERM) 13:01:43.496550 run iperf3-srv_10.42.42.10(pid=24726): Terminating (SIGTERM) 13:01:43.535992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24727): Terminating (SIGTERM) 13:01:43.575260 run iperf3-srv_10.42.42.10(pid=24728): Terminating (SIGTERM) 13:01:43.614301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24729): Terminating (SIGTERM) 13:01:43.653408 run iperf3-srv_10.42.42.10(pid=24730): Terminating (SIGTERM) 13:01:43.693307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24733): Terminating (SIGTERM) 13:01:43.736798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24736): Terminating (SIGTERM) 13:01:43.779151 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24739): Terminating (SIGTERM) 13:01:43.821827 --- ParallelTerminationStrategy: PID 24723 died... 13:01:43.842726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24723): Terminated: ok {rc=0} 13:01:43.889899 --- ParallelTerminationStrategy: PID 24724 died... 13:01:43.910227 run iperf3-srv_10.42.42.10(pid=24724): Terminated {rc=256} 13:01:43.957305 --- ParallelTerminationStrategy: PID 24725 died... 13:01:43.977810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24725): Terminated: ok {rc=0} 13:01:44.024217 --- ParallelTerminationStrategy: PID 24726 died... 13:01:44.044096 run iperf3-srv_10.42.42.10(pid=24726): Terminated {rc=256} 13:01:44.090179 --- ParallelTerminationStrategy: PID 24727 died... 13:01:44.110103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24727): Terminated: ok {rc=0} 13:01:44.156687 --- ParallelTerminationStrategy: PID 24728 died... 13:01:44.176612 run iperf3-srv_10.42.42.10(pid=24728): Terminated {rc=256} 13:01:44.223321 --- ParallelTerminationStrategy: PID 24729 died... 13:01:44.243276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24729): Terminated: ok {rc=0} 13:01:44.289730 --- ParallelTerminationStrategy: PID 24730 died... 13:01:44.309668 run iperf3-srv_10.42.42.10(pid=24730): Terminated {rc=256} 13:01:44.355993 --- ParallelTerminationStrategy: PID 24733 died... 13:01:44.376138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24733): Terminated: ok {rc=0} 13:01:44.422754 --- ParallelTerminationStrategy: PID 24736 died... 13:01:44.442979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24736): Terminated: ok {rc=0} 13:01:44.489575 --- ParallelTerminationStrategy: PID 24739 died... 13:01:44.509698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24739): Terminated: ok {rc=0} 13:01:44.599168 bus /gobi_4: Setting Powered False 13:01:45.697971 bus /gobi_4: Setting Powered False 13:01:46.815496 bus /gobi_1: Setting Powered False 13:01:47.918221 bus /gobi_1: Setting Powered False 13:01:49.033947 bus /gobi_0: Setting Powered False 13:01:50.132381 bus /gobi_0: Setting Powered False 13:01:51.249805 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:01:52.349856 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:52.361169 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:01:52.420081 tst ping.py: using LAC 41073 13:01:52.535220 tst ping.py: using RAC 18 13:01:52.649193 tst ping.py: using CellId 41073 13:01:52.763836 tst ping.py: using BVCI 41074 13:01:52.871308 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:52.882191 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:52.892731 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:52.903315 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:52.913803 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:52.924202 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:52.934855 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:01:52.945455 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:01:53.059906 tst ping.py:19: start network... 13:01:53.257691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:01:53.715591 run create_hlr_db(pid=24741): Launched 13:01:53.836778 bus /gobi_6: Setting Powered False 13:01:54.895947 run create_hlr_db(pid=24741): Terminated: ok {rc=0} 13:01:55.332279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24743): Launched 13:01:55.651186 run osmo-hlr_10.42.42.2(pid=24744): Launched 13:01:55.772851 run osmo-stp_10.42.42.5: Starting osmo-stp 13:01:56.330467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24746): Launched 13:01:56.648830 run osmo-stp_10.42.42.5(pid=24747): Launched 13:01:56.770521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:01:57.319899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24749): Launched 13:01:57.442569 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:01:57.711414 run patchelf(pid=24750): Launched 13:01:57.888056 run osmo-stp_10.42.42.5(pid=24747): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24747)] 13:01:58.023417 run osmo-stp_10.42.42.5(pid=24747): stdout: | (launched: 2022-12-14_13:01:56.591248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:58.160338 run osmo-stp_10.42.42.5(pid=24747): stderr: | 20221214130156783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130156783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130156783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130156784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130156784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130156784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130156784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:58.297677 run osmo-stp_10.42.42.5(pid=24747): stdout: | (launched: 2022-12-14_13:01:56.591248) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:01:58.428445 run osmo-stp_10.42.42.5(pid=24747): stderr: | 20221214130156783 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130156783 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130156783 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130156784 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130156784 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130156784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130156784 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:01:58.583450 run patchelf(pid=24750): Terminating (SIGINT) 13:01:58.760753 run patchelf(pid=24750): Terminated: ok {rc=0} 13:01:58.888844 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24747): Process ended prematurely: osmo-stp_10.42.42.5(pid=24747) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24747)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 13:01:58.898264 tst ping.py:22: Test FAILED (6.5 sec) 13:01:58.926219 run osmo-hlr_10.42.42.2(pid=24744): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24744)] 13:01:58.976573 run osmo-hlr_10.42.42.2(pid=24744): stdout: | (launched: 2022-12-14_13:01:55.593301) 13:01:59.028172 run osmo-hlr_10.42.42.2(pid=24744): stderr: | 20221214130155790 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130155790 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130155790 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130155790 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130155790 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130155790 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130155801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130155809 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130155810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130155810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:01:59.080045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24743): Terminating (SIGTERM) 13:01:59.122094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24746): Terminating (SIGTERM) 13:01:59.163775 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24749): Terminating (SIGTERM) 13:01:59.205998 --- ParallelTerminationStrategy: PID 24743 died... 13:01:59.226361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24743): Terminated: ok {rc=0} 13:01:59.272427 --- ParallelTerminationStrategy: PID 24746 died... 13:01:59.292018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24746): Terminated: ok {rc=0} 13:01:59.338042 --- ParallelTerminationStrategy: PID 24749 died... 13:01:59.357733 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24749): Terminated: ok {rc=0} 13:01:59.444796 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:02:00.530658 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:00.542553 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:02:00.600271 tst ping_idle_ping.py: using LAC 41074 13:02:00.718212 tst ping_idle_ping.py: using RAC 19 13:02:00.842926 tst ping_idle_ping.py: using CellId 41074 13:02:00.967767 tst ping_idle_ping.py: using BVCI 41075 13:02:01.078045 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:01.089958 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:01.101682 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:01.113307 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:01.125122 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:01.136315 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:01.147968 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:02:01.159348 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:02:01.272850 tst ping_idle_ping.py:24: start network... 13:02:01.475221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:02.012544 run create_hlr_db(pid=24751): Launched 13:02:02.169442 bus /gobi_6: Setting Powered False 13:02:03.228786 run create_hlr_db(pid=24751): Terminated: ok {rc=0} 13:02:03.665641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24753): Launched 13:02:03.985554 run osmo-hlr_10.42.42.2(pid=24754): Launched 13:02:04.107924 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:04.665927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24756): Launched 13:02:04.986614 run osmo-stp_10.42.42.5(pid=24757): Launched 13:02:05.110104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:05.663546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24759): Launched 13:02:05.780675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:06.031100 run patchelf(pid=24760): Launched 13:02:06.196740 run osmo-stp_10.42.42.5(pid=24757): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24757)] 13:02:06.322158 run osmo-stp_10.42.42.5(pid=24757): stdout: | (launched: 2022-12-14_13:02:04.928250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:06.448788 run osmo-stp_10.42.42.5(pid=24757): stderr: | 20221214130205121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130205121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130205122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130205122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130205122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130205122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130205123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:06.575908 run osmo-stp_10.42.42.5(pid=24757): stdout: | (launched: 2022-12-14_13:02:04.928250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:06.697388 run osmo-stp_10.42.42.5(pid=24757): stderr: | 20221214130205121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130205121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130205122 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130205122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130205122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130205122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130205123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:06.841817 run patchelf(pid=24760): Terminating (SIGINT) 13:02:07.007503 run patchelf(pid=24760): Terminated: ok {rc=0} 13:02:07.126700 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24757): Process ended prematurely: osmo-stp_10.42.42.5(pid=24757) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24757)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:02:07.135372 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:02:07.161517 run osmo-hlr_10.42.42.2(pid=24754): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24754)] 13:02:07.208441 run osmo-hlr_10.42.42.2(pid=24754): stdout: | (launched: 2022-12-14_13:02:03.927558) 13:02:07.257187 run osmo-hlr_10.42.42.2(pid=24754): stderr: | 20221214130204125 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130204125 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130204125 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130204125 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130204125 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130204125 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130204137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130204145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130204146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130204146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:07.306199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24753): Terminating (SIGTERM) 13:02:07.345565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24756): Terminating (SIGTERM) 13:02:07.384719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24759): Terminating (SIGTERM) 13:02:07.424183 --- ParallelTerminationStrategy: PID 24753 died... 13:02:07.443288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24753): Terminated: ok {rc=0} 13:02:07.486911 --- ParallelTerminationStrategy: PID 24756 died... 13:02:07.505337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24756): Terminated: ok {rc=0} 13:02:07.549129 --- ParallelTerminationStrategy: PID 24759 died... 13:02:07.567565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24759): Terminated: ok {rc=0} 13:02:07.651845 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:02:08.938219 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:02:08.944059 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:02:08.964457 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:02:09.002408 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:02:09.086031 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:02:09.106371 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:02:09.143915 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:02:09.738056 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:02:09.786580 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:09.797469 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:02:09.852039 tst cs_paging_gprs_active.py: using LAC 41075 13:02:09.968435 tst cs_paging_gprs_active.py: using RAC 20 13:02:10.095173 tst cs_paging_gprs_active.py: using CellId 41075 13:02:10.220376 tst cs_paging_gprs_active.py: using BVCI 41076 13:02:10.340016 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:10.351710 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:10.362892 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:10.373900 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:10.385371 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:10.396757 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:10.408338 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:10.419587 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:10.430971 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:10.547827 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:10.668064 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:02:10.888405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:11.214823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24765): Launched 13:02:11.497028 run iperf3-srv_10.42.42.10(pid=24766): Launched 13:02:11.618666 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:02:11.837673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:12.163109 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24767): Launched 13:02:12.445833 run iperf3-srv_10.42.42.10(pid=24768): Launched 13:02:12.567269 tst cs_paging_gprs_active.py:38: start network... 13:02:12.786283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:13.287840 run create_hlr_db(pid=24769): Launched 13:02:13.414422 bus /gobi_6: Setting Powered False 13:02:14.474961 run create_hlr_db(pid=24769): Terminated: ok {rc=0} 13:02:14.924045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24771): Launched 13:02:15.248920 run osmo-hlr_10.42.42.2(pid=24772): Launched 13:02:15.373914 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:15.961301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24774): Launched 13:02:16.317728 run osmo-stp_10.42.42.5(pid=24775): Launched 13:02:16.510232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:17.193409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24777): Launched 13:02:17.308602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:17.563635 run patchelf(pid=24778): Launched 13:02:17.731363 run osmo-stp_10.42.42.5(pid=24775): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24775)] 13:02:17.858605 run osmo-stp_10.42.42.5(pid=24775): stdout: | (launched: 2022-12-14_13:02:16.244642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:17.987707 run osmo-stp_10.42.42.5(pid=24775): stderr: | 20221214130216570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130216570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130216570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130216570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130216571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130216571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130216571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:18.116918 run osmo-stp_10.42.42.5(pid=24775): stdout: | (launched: 2022-12-14_13:02:16.244642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:18.241468 run osmo-stp_10.42.42.5(pid=24775): stderr: | 20221214130216570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130216570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130216570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130216570 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130216571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130216571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130216571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:18.387947 run patchelf(pid=24778): Terminating (SIGINT) 13:02:18.558676 run patchelf(pid=24778): Terminated: ok {rc=0} 13:02:18.680627 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=24775): Process ended prematurely: osmo-stp_10.42.42.5(pid=24775) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24775)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:02:18.690095 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:02:18.716670 run osmo-hlr_10.42.42.2(pid=24772): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24772)] 13:02:18.764058 run osmo-hlr_10.42.42.2(pid=24772): stdout: | (launched: 2022-12-14_13:02:15.189535) 13:02:18.813056 run osmo-hlr_10.42.42.2(pid=24772): stderr: | 20221214130215389 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130215389 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130215389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130215389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130215389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130215389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130215402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130215410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130215410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130215410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:18.862264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24765): Terminating (SIGTERM) 13:02:18.901576 run iperf3-srv_10.42.42.10(pid=24766): Terminating (SIGTERM) 13:02:18.940792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24767): Terminating (SIGTERM) 13:02:18.979975 run iperf3-srv_10.42.42.10(pid=24768): Terminating (SIGTERM) 13:02:19.019099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24771): Terminating (SIGTERM) 13:02:19.058385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24774): Terminating (SIGTERM) 13:02:19.097343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24777): Terminating (SIGTERM) 13:02:19.137336 --- ParallelTerminationStrategy: PID 24765 died... 13:02:19.156338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24765): Terminated: ok {rc=0} 13:02:19.200504 --- ParallelTerminationStrategy: PID 24766 died... 13:02:19.219025 run iperf3-srv_10.42.42.10(pid=24766): Terminated {rc=256} 13:02:19.262287 --- ParallelTerminationStrategy: PID 24767 died... 13:02:19.280575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24767): Terminated: ok {rc=0} 13:02:19.323930 --- ParallelTerminationStrategy: PID 24768 died... 13:02:19.342473 run iperf3-srv_10.42.42.10(pid=24768): Terminated {rc=256} 13:02:19.385754 --- ParallelTerminationStrategy: PID 24771 died... 13:02:19.404204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24771): Terminated: ok {rc=0} 13:02:19.447422 --- ParallelTerminationStrategy: PID 24774 died... 13:02:19.465950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24774): Terminated: ok {rc=0} 13:02:19.509263 --- ParallelTerminationStrategy: PID 24777 died... 13:02:19.527777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24777): Terminated: ok {rc=0} 13:02:19.612022 bus /gobi_0: Setting Powered False 13:02:20.712260 bus /gobi_0: Setting Powered False 13:02:21.826784 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:02:22.971192 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:22.982560 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:02:23.041392 tst iperf3.py: using LAC 41076 13:02:23.159309 tst iperf3.py: using RAC 21 13:02:23.278790 tst iperf3.py: using CellId 41076 13:02:23.398413 tst iperf3.py: using BVCI 41077 13:02:23.506934 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:23.517716 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:23.528236 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:23.538893 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:23.549360 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:23.560175 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:23.571132 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:23.581530 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:23.592582 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:23.706236 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:02:23.927385 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:24.252914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24780): Launched 13:02:24.535154 run iperf3-srv_10.42.42.10(pid=24781): Launched 13:02:24.657353 tst iperf3.py:8: start network... 13:02:24.876999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:25.378906 run create_hlr_db(pid=24782): Launched 13:02:25.502790 bus /gobi_6: Setting Powered False 13:02:26.566896 run create_hlr_db(pid=24782): Terminated: ok {rc=0} 13:02:26.999152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24784): Launched 13:02:27.300727 run osmo-hlr_10.42.42.2(pid=24785): Launched 13:02:27.416232 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:27.952845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24787): Launched 13:02:28.253790 run osmo-stp_10.42.42.5(pid=24788): Launched 13:02:28.369537 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:28.889056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24790): Launched 13:02:29.005178 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:29.260125 run patchelf(pid=24791): Launched 13:02:29.427846 run osmo-stp_10.42.42.5(pid=24788): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24788)] 13:02:29.555480 run osmo-stp_10.42.42.5(pid=24788): stdout: | (launched: 2022-12-14_13:02:28.198929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:29.684333 run osmo-stp_10.42.42.5(pid=24788): stderr: | 20221214130228369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130228369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130228369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130228370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130228370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130228370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130228370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:29.813610 run osmo-stp_10.42.42.5(pid=24788): stdout: | (launched: 2022-12-14_13:02:28.198929) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:29.937189 run osmo-stp_10.42.42.5(pid=24788): stderr: | 20221214130228369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130228369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130228369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130228370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130228370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130228370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130228370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:30.083514 run patchelf(pid=24791): Terminating (SIGINT) 13:02:30.252725 run patchelf(pid=24791): Terminated: ok {rc=0} 13:02:30.375660 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24788): Process ended prematurely: osmo-stp_10.42.42.5(pid=24788) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24788)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 13:02:30.385121 tst iperf3.py:8: Test FAILED (7.4 sec) 13:02:30.411849 run osmo-hlr_10.42.42.2(pid=24785): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24785)] 13:02:30.458953 run osmo-hlr_10.42.42.2(pid=24785): stdout: | (launched: 2022-12-14_13:02:27.246305) 13:02:30.507450 run osmo-hlr_10.42.42.2(pid=24785): stderr: | 20221214130227423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130227423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130227424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130227424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130227424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130227424 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130227436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130227446 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130227446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130227446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:30.556359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24780): Terminating (SIGTERM) 13:02:30.595996 run iperf3-srv_10.42.42.10(pid=24781): Terminating (SIGTERM) 13:02:30.635165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24784): Terminating (SIGTERM) 13:02:30.674518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24787): Terminating (SIGTERM) 13:02:30.713758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24790): Terminating (SIGTERM) 13:02:30.753329 --- ParallelTerminationStrategy: PID 24780 died... 13:02:30.772414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24780): Terminated: ok {rc=0} 13:02:30.816487 --- ParallelTerminationStrategy: PID 24781 died... 13:02:30.844431 run iperf3-srv_10.42.42.10(pid=24781): Terminated {rc=256} 13:02:30.911370 --- ParallelTerminationStrategy: PID 24784 died... 13:02:30.931697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24784): Terminated: ok {rc=0} 13:02:30.976507 --- ParallelTerminationStrategy: PID 24787 died... 13:02:30.995651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24787): Terminated: ok {rc=0} 13:02:31.040081 --- ParallelTerminationStrategy: PID 24790 died... 13:02:31.059425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24790): Terminated: ok {rc=0} 13:02:31.144073 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:02:32.307436 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:32.319371 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:02:32.378842 tst iperf3m4.py: using LAC 41077 13:02:32.509349 tst iperf3m4.py: using RAC 22 13:02:32.636334 tst iperf3m4.py: using CellId 41077 13:02:32.761310 tst iperf3m4.py: using BVCI 41078 13:02:32.879102 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:32.890523 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:32.901605 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:32.912536 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:32.923817 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:32.935156 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:32.946577 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:32.957843 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:32.969451 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:33.085751 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:33.206495 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:33.323744 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:33.438740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:02:33.640640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:33.942981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24792): Launched 13:02:34.205895 run iperf3-srv_10.42.42.10(pid=24793): Launched 13:02:34.318357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:02:34.519263 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:34.820463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Launched 13:02:35.082307 run iperf3-srv_10.42.42.10(pid=24795): Launched 13:02:35.194604 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:02:35.395800 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:35.697335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24796): Launched 13:02:35.960599 run iperf3-srv_10.42.42.10(pid=24797): Launched 13:02:36.072882 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:02:36.274537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:02:36.577309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24798): Launched 13:02:36.839725 run iperf3-srv_10.42.42.10(pid=24799): Launched 13:02:36.952098 tst iperf3m4.py:8: start network... 13:02:37.153341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:37.618082 run create_hlr_db(pid=24800): Launched 13:02:37.742011 bus /gobi_6: Setting Powered False 13:02:38.802373 run create_hlr_db(pid=24800): Terminated: ok {rc=0} 13:02:39.224409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24802): Launched 13:02:39.525682 run osmo-hlr_10.42.42.2(pid=24803): Launched 13:02:39.639715 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:40.160867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24805): Launched 13:02:40.462204 run osmo-stp_10.42.42.5(pid=24806): Launched 13:02:40.576926 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:41.094868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24808): Launched 13:02:41.209993 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:41.464649 run patchelf(pid=24809): Launched 13:02:41.632305 run osmo-stp_10.42.42.5(pid=24806): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24806)] 13:02:41.759677 run osmo-stp_10.42.42.5(pid=24806): stdout: | (launched: 2022-12-14_13:02:40.407371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:41.888735 run osmo-stp_10.42.42.5(pid=24806): stderr: | 20221214130240578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130240579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130240579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130240579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130240580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130240580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130240580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:42.018283 run osmo-stp_10.42.42.5(pid=24806): stdout: | (launched: 2022-12-14_13:02:40.407371) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:42.141803 run osmo-stp_10.42.42.5(pid=24806): stderr: | 20221214130240578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130240579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130240579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130240579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130240580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130240580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130240580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:42.288556 run patchelf(pid=24809): Terminating (SIGINT) 13:02:42.457838 run patchelf(pid=24809): Terminated: ok {rc=0} 13:02:42.579301 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24806): Process ended prematurely: osmo-stp_10.42.42.5(pid=24806) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24806)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:02:42.588603 tst iperf3m4.py:8: Test FAILED (10.3 sec) 13:02:42.615556 run osmo-hlr_10.42.42.2(pid=24803): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24803)] 13:02:42.662727 run osmo-hlr_10.42.42.2(pid=24803): stdout: | (launched: 2022-12-14_13:02:39.470309) 13:02:42.711471 run osmo-hlr_10.42.42.2(pid=24803): stderr: | 20221214130239647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130239647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130239647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130239647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130239647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130239647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130239660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130239670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130239670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130239670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:42.760604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24792): Terminating (SIGTERM) 13:02:42.799865 run iperf3-srv_10.42.42.10(pid=24793): Terminating (SIGTERM) 13:02:42.839403 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Terminating (SIGTERM) 13:02:42.878977 run iperf3-srv_10.42.42.10(pid=24795): Terminating (SIGTERM) 13:02:42.918335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24796): Terminating (SIGTERM) 13:02:42.957690 run iperf3-srv_10.42.42.10(pid=24797): Terminating (SIGTERM) 13:02:42.997068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24798): Terminating (SIGTERM) 13:02:43.036329 run iperf3-srv_10.42.42.10(pid=24799): Terminating (SIGTERM) 13:02:43.075489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24802): Terminating (SIGTERM) 13:02:43.114826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24805): Terminating (SIGTERM) 13:02:43.154111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24808): Terminating (SIGTERM) 13:02:43.193736 --- ParallelTerminationStrategy: PID 24792 died... 13:02:43.212702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24792): Terminated: ok {rc=0} 13:02:43.256569 --- ParallelTerminationStrategy: PID 24793 died... 13:02:43.275120 run iperf3-srv_10.42.42.10(pid=24793): Terminated {rc=256} 13:02:43.318775 --- ParallelTerminationStrategy: PID 24794 died... 13:02:43.337245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24794): Terminated: ok {rc=0} 13:02:43.381011 --- ParallelTerminationStrategy: PID 24795 died... 13:02:43.399396 run iperf3-srv_10.42.42.10(pid=24795): Terminated {rc=256} 13:02:43.442899 --- ParallelTerminationStrategy: PID 24796 died... 13:02:43.461388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24796): Terminated: ok {rc=0} 13:02:43.504940 --- ParallelTerminationStrategy: PID 24797 died... 13:02:43.523482 run iperf3-srv_10.42.42.10(pid=24797): Terminated {rc=256} 13:02:43.567168 --- ParallelTerminationStrategy: PID 24798 died... 13:02:43.585651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=24798): Terminated: ok {rc=0} 13:02:43.629307 --- ParallelTerminationStrategy: PID 24799 died... 13:02:43.647832 run iperf3-srv_10.42.42.10(pid=24799): Terminated {rc=256} 13:02:43.691404 --- ParallelTerminationStrategy: PID 24802 died... 13:02:43.710111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24802): Terminated: ok {rc=0} 13:02:43.753754 --- ParallelTerminationStrategy: PID 24805 died... 13:02:43.772227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24805): Terminated: ok {rc=0} 13:02:43.815881 --- ParallelTerminationStrategy: PID 24808 died... 13:02:43.834570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24808): Terminated: ok {rc=0} 13:02:43.917143 bus /gobi_4: Setting Powered False 13:02:45.011752 bus /gobi_4: Setting Powered False 13:02:46.133510 bus /gobi_1: Setting Powered False 13:02:47.247147 bus /gobi_1: Setting Powered False 13:02:48.362690 bus /gobi_0: Setting Powered False 13:02:49.457371 bus /gobi_0: Setting Powered False 13:02:50.572675 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:02:51.675994 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:51.687435 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:02:51.745100 tst ping.py: using LAC 41078 13:02:51.863550 tst ping.py: using RAC 23 13:02:52.006504 tst ping.py: using CellId 41078 13:02:52.123996 tst ping.py: using BVCI 41079 13:02:52.232641 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:52.243686 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:52.254473 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:52.265030 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:52.275429 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:52.286045 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:52.297136 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:52.308071 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:02:52.421331 tst ping.py:19: start network... 13:02:52.619986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:02:53.078946 run create_hlr_db(pid=24810): Launched 13:02:53.200602 bus /gobi_6: Setting Powered False 13:02:54.262472 run create_hlr_db(pid=24810): Terminated: ok {rc=0} 13:02:54.698534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24812): Launched 13:02:55.018121 run osmo-hlr_10.42.42.2(pid=24813): Launched 13:02:55.139717 run osmo-stp_10.42.42.5: Starting osmo-stp 13:02:55.695143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24815): Launched 13:02:56.015999 run osmo-stp_10.42.42.5(pid=24816): Launched 13:02:56.138899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:02:56.690650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24818): Launched 13:02:56.812859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:02:57.082790 run patchelf(pid=24819): Launched 13:02:57.260902 run osmo-stp_10.42.42.5(pid=24816): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24816)] 13:02:57.396360 run osmo-stp_10.42.42.5(pid=24816): stdout: | (launched: 2022-12-14_13:02:55.957998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:57.533225 run osmo-stp_10.42.42.5(pid=24816): stderr: | 20221214130256151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130256151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130256151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130256152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130256152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130256152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130256152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:57.669973 run osmo-stp_10.42.42.5(pid=24816): stdout: | (launched: 2022-12-14_13:02:55.957998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:02:57.802150 run osmo-stp_10.42.42.5(pid=24816): stderr: | 20221214130256151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130256151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130256151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130256152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130256152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130256152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130256152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:02:57.957575 run patchelf(pid=24819): Terminating (SIGINT) 13:02:58.136101 run patchelf(pid=24819): Terminated: ok {rc=0} 13:02:58.265619 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=24816): Process ended prematurely: osmo-stp_10.42.42.5(pid=24816) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24816)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 13:02:58.275326 tst ping.py:22: Test FAILED (6.6 sec) 13:02:58.303739 run osmo-hlr_10.42.42.2(pid=24813): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24813)] 13:02:58.354338 run osmo-hlr_10.42.42.2(pid=24813): stdout: | (launched: 2022-12-14_13:02:54.960193) 13:02:58.406145 run osmo-hlr_10.42.42.2(pid=24813): stderr: | 20221214130255159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130255159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130255159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130255159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130255159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130255159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130255172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130255180 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130255181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130255181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:02:58.458224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24812): Terminating (SIGTERM) 13:02:58.500425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24815): Terminating (SIGTERM) 13:02:58.543179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24818): Terminating (SIGTERM) 13:02:58.586025 --- ParallelTerminationStrategy: PID 24812 died... 13:02:58.606784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24812): Terminated: ok {rc=0} 13:02:58.653853 --- ParallelTerminationStrategy: PID 24815 died... 13:02:58.673909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24815): Terminated: ok {rc=0} 13:02:58.721276 --- ParallelTerminationStrategy: PID 24818 died... 13:02:58.741408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24818): Terminated: ok {rc=0} 13:02:58.829986 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:02:59.916454 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:02:59.927915 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:02:59.986431 tst ping_idle_ping.py: using LAC 41079 13:03:00.103343 tst ping_idle_ping.py: using RAC 24 13:03:00.225336 tst ping_idle_ping.py: using CellId 41079 13:03:00.351219 tst ping_idle_ping.py: using BVCI 41080 13:03:00.468136 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:00.479690 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:00.490931 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:00.502140 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:00.513864 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:00.525607 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:00.537333 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:03:00.548721 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:03:00.663475 tst ping_idle_ping.py:24: start network... 13:03:00.890175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:01.407865 run create_hlr_db(pid=24821): Launched 13:03:01.566665 bus /gobi_6: Setting Powered False 13:03:02.630130 run create_hlr_db(pid=24821): Terminated: ok {rc=0} 13:03:03.058306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24823): Launched 13:03:03.356265 run osmo-hlr_10.42.42.2(pid=24824): Launched 13:03:03.469303 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:03.979987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24826): Launched 13:03:04.277501 run osmo-stp_10.42.42.5(pid=24827): Launched 13:03:04.390600 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:03:04.905086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24829): Launched 13:03:05.019060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:03:05.270146 run patchelf(pid=24830): Launched 13:03:05.435341 run osmo-stp_10.42.42.5(pid=24827): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24827)] 13:03:05.561165 run osmo-stp_10.42.42.5(pid=24827): stdout: | (launched: 2022-12-14_13:03:04.222767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:05.688142 run osmo-stp_10.42.42.5(pid=24827): stderr: | 20221214130304392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130304392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130304392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130304393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130304393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130304393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130304393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:05.815973 run osmo-stp_10.42.42.5(pid=24827): stdout: | (launched: 2022-12-14_13:03:04.222767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:05.937977 run osmo-stp_10.42.42.5(pid=24827): stderr: | 20221214130304392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130304392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130304392 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130304393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130304393 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130304393 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130304393 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:06.082694 run patchelf(pid=24830): Terminating (SIGINT) 13:03:06.249096 run patchelf(pid=24830): Terminated: ok {rc=0} 13:03:06.368883 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=24827): Process ended prematurely: osmo-stp_10.42.42.5(pid=24827) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24827)] [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:03:06.377870 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:03:06.404482 run osmo-hlr_10.42.42.2(pid=24824): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24824)] 13:03:06.452563 run osmo-hlr_10.42.42.2(pid=24824): stdout: | (launched: 2022-12-14_13:03:03.301372) 13:03:06.501945 run osmo-hlr_10.42.42.2(pid=24824): stderr: | 20221214130303479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130303479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130303480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130303480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130303480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130303480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130303525 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130303535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130303536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130303536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:06.551785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24823): Terminating (SIGTERM) 13:03:06.591791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24826): Terminating (SIGTERM) 13:03:06.631247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24829): Terminating (SIGTERM) 13:03:06.670783 --- ParallelTerminationStrategy: PID 24823 died... 13:03:06.689640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24823): Terminated: ok {rc=0} 13:03:06.733122 --- ParallelTerminationStrategy: PID 24826 died... 13:03:06.751602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24826): Terminated: ok {rc=0} 13:03:06.795087 --- ParallelTerminationStrategy: PID 24829 died... 13:03:06.813652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24829): Terminated: ok {rc=0} 13:03:06.899097 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:03:08.184332 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:08.190707 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:03:08.211029 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:03:08.246127 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:03:08.298305 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:03:08.319239 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:03:08.353975 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:03:08.911011 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:03:08.916151 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:08.927329 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:03:08.985251 tst switch_tch_pdch.py: using LAC 41080 13:03:09.104162 tst switch_tch_pdch.py: using RAC 25 13:03:09.230366 tst switch_tch_pdch.py: using CellId 41080 13:03:09.357423 tst switch_tch_pdch.py: using BVCI 41081 13:03:09.465416 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:09.476463 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:09.487451 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:09.498290 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:09.509047 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:09.519839 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:09.530766 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:03:09.541649 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:03:09.661815 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:03:09.777435 tst switch_tch_pdch.py:51: start network... 13:03:09.974924 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:10.432669 run create_hlr_db(pid=24835): Launched 13:03:10.554259 bus /gobi_6: Setting Powered False 13:03:11.613517 run create_hlr_db(pid=24835): Terminated: ok {rc=0} 13:03:12.026124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24837): Launched 13:03:12.321288 run osmo-hlr_10.42.42.2(pid=24838): Launched 13:03:12.434038 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:12.941447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24840): Launched 13:03:13.236826 run osmo-stp_10.42.42.5(pid=24841): Launched 13:03:13.349101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:03:13.858745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24843): Launched 13:03:13.971212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:03:14.220782 run patchelf(pid=24844): Launched 13:03:14.384733 run osmo-stp_10.42.42.5(pid=24841): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24841)] 13:03:14.509426 run osmo-stp_10.42.42.5(pid=24841): stdout: | (launched: 2022-12-14_13:03:13.182465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:14.636009 run osmo-stp_10.42.42.5(pid=24841): stderr: | 20221214130313354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130313354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130313354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130313355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130313355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130313355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130313355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:14.763608 run osmo-stp_10.42.42.5(pid=24841): stdout: | (launched: 2022-12-14_13:03:13.182465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:14.884287 run osmo-stp_10.42.42.5(pid=24841): stderr: | 20221214130313354 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130313354 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130313354 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130313355 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130313355 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130313355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130313355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:15.028188 run patchelf(pid=24844): Terminating (SIGINT) 13:03:15.194359 run patchelf(pid=24844): Terminated: ok {rc=0} 13:03:15.314381 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24841): Process ended prematurely: osmo-stp_10.42.42.5(pid=24841) [trial-2405↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24841)] [trial-2405↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:03:15.323102 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:03:15.349616 run osmo-hlr_10.42.42.2(pid=24838): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24838)] 13:03:15.396913 run osmo-hlr_10.42.42.2(pid=24838): stdout: | (launched: 2022-12-14_13:03:12.267124) 13:03:15.446357 run osmo-hlr_10.42.42.2(pid=24838): stderr: | 20221214130312441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130312441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130312441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130312441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130312441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130312441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130312457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130312465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130312465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130312465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:15.495799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24837): Terminating (SIGTERM) 13:03:15.535477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24840): Terminating (SIGTERM) 13:03:15.575215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24843): Terminating (SIGTERM) 13:03:15.615202 --- ParallelTerminationStrategy: PID 24837 died... 13:03:15.634419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24837): Terminated: ok {rc=0} 13:03:15.678539 --- ParallelTerminationStrategy: PID 24840 died... 13:03:15.697092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24840): Terminated: ok {rc=0} 13:03:15.740619 --- ParallelTerminationStrategy: PID 24843 died... 13:03:15.759154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24843): Terminated: ok {rc=0} 13:03:15.851336 bus /gobi_0: Setting Powered False 13:03:16.951804 bus /gobi_0: Setting Powered False 13:03:18.070280 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:03:19.308390 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:19.314619 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:03:19.335646 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:03:19.371518 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:03:19.425946 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:03:19.446908 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:03:19.481897 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:03:20.033395 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:03:20.038520 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:20.049474 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:03:20.104843 tst switch_tch_pdch.py: using LAC 41081 13:03:20.221380 tst switch_tch_pdch.py: using RAC 26 13:03:20.336886 tst switch_tch_pdch.py: using CellId 41081 13:03:20.472754 tst switch_tch_pdch.py: using BVCI 41082 13:03:20.588144 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:20.599738 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:20.610842 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:20.622130 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:20.633628 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:20.644713 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:20.656178 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:03:20.667473 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:03:20.782664 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:03:20.901454 tst switch_tch_pdch.py:51: start network... 13:03:21.116068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:21.581271 run create_hlr_db(pid=24848): Launched 13:03:21.702830 bus /gobi_6: Setting Powered False 13:03:22.765285 run create_hlr_db(pid=24848): Terminated: ok {rc=0} 13:03:23.165653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24850): Launched 13:03:23.463009 run osmo-hlr_10.42.42.2(pid=24851): Launched 13:03:23.576367 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:24.061300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24853): Launched 13:03:24.357171 run osmo-stp_10.42.42.5(pid=24854): Launched 13:03:24.469827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:03:24.957154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24856): Launched 13:03:25.070472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:03:25.320450 run patchelf(pid=24857): Launched 13:03:25.484198 run osmo-stp_10.42.42.5(pid=24854): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24854)] 13:03:25.609517 run osmo-stp_10.42.42.5(pid=24854): stdout: | (launched: 2022-12-14_13:03:24.302790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:25.735769 run osmo-stp_10.42.42.5(pid=24854): stderr: | 20221214130324473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130324473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130324473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130324474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130324476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130324476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130324476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:25.862933 run osmo-stp_10.42.42.5(pid=24854): stdout: | (launched: 2022-12-14_13:03:24.302790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:25.984060 run osmo-stp_10.42.42.5(pid=24854): stderr: | 20221214130324473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130324473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130324473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130324474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130324476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130324476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130324476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:26.128434 run patchelf(pid=24857): Terminating (SIGINT) 13:03:26.294539 run patchelf(pid=24857): Terminated: ok {rc=0} 13:03:26.414262 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=24854): Process ended prematurely: osmo-stp_10.42.42.5(pid=24854) [trial-2405↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24854)] [trial-2405↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:03:26.423039 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:03:26.449481 run osmo-hlr_10.42.42.2(pid=24851): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24851)] 13:03:26.496871 run osmo-hlr_10.42.42.2(pid=24851): stdout: | (launched: 2022-12-14_13:03:23.408732) 13:03:26.546068 run osmo-hlr_10.42.42.2(pid=24851): stderr: | 20221214130323585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130323585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130323585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130323585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130323585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130323585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130323597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130323607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130323608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130323608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:26.595528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24850): Terminating (SIGTERM) 13:03:26.635215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24853): Terminating (SIGTERM) 13:03:26.674667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24856): Terminating (SIGTERM) 13:03:26.714491 --- ParallelTerminationStrategy: PID 24850 died... 13:03:26.733948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24850): Terminated: ok {rc=0} 13:03:26.778080 --- ParallelTerminationStrategy: PID 24853 died... 13:03:26.796463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24853): Terminated: ok {rc=0} 13:03:26.840418 --- ParallelTerminationStrategy: PID 24856 died... 13:03:26.859059 run pcap-recorder_any(filters='host 10.42.42.6')(pid=24856): Terminated: ok {rc=0} 13:03:26.944940 bus /gobi_0: Setting Powered False 13:03:28.044384 bus /gobi_0: Setting Powered False 13:03:29.159887 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_sms:oc2g --------------------------------------------------------------------- 13:03:30.400003 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:30.404107 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 13:03:30.425046 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 13:03:30.432053 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 13:03:30.486187 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 13:03:30.507493 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 13:03:30.514538 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 13:03:31.065671 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 13:03:31.073243 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 13:03:31.088031 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 13:03:31.134682 tst mo_mt_sms.py: using LAC 41082 13:03:31.262556 tst mo_mt_sms.py: using RAC 27 13:03:31.429873 tst mo_mt_sms.py: using CellId 41082 13:03:31.575230 tst mo_mt_sms.py: using BVCI 41083 13:03:31.689364 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 13:03:31.801854 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 13:03:31.917953 tst mo_mt_sms.py:9: start nitb and bts... 13:03:32.137975 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:03:32.790706 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24861): Launched 13:03:33.112250 run osmo-nitb_10.42.42.2(pid=24862): Launched 13:03:33.289515 run osmo-nitb_10.42.42.2(pid=24862): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24862)] 13:03:33.432758 run osmo-nitb_10.42.42.2(pid=24862): stdout: | (launched: 2022-12-14_13:03:33.053923) 13:03:33.577167 run osmo-nitb_10.42.42.2(pid=24862): stderr: | (launched: 2022-12-14_13:03:33.101959) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:03:33.721854 run osmo-nitb_10.42.42.2(pid=24862): stdout: | (launched: 2022-12-14_13:03:33.053923) 13:03:33.860648 run osmo-nitb_10.42.42.2(pid=24862): stderr: | (launched: 2022-12-14_13:03:33.101959) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24862): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24862) [trial-2405↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24862)] 13:03:34.233382 tst osmo-nitb_10.42.42.2(pid=24862): stdout: | (launched: 2022-12-14_13:03:33.053923) 13:03:34.363692 tst osmo-nitb_10.42.42.2(pid=24862): stderr: | (launched: 2022-12-14_13:03:33.101959) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:03:34.516522 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=24862): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24862) [trial-2405↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24862)] [trial-2405↪nitb_sms:oc2g↪mo_mt_sms.py:11] 13:03:34.525696 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 13:03:34.532539 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24861): Terminating (SIGTERM) 13:03:34.744537 --- ParallelTerminationStrategy: PID 24861 died... 13:03:34.765944 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24861): Terminated: ok {rc=0} 13:03:34.855861 bus /sierra_3: Setting Powered False 13:03:35.955189 bus /sierra_3: Setting Powered False 13:03:37.073531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 sms:oc2g --------------------------------------------------------------------- 13:03:38.254532 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:38.258954 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 13:03:38.279999 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 13:03:38.309469 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 13:03:38.363157 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 13:03:38.384452 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 13:03:38.412479 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 13:03:38.956092 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 sms:oc2g mo_mt_sms.py ---------------------------------------------- 13:03:38.962686 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:03:38.973880 tst sms:oc2g: Using 1 x bts (candidates: 1) 13:03:39.009992 tst mo_mt_sms.py: using LAC 41083 13:03:39.134790 tst mo_mt_sms.py: using RAC 28 13:03:39.257429 tst mo_mt_sms.py: using CellId 41083 13:03:39.373309 tst mo_mt_sms.py: using BVCI 41084 13:03:39.480334 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:03:39.490704 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:03:39.500857 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:03:39.511034 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:03:39.521161 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 13:03:39.531408 tst sms:oc2g: Using 1 x modem (candidates: 2) 13:03:39.650339 tst sms:oc2g: Using 1 x modem (candidates: 2) 13:03:39.768114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:40.263688 run create_hlr_db(pid=24866): Launched 13:03:40.388321 bus /sierra_2: Setting Powered False 13:03:41.451761 run create_hlr_db(pid=24866): Terminated: ok {rc=0} 13:03:41.878195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24868): Launched 13:03:42.175517 run osmo-hlr_10.42.42.2(pid=24869): Launched 13:03:42.288152 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:42.816449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24871): Launched 13:03:43.114269 run osmo-stp_10.42.42.5(pid=24872): Launched 13:03:43.227280 run osmo-msc_10.42.42.6: Starting osmo-msc 13:03:43.763356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24874): Launched 13:03:44.059970 run osmo-msc_10.42.42.6(pid=24875): Launched 13:03:44.225452 run osmo-stp_10.42.42.5(pid=24872): ERR: Terminated: ERROR {rc=1} [trial-2405↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24872)] 13:03:44.351059 run osmo-stp_10.42.42.5(pid=24872): stdout: | (launched: 2022-12-14_13:03:43.059306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:44.476520 run osmo-stp_10.42.42.5(pid=24872): stderr: | 20221214130343229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130343229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130343230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130343230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130343231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130343231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130343231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:44.599978 run osmo-stp_10.42.42.5(pid=24872): stdout: | (launched: 2022-12-14_13:03:43.059306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:03:44.718178 run osmo-stp_10.42.42.5(pid=24872): stderr: | 20221214130343229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130343229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130343230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130343230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130343231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130343231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130343231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:03:44.859335 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=24872): Process ended prematurely: osmo-stp_10.42.42.5(pid=24872) [trial-2405↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24872)] [trial-2405↪sms:oc2g↪mo_mt_sms.py:16] 13:03:44.867741 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 13:03:44.894173 run osmo-hlr_10.42.42.2(pid=24869): ERR: Terminated: ERROR {rc=237} [trial-2405↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24869)] 13:03:44.941552 run osmo-hlr_10.42.42.2(pid=24869): stdout: | (launched: 2022-12-14_13:03:42.120567) 13:03:44.990446 run osmo-hlr_10.42.42.2(pid=24869): stderr: | 20221214130342299 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130342299 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130342299 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130342299 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130342299 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130342299 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130342312 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130342320 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130342320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130342320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:03:45.058643 run osmo-msc_10.42.42.6(pid=24875): ERR: Terminated: ERROR {rc=2} [trial-2405↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24875)] 13:03:45.105929 run osmo-msc_10.42.42.6(pid=24875): stdout: | (launched: 2022-12-14_13:03:44.005266) 13:03:45.154536 run osmo-msc_10.42.42.6(pid=24875): stderr: | 20221214130344279 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130344279 DLGLOBAL DEBUG validating counter group 0x7efff6994c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130344279 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130344279 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130344279 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130344280 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130344281 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130344282 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130344282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130344282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:03:45.203414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24868): Terminating (SIGTERM) 13:03:45.242583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24871): Terminating (SIGTERM) 13:03:45.281793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24874): Terminating (SIGTERM) 13:03:45.321625 --- ParallelTerminationStrategy: PID 24868 died... 13:03:45.340810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24868): Terminated: ok {rc=0} 13:03:45.384612 --- ParallelTerminationStrategy: PID 24871 died... 13:03:45.403288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24871): Terminated: ok {rc=0} 13:03:45.447192 --- ParallelTerminationStrategy: PID 24874 died... 13:03:45.466349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24874): Terminated: ok {rc=0} 13:03:45.549766 bus /sierra_3: Setting Powered False 13:03:46.652791 bus /sierra_3: Setting Powered False 13:03:47.787216 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_ussd:oc2g --------------------------------------------------------------------- 13:03:48.999183 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:49.003238 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 13:03:49.023807 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 13:03:49.030977 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 13:03:49.064486 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 13:03:49.085110 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 13:03:49.091739 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 13:03:49.611268 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 13:03:49.617582 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 13:03:49.628545 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 13:03:49.663508 tst assert_extension.py: using LAC 41084 13:03:49.789129 tst assert_extension.py: using RAC 29 13:03:49.915506 tst assert_extension.py: using CellId 41084 13:03:50.040195 tst assert_extension.py: using BVCI 41085 13:03:50.157425 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 13:03:50.273162 tst assert_extension.py:10: start nitb and bts... 13:03:50.490952 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:03:51.141631 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24880): Launched 13:03:51.461506 run osmo-nitb_10.42.42.2(pid=24881): Launched 13:03:51.639080 run osmo-nitb_10.42.42.2(pid=24881): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24881)] 13:03:51.782631 run osmo-nitb_10.42.42.2(pid=24881): stdout: | (launched: 2022-12-14_13:03:51.403544) 13:03:51.927642 run osmo-nitb_10.42.42.2(pid=24881): stderr: | (launched: 2022-12-14_13:03:51.451237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:03:52.072519 run osmo-nitb_10.42.42.2(pid=24881): stdout: | (launched: 2022-12-14_13:03:51.403544) 13:03:52.211834 run osmo-nitb_10.42.42.2(pid=24881): stderr: | (launched: 2022-12-14_13:03:51.451237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=24881): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24881) [trial-2405↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24881)] 13:03:52.582301 tst osmo-nitb_10.42.42.2(pid=24881): stdout: | (launched: 2022-12-14_13:03:51.403544) 13:03:52.712144 tst osmo-nitb_10.42.42.2(pid=24881): stderr: | (launched: 2022-12-14_13:03:51.451237) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:03:52.865085 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=24881): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24881) [trial-2405↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24881)] [trial-2405↪nitb_ussd:oc2g↪assert_extension.py:12] 13:03:52.874071 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:03:52.881486 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24880): Terminating (SIGTERM) 13:03:53.092938 --- ParallelTerminationStrategy: PID 24880 died... 13:03:53.114585 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=24880): Terminated: ok {rc=0} 13:03:53.203086 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 ussd:oc2g --------------------------------------------------------------------- 13:03:54.365793 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:03:54.370084 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 13:03:54.390830 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 13:03:54.418562 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 13:03:54.459162 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 13:03:54.482735 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 13:03:54.509852 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 13:03:55.030288 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 ussd:oc2g assert_extension.py ---------------------------------------------- 13:03:55.035448 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:03:55.046084 tst ussd:oc2g: Using 1 x bts (candidates: 1) 13:03:55.079743 tst assert_extension.py: using LAC 41085 13:03:55.204473 tst assert_extension.py: using RAC 30 13:03:55.328040 tst assert_extension.py: using CellId 41085 13:03:55.453024 tst assert_extension.py: using BVCI 41086 13:03:55.568423 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:03:55.579286 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:03:55.589990 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:03:55.600584 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:03:55.611686 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 13:03:55.622629 tst ussd:oc2g: Using 1 x modem (candidates: 1) 13:03:55.736287 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:03:56.197143 run create_hlr_db(pid=24885): Launched 13:03:56.319885 bus /sierra_2: Setting Powered False 13:03:57.379041 run create_hlr_db(pid=24885): Terminated: ok {rc=0} 13:03:57.814377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24887): Launched 13:03:58.134449 run osmo-hlr_10.42.42.2(pid=24888): Launched 13:03:58.257373 run osmo-stp_10.42.42.5: Starting osmo-stp 13:03:58.777257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24890): Launched 13:03:59.075399 run osmo-stp_10.42.42.5(pid=24891): Launched 13:03:59.188530 run osmo-msc_10.42.42.6: Starting osmo-msc 13:03:59.721867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24893): Launched 13:04:00.018526 run osmo-msc_10.42.42.6(pid=24894): Launched 13:04:00.184423 run osmo-stp_10.42.42.5(pid=24891): ERR: Terminated: ERROR {rc=1} [trial-2405↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24891)] 13:04:00.309594 run osmo-stp_10.42.42.5(pid=24891): stdout: | (launched: 2022-12-14_13:03:59.020790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:00.435072 run osmo-stp_10.42.42.5(pid=24891): stderr: | 20221214130359190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130359191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130359191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130359191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130359192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130359192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130359192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:00.558941 run osmo-stp_10.42.42.5(pid=24891): stdout: | (launched: 2022-12-14_13:03:59.020790) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:00.676804 run osmo-stp_10.42.42.5(pid=24891): stderr: | 20221214130359190 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130359191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130359191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130359191 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130359192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130359192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130359192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:00.819394 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=24891): Process ended prematurely: osmo-stp_10.42.42.5(pid=24891) [trial-2405↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24891)] [trial-2405↪ussd:oc2g↪assert_extension.py:17] 13:04:00.829131 tst assert_extension.py:17: Test FAILED (5.8 sec) 13:04:00.862935 run osmo-hlr_10.42.42.2(pid=24888): ERR: Terminated: ERROR {rc=237} [trial-2405↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24888)] 13:04:00.912419 run osmo-hlr_10.42.42.2(pid=24888): stdout: | (launched: 2022-12-14_13:03:58.076139) 13:04:00.962377 run osmo-hlr_10.42.42.2(pid=24888): stderr: | 20221214130358275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130358275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130358275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130358275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130358275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130358275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130358287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130358295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130358295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130358295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:01.033176 run osmo-msc_10.42.42.6(pid=24894): ERR: Terminated: ERROR {rc=2} [trial-2405↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24894)] 13:04:01.082052 run osmo-msc_10.42.42.6(pid=24894): stdout: | (launched: 2022-12-14_13:03:59.963829) 13:04:01.132318 run osmo-msc_10.42.42.6(pid=24894): stderr: | 20221214130400235 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130400235 DLGLOBAL DEBUG validating counter group 0x7ff7fba84c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130400235 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130400235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130400235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130400236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130400239 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130400240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130400240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130400240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:01.183100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24887): Terminating (SIGTERM) 13:04:01.224350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24890): Terminating (SIGTERM) 13:04:01.266731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24893): Terminating (SIGTERM) 13:04:01.307622 --- ParallelTerminationStrategy: PID 24887 died... 13:04:01.327208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24887): Terminated: ok {rc=0} 13:04:01.371465 --- ParallelTerminationStrategy: PID 24890 died... 13:04:01.390949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24890): Terminated: ok {rc=0} 13:04:01.435103 --- ParallelTerminationStrategy: PID 24893 died... 13:04:01.453978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24893): Terminated: ok {rc=0} 13:04:01.537802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:04:02.728933 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:02.735572 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:04:02.756152 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:04:02.783111 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:04:02.833687 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:04:02.854650 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:04:02.882179 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:04:03.429830 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:04:03.479469 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:03.490557 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:04:03.545512 tst mo_mt_call.py: using LAC 41086 13:04:03.663794 tst mo_mt_call.py: using RAC 31 13:04:03.781663 tst mo_mt_call.py: using CellId 41086 13:04:03.909591 tst mo_mt_call.py: using BVCI 41087 13:04:04.019697 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:04.030894 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:04.041814 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:04.052652 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:04.063560 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:04.074509 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:04.193534 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:04.309353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:04.777632 run create_hlr_db(pid=24899): Launched 13:04:04.902180 bus /sierra_2: Setting Powered False 13:04:05.961803 run create_hlr_db(pid=24899): Terminated: ok {rc=0} 13:04:06.407828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24901): Launched 13:04:06.732810 run osmo-hlr_10.42.42.2(pid=24902): Launched 13:04:06.856786 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:07.418630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24904): Launched 13:04:07.744881 run osmo-stp_10.42.42.5(pid=24905): Launched 13:04:07.869790 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:08.458500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24907): Launched 13:04:08.783839 run osmo-msc_10.42.42.6(pid=24908): Launched 13:04:08.964442 run osmo-stp_10.42.42.5(pid=24905): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24905)] 13:04:09.101744 run osmo-stp_10.42.42.5(pid=24905): stdout: | (launched: 2022-12-14_13:04:07.685754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:09.239365 run osmo-stp_10.42.42.5(pid=24905): stderr: | 20221214130407880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130407880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130407880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130407881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130407881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130407881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130407881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:09.377168 run osmo-stp_10.42.42.5(pid=24905): stdout: | (launched: 2022-12-14_13:04:07.685754) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:09.507012 run osmo-stp_10.42.42.5(pid=24905): stderr: | 20221214130407880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130407880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130407880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130407881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130407881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130407881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130407881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:09.662207 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24905): Process ended prematurely: osmo-stp_10.42.42.5(pid=24905) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24905)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:04:09.671684 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:04:09.699452 run osmo-hlr_10.42.42.2(pid=24902): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24902)] 13:04:09.750830 run osmo-hlr_10.42.42.2(pid=24902): stdout: | (launched: 2022-12-14_13:04:06.674207) 13:04:09.803000 run osmo-hlr_10.42.42.2(pid=24902): stderr: | 20221214130406874 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130406874 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130406874 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130406874 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130406875 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130406875 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130406885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130406893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130406894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130406894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:09.875507 run osmo-msc_10.42.42.6(pid=24908): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24908)] 13:04:09.925822 run osmo-msc_10.42.42.6(pid=24908): stdout: | (launched: 2022-12-14_13:04:08.724664) 13:04:09.978145 run osmo-msc_10.42.42.6(pid=24908): stderr: | 20221214130409046 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130409046 DLGLOBAL DEBUG validating counter group 0x7fe5c78c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130409046 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130409046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130409047 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130409047 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130409048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130409049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130409049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130409049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:10.030661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24901): Terminating (SIGTERM) 13:04:10.073142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24904): Terminating (SIGTERM) 13:04:10.115447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24907): Terminating (SIGTERM) 13:04:10.157962 --- ParallelTerminationStrategy: PID 24901 died... 13:04:10.178387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24901): Terminated: ok {rc=0} 13:04:10.225170 --- ParallelTerminationStrategy: PID 24904 died... 13:04:10.244849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24904): Terminated: ok {rc=0} 13:04:10.291766 --- ParallelTerminationStrategy: PID 24907 died... 13:04:10.311632 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24907): Terminated: ok {rc=0} 13:04:10.399496 bus /sierra_3: Setting Powered False 13:04:11.494226 bus /sierra_3: Setting Powered False 13:04:12.608592 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:04:13.754014 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:13.765655 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:04:13.821531 tst mo_mt_call_osmux.py: using LAC 41087 13:04:13.941179 tst mo_mt_call_osmux.py: using RAC 32 13:04:14.060269 tst mo_mt_call_osmux.py: using CellId 41087 13:04:14.181141 tst mo_mt_call_osmux.py: using BVCI 41088 13:04:14.290400 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:14.301530 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:14.312333 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:14.323114 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:14.333929 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:04:14.345066 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:14.458823 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:04:14.578880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:15.084273 run create_hlr_db(pid=24910): Launched 13:04:15.210114 bus /sierra_2: Setting Powered False 13:04:16.275178 run create_hlr_db(pid=24910): Terminated: ok {rc=0} 13:04:16.769822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24912): Launched 13:04:17.118101 run osmo-hlr_10.42.42.2(pid=24913): Launched 13:04:17.265628 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:17.831767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24915): Launched 13:04:18.156227 run osmo-stp_10.42.42.5(pid=24916): Launched 13:04:18.281371 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:18.867541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24918): Launched 13:04:19.191769 run osmo-msc_10.42.42.6(pid=24919): Launched 13:04:19.373264 run osmo-stp_10.42.42.5(pid=24916): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24916)] 13:04:19.510587 run osmo-stp_10.42.42.5(pid=24916): stdout: | (launched: 2022-12-14_13:04:18.097340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:19.648202 run osmo-stp_10.42.42.5(pid=24916): stderr: | 20221214130418289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130418289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130418289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130418290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130418292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130418292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130418292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:19.785362 run osmo-stp_10.42.42.5(pid=24916): stdout: | (launched: 2022-12-14_13:04:18.097340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:19.915071 run osmo-stp_10.42.42.5(pid=24916): stderr: | 20221214130418289 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130418289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130418289 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130418290 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130418292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130418292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130418292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:20.070383 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24916): Process ended prematurely: osmo-stp_10.42.42.5(pid=24916) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24916)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:04:20.079717 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:04:20.107309 run osmo-hlr_10.42.42.2(pid=24913): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24913)] 13:04:20.157921 run osmo-hlr_10.42.42.2(pid=24913): stdout: | (launched: 2022-12-14_13:04:17.054623) 13:04:20.209699 run osmo-hlr_10.42.42.2(pid=24913): stderr: | 20221214130417274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130417274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130417274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130417274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130417274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130417274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130417286 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130417295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130417295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130417295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:20.281837 run osmo-msc_10.42.42.6(pid=24919): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24919)] 13:04:20.331851 run osmo-msc_10.42.42.6(pid=24919): stdout: | (launched: 2022-12-14_13:04:19.132626) 13:04:20.383664 run osmo-msc_10.42.42.6(pid=24919): stderr: | 20221214130419457 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130419457 DLGLOBAL DEBUG validating counter group 0x7feec1980c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130419458 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130419458 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130419458 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130419458 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130419460 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130419460 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130419460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130419460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:20.435841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24912): Terminating (SIGTERM) 13:04:20.477481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24915): Terminating (SIGTERM) 13:04:20.518949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24918): Terminating (SIGTERM) 13:04:20.560686 --- ParallelTerminationStrategy: PID 24912 died... 13:04:20.581056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24912): Terminated: ok {rc=0} 13:04:20.627277 --- ParallelTerminationStrategy: PID 24915 died... 13:04:20.647066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24915): Terminated: ok {rc=0} 13:04:20.693298 --- ParallelTerminationStrategy: PID 24918 died... 13:04:20.712878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24918): Terminated: ok {rc=0} 13:04:20.800412 bus /sierra_3: Setting Powered False 13:04:21.898669 bus /sierra_3: Setting Powered False 13:04:23.014716 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:04:24.249193 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:24.255904 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:04:24.276581 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:04:24.306703 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:04:24.357636 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:04:24.378566 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:04:24.405175 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:04:24.953834 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:04:25.002224 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:25.013366 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:04:25.068880 tst mo_mt_call.py: using LAC 41088 13:04:25.188485 tst mo_mt_call.py: using RAC 33 13:04:25.309461 tst mo_mt_call.py: using CellId 41088 13:04:25.427945 tst mo_mt_call.py: using BVCI 41089 13:04:25.536756 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:25.547764 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:25.558595 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:25.569275 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:25.579994 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:25.590753 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:04:25.711063 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:04:25.829208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:26.335237 run create_hlr_db(pid=24925): Launched 13:04:26.459932 bus /sierra_2: Setting Powered False 13:04:27.525105 run create_hlr_db(pid=24925): Terminated: ok {rc=0} 13:04:27.978241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24927): Launched 13:04:28.302636 run osmo-hlr_10.42.42.2(pid=24928): Launched 13:04:28.427793 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:28.985749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24930): Launched 13:04:29.309583 run osmo-stp_10.42.42.5(pid=24931): Launched 13:04:29.434677 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:30.020318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24933): Launched 13:04:30.344842 run osmo-msc_10.42.42.6(pid=24934): Launched 13:04:30.526517 run osmo-stp_10.42.42.5(pid=24931): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24931)] 13:04:30.664036 run osmo-stp_10.42.42.5(pid=24931): stdout: | (launched: 2022-12-14_13:04:29.250504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:30.802363 run osmo-stp_10.42.42.5(pid=24931): stderr: | 20221214130429443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130429443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130429444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130429444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130429445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130429445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130429445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:30.956005 run osmo-stp_10.42.42.5(pid=24931): stdout: | (launched: 2022-12-14_13:04:29.250504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:31.089239 run osmo-stp_10.42.42.5(pid=24931): stderr: | 20221214130429443 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130429443 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130429444 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130429444 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130429445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130429445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130429445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:31.249021 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24931): Process ended prematurely: osmo-stp_10.42.42.5(pid=24931) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24931)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:04:31.259490 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:04:31.288540 run osmo-hlr_10.42.42.2(pid=24928): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24928)] 13:04:31.343838 run osmo-hlr_10.42.42.2(pid=24928): stdout: | (launched: 2022-12-14_13:04:28.243494) 13:04:31.397839 run osmo-hlr_10.42.42.2(pid=24928): stderr: | 20221214130428443 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130428443 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130428443 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130428443 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130428443 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130428443 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130428455 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130428464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130428464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130428464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:31.472356 run osmo-msc_10.42.42.6(pid=24934): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24934)] 13:04:31.523514 run osmo-msc_10.42.42.6(pid=24934): stdout: | (launched: 2022-12-14_13:04:30.285548) 13:04:31.578156 run osmo-msc_10.42.42.6(pid=24934): stderr: | 20221214130430607 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130430607 DLGLOBAL DEBUG validating counter group 0x7f29ccff2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130430607 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130430607 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130430607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130430607 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130430609 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130430610 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130430610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130430610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:31.632555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24927): Terminating (SIGTERM) 13:04:31.675296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24930): Terminating (SIGTERM) 13:04:31.719115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24933): Terminating (SIGTERM) 13:04:31.763592 --- ParallelTerminationStrategy: PID 24927 died... 13:04:31.785525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24927): Terminated: ok {rc=0} 13:04:31.836370 --- ParallelTerminationStrategy: PID 24930 died... 13:04:31.856832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24930): Terminated: ok {rc=0} 13:04:31.905351 --- ParallelTerminationStrategy: PID 24933 died... 13:04:31.926811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24933): Terminated: ok {rc=0} 13:04:32.023051 bus /sierra_3: Setting Powered False 13:04:33.136683 bus /sierra_3: Setting Powered False 13:04:34.251697 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:04:35.400762 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:35.412766 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:04:35.470174 tst mo_mt_call_osmux.py: using LAC 41089 13:04:35.597369 tst mo_mt_call_osmux.py: using RAC 34 13:04:35.725646 tst mo_mt_call_osmux.py: using CellId 41089 13:04:35.856266 tst mo_mt_call_osmux.py: using BVCI 41090 13:04:35.975772 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:35.987134 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:35.998247 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:36.009337 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:36.020800 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:04:36.032313 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:04:36.149131 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:04:36.271566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:36.775843 run create_hlr_db(pid=24936): Launched 13:04:36.899572 bus /sierra_2: Setting Powered False 13:04:37.963518 run create_hlr_db(pid=24936): Terminated: ok {rc=0} 13:04:38.397031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24938): Launched 13:04:38.699477 run osmo-hlr_10.42.42.2(pid=24939): Launched 13:04:38.814816 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:39.334162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24941): Launched 13:04:39.635734 run osmo-stp_10.42.42.5(pid=24942): Launched 13:04:39.751181 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:40.294387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24944): Launched 13:04:40.595502 run osmo-msc_10.42.42.6(pid=24945): Launched 13:04:40.763606 run osmo-stp_10.42.42.5(pid=24942): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24942)] 13:04:40.890838 run osmo-stp_10.42.42.5(pid=24942): stdout: | (launched: 2022-12-14_13:04:39.580542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:41.017844 run osmo-stp_10.42.42.5(pid=24942): stderr: | 20221214130439751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130439751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130439752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130439752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130439752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130439753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130439753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:41.143596 run osmo-stp_10.42.42.5(pid=24942): stdout: | (launched: 2022-12-14_13:04:39.580542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:41.263524 run osmo-stp_10.42.42.5(pid=24942): stderr: | 20221214130439751 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130439751 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130439752 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130439752 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130439752 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130439753 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130439753 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:41.407764 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24942): Process ended prematurely: osmo-stp_10.42.42.5(pid=24942) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24942)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:04:41.416635 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:04:41.442858 run osmo-hlr_10.42.42.2(pid=24939): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24939)] 13:04:41.490764 run osmo-hlr_10.42.42.2(pid=24939): stdout: | (launched: 2022-12-14_13:04:38.644453) 13:04:41.539886 run osmo-hlr_10.42.42.2(pid=24939): stderr: | 20221214130438819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130438819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130438819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130438819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130438819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130438819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130438833 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130438843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130438843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130438843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:41.608320 run osmo-msc_10.42.42.6(pid=24945): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24945)] 13:04:41.655588 run osmo-msc_10.42.42.6(pid=24945): stdout: | (launched: 2022-12-14_13:04:40.540106) 13:04:41.704387 run osmo-msc_10.42.42.6(pid=24945): stderr: | 20221214130440812 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130440812 DLGLOBAL DEBUG validating counter group 0x7f784465fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130440812 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130440812 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130440812 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130440812 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130440814 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130440815 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130440815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130440815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:41.753469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24938): Terminating (SIGTERM) 13:04:41.792763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24941): Terminating (SIGTERM) 13:04:41.831770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24944): Terminating (SIGTERM) 13:04:41.870978 --- ParallelTerminationStrategy: PID 24938 died... 13:04:41.890421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24938): Terminated: ok {rc=0} 13:04:41.934153 --- ParallelTerminationStrategy: PID 24941 died... 13:04:41.952628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24941): Terminated: ok {rc=0} 13:04:41.995929 --- ParallelTerminationStrategy: PID 24944 died... 13:04:42.014277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24944): Terminated: ok {rc=0} 13:04:42.099180 bus /sierra_3: Setting Powered False 13:04:43.195999 bus /sierra_3: Setting Powered False 13:04:44.307798 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:04:45.540265 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:04:45.547398 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:04:45.568274 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:04:45.596011 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:04:45.651888 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:04:45.672927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:04:45.700092 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:04:46.263584 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:04:46.330510 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:46.344766 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:04:46.409298 tst mo_mt_call.py: using LAC 41090 13:04:46.564554 tst mo_mt_call.py: using RAC 35 13:04:46.726110 tst mo_mt_call.py: using CellId 41090 13:04:46.858491 tst mo_mt_call.py: using BVCI 41091 13:04:46.980023 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:46.992250 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:47.004002 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:47.015865 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:47.028021 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:47.040161 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:04:47.163677 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:04:47.298708 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:47.776012 run create_hlr_db(pid=24950): Launched 13:04:47.900646 bus /sierra_2: Setting Powered False 13:04:48.961632 run create_hlr_db(pid=24950): Terminated: ok {rc=0} 13:04:49.384413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24952): Launched 13:04:49.687281 run osmo-hlr_10.42.42.2(pid=24953): Launched 13:04:49.801852 run osmo-stp_10.42.42.5: Starting osmo-stp 13:04:50.333719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24955): Launched 13:04:50.634205 run osmo-stp_10.42.42.5(pid=24956): Launched 13:04:50.749526 run osmo-msc_10.42.42.6: Starting osmo-msc 13:04:51.292928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24958): Launched 13:04:51.595132 run osmo-msc_10.42.42.6(pid=24959): Launched 13:04:51.763693 run osmo-stp_10.42.42.5(pid=24956): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24956)] 13:04:51.891108 run osmo-stp_10.42.42.5(pid=24956): stdout: | (launched: 2022-12-14_13:04:50.579119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:52.018501 run osmo-stp_10.42.42.5(pid=24956): stderr: | 20221214130450748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130450748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130450749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130450749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130450750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130450750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130450750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:52.144329 run osmo-stp_10.42.42.5(pid=24956): stdout: | (launched: 2022-12-14_13:04:50.579119) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:04:52.264459 run osmo-stp_10.42.42.5(pid=24956): stderr: | 20221214130450748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130450748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130450749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130450749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130450750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130450750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130450750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:04:52.408126 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24956): Process ended prematurely: osmo-stp_10.42.42.5(pid=24956) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24956)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:04:52.416812 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:04:52.443090 run osmo-hlr_10.42.42.2(pid=24953): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24953)] 13:04:52.490982 run osmo-hlr_10.42.42.2(pid=24953): stdout: | (launched: 2022-12-14_13:04:49.632341) 13:04:52.540028 run osmo-hlr_10.42.42.2(pid=24953): stderr: | 20221214130449811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130449811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130449811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130449811 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130449811 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130449811 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130449825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130449835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130449835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130449835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:04:52.608606 run osmo-msc_10.42.42.6(pid=24959): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24959)] 13:04:52.655670 run osmo-msc_10.42.42.6(pid=24959): stdout: | (launched: 2022-12-14_13:04:51.539707) 13:04:52.704466 run osmo-msc_10.42.42.6(pid=24959): stderr: | 20221214130451812 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130451812 DLGLOBAL DEBUG validating counter group 0x7fe1c3768c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130451813 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130451813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130451813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130451813 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130451815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130451815 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130451815 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130451816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:04:52.753542 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24952): Terminating (SIGTERM) 13:04:52.792539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24955): Terminating (SIGTERM) 13:04:52.831739 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24958): Terminating (SIGTERM) 13:04:52.871263 --- ParallelTerminationStrategy: PID 24952 died... 13:04:52.890253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24952): Terminated: ok {rc=0} 13:04:52.933756 --- ParallelTerminationStrategy: PID 24955 died... 13:04:52.952222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24955): Terminated: ok {rc=0} 13:04:52.995795 --- ParallelTerminationStrategy: PID 24958 died... 13:04:53.014317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24958): Terminated: ok {rc=0} 13:04:53.099462 bus /sierra_3: Setting Powered False 13:04:54.197810 bus /sierra_3: Setting Powered False 13:04:55.311695 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:04:56.458011 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:56.469817 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:04:56.525476 tst mo_mt_call_osmux.py: using LAC 41091 13:04:56.643911 tst mo_mt_call_osmux.py: using RAC 36 13:04:56.764272 tst mo_mt_call_osmux.py: using CellId 41091 13:04:56.888352 tst mo_mt_call_osmux.py: using BVCI 41092 13:04:56.998441 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:57.009421 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:57.020082 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:57.030722 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:57.041350 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:04:57.052484 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:04:57.167543 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:04:57.287498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:04:57.793849 run create_hlr_db(pid=24961): Launched 13:04:57.919211 bus /sierra_2: Setting Powered False 13:04:58.983676 run create_hlr_db(pid=24961): Terminated: ok {rc=0} 13:04:59.437469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24963): Launched 13:04:59.762272 run osmo-hlr_10.42.42.2(pid=24964): Launched 13:04:59.886005 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:00.449071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24966): Launched 13:05:00.773643 run osmo-stp_10.42.42.5(pid=24967): Launched 13:05:00.995365 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:01.666228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24972): Launched 13:05:02.039018 run osmo-msc_10.42.42.6(pid=24973): Launched 13:05:02.401100 run osmo-stp_10.42.42.5(pid=24967): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24967)] 13:05:02.541084 run osmo-stp_10.42.42.5(pid=24967): stdout: | (launched: 2022-12-14_13:05:00.714753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:02.678619 run osmo-stp_10.42.42.5(pid=24967): stderr: | 20221214130500940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130500940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130500940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130500941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130500941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130500941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130500941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:02.813841 run osmo-stp_10.42.42.5(pid=24967): stdout: | (launched: 2022-12-14_13:05:00.714753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:02.943627 run osmo-stp_10.42.42.5(pid=24967): stderr: | 20221214130500940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130500940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130500940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130500941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130500941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130500941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130500941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:03.099171 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24967): Process ended prematurely: osmo-stp_10.42.42.5(pid=24967) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24967)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:05:03.108578 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 13:05:03.136527 run osmo-hlr_10.42.42.2(pid=24964): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24964)] 13:05:03.186960 run osmo-hlr_10.42.42.2(pid=24964): stdout: | (launched: 2022-12-14_13:04:59.703517) 13:05:03.238666 run osmo-hlr_10.42.42.2(pid=24964): stderr: | 20221214130459903 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130459903 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130459903 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130459903 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130459903 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130459904 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130459919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130459929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130459929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130459929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:03.311152 run osmo-msc_10.42.42.6(pid=24973): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24973)] 13:05:03.361350 run osmo-msc_10.42.42.6(pid=24973): stdout: | (launched: 2022-12-14_13:05:01.974217) 13:05:03.413131 run osmo-msc_10.42.42.6(pid=24973): stderr: | 20221214130502454 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130502454 DLGLOBAL DEBUG validating counter group 0x7ff0f883fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130502454 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130502454 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130502454 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130502454 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130502456 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130502456 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130502457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130502457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:03.465356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24963): Terminating (SIGTERM) 13:05:03.507047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24966): Terminating (SIGTERM) 13:05:03.548851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24972): Terminating (SIGTERM) 13:05:03.590979 --- ParallelTerminationStrategy: PID 24963 died... 13:05:03.611281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24963): Terminated: ok {rc=0} 13:05:03.657738 --- ParallelTerminationStrategy: PID 24966 died... 13:05:03.677594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24966): Terminated: ok {rc=0} 13:05:03.723918 --- ParallelTerminationStrategy: PID 24972 died... 13:05:03.743900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24972): Terminated: ok {rc=0} 13:05:03.831600 bus /sierra_3: Setting Powered False 13:05:04.929768 bus /sierra_3: Setting Powered False 13:05:06.045714 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:05:07.279500 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:07.286460 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:05:07.307254 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:05:07.335101 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:05:07.387149 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:05:07.407395 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:05:07.433729 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:05:07.984245 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:05:08.033371 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:08.044310 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:05:08.099750 tst mo_mt_call.py: using LAC 41092 13:05:08.218464 tst mo_mt_call.py: using RAC 37 13:05:08.338437 tst mo_mt_call.py: using CellId 41092 13:05:08.456454 tst mo_mt_call.py: using BVCI 41093 13:05:08.567340 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:08.578354 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:08.589307 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:08.599746 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:08.610520 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:08.621352 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:08.739271 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:08.855864 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:09.324156 run create_hlr_db(pid=24978): Launched 13:05:09.447618 bus /sierra_2: Setting Powered False 13:05:10.508368 run create_hlr_db(pid=24978): Terminated: ok {rc=0} 13:05:10.953491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24980): Launched 13:05:11.277581 run osmo-hlr_10.42.42.2(pid=24981): Launched 13:05:11.402058 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:11.963557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24983): Launched 13:05:12.287566 run osmo-stp_10.42.42.5(pid=24984): Launched 13:05:12.411885 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:12.998159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24986): Launched 13:05:13.322594 run osmo-msc_10.42.42.6(pid=24987): Launched 13:05:13.503616 run osmo-stp_10.42.42.5(pid=24984): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24984)] 13:05:13.642188 run osmo-stp_10.42.42.5(pid=24984): stdout: | (launched: 2022-12-14_13:05:12.228844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:13.780047 run osmo-stp_10.42.42.5(pid=24984): stderr: | 20221214130512419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130512419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130512420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130512420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130512420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130512421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130512421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:13.917253 run osmo-stp_10.42.42.5(pid=24984): stdout: | (launched: 2022-12-14_13:05:12.228844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:14.047335 run osmo-stp_10.42.42.5(pid=24984): stderr: | 20221214130512419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130512419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130512420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130512420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130512420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130512421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130512421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:14.203031 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24984): Process ended prematurely: osmo-stp_10.42.42.5(pid=24984) [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24984)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:05:14.212635 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:05:14.240523 run osmo-hlr_10.42.42.2(pid=24981): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24981)] 13:05:14.291181 run osmo-hlr_10.42.42.2(pid=24981): stdout: | (launched: 2022-12-14_13:05:11.218908) 13:05:14.343876 run osmo-hlr_10.42.42.2(pid=24981): stderr: | 20221214130511418 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130511418 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130511418 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130511418 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130511418 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130511418 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130511432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130511440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130511440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130511440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:14.416111 run osmo-msc_10.42.42.6(pid=24987): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24987)] 13:05:14.465892 run osmo-msc_10.42.42.6(pid=24987): stdout: | (launched: 2022-12-14_13:05:13.263523) 13:05:14.517393 run osmo-msc_10.42.42.6(pid=24987): stderr: | 20221214130513586 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130513586 DLGLOBAL DEBUG validating counter group 0x7fc6514e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130513586 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130513586 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130513586 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130513586 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130513588 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130513588 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130513588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130513589 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:14.569379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24980): Terminating (SIGTERM) 13:05:14.611374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24983): Terminating (SIGTERM) 13:05:14.653618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24986): Terminating (SIGTERM) 13:05:14.695769 --- ParallelTerminationStrategy: PID 24980 died... 13:05:14.715819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24980): Terminated: ok {rc=0} 13:05:14.761944 --- ParallelTerminationStrategy: PID 24983 died... 13:05:14.781614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24983): Terminated: ok {rc=0} 13:05:14.827452 --- ParallelTerminationStrategy: PID 24986 died... 13:05:14.847479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24986): Terminated: ok {rc=0} 13:05:14.934882 bus /sierra_3: Setting Powered False 13:05:16.043222 bus /sierra_3: Setting Powered False 13:05:17.172541 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:05:18.326676 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:18.338665 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:05:18.396126 tst mo_mt_call_osmux.py: using LAC 41093 13:05:18.524435 tst mo_mt_call_osmux.py: using RAC 38 13:05:18.652817 tst mo_mt_call_osmux.py: using CellId 41093 13:05:18.779990 tst mo_mt_call_osmux.py: using BVCI 41094 13:05:18.897510 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:18.908845 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:18.920000 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:18.931243 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:18.942747 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:05:18.954254 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:19.073839 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:05:19.193561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:19.698085 run create_hlr_db(pid=24990): Launched 13:05:19.821652 bus /sierra_2: Setting Powered False 13:05:20.882348 run create_hlr_db(pid=24990): Terminated: ok {rc=0} 13:05:21.335588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24992): Launched 13:05:21.661118 run osmo-hlr_10.42.42.2(pid=24993): Launched 13:05:21.785654 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:22.347021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24995): Launched 13:05:22.671594 run osmo-stp_10.42.42.5(pid=24996): Launched 13:05:22.795586 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:23.382773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24998): Launched 13:05:23.708189 run osmo-msc_10.42.42.6(pid=24999): Launched 13:05:23.889208 run osmo-stp_10.42.42.5(pid=24996): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24996)] 13:05:24.025847 run osmo-stp_10.42.42.5(pid=24996): stdout: | (launched: 2022-12-14_13:05:22.612615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:24.162824 run osmo-stp_10.42.42.5(pid=24996): stderr: | 20221214130522807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130522807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130522807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130522807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130522808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130522808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130522808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:24.299758 run osmo-stp_10.42.42.5(pid=24996): stdout: | (launched: 2022-12-14_13:05:22.612615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:24.429886 run osmo-stp_10.42.42.5(pid=24996): stderr: | 20221214130522807 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130522807 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130522807 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130522807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130522808 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130522808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130522808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:24.584853 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=24996): Process ended prematurely: osmo-stp_10.42.42.5(pid=24996) [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24996)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:05:24.594487 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:05:24.622049 run osmo-hlr_10.42.42.2(pid=24993): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=24993)] 13:05:24.671931 run osmo-hlr_10.42.42.2(pid=24993): stdout: | (launched: 2022-12-14_13:05:21.602216) 13:05:24.723135 run osmo-hlr_10.42.42.2(pid=24993): stderr: | 20221214130521802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130521802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130521802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130521802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130521802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130521803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130521814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130521822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130521822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130521823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:24.794812 run osmo-msc_10.42.42.6(pid=24999): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=24999)] 13:05:24.844016 run osmo-msc_10.42.42.6(pid=24999): stdout: | (launched: 2022-12-14_13:05:23.648824) 13:05:24.895471 run osmo-msc_10.42.42.6(pid=24999): stderr: | 20221214130523971 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130523971 DLGLOBAL DEBUG validating counter group 0x7fed670b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130523971 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130523971 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130523971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130523971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130523973 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130523973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130523974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130523974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:24.946792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24992): Terminating (SIGTERM) 13:05:24.988354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24995): Terminating (SIGTERM) 13:05:25.030450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24998): Terminating (SIGTERM) 13:05:25.072853 --- ParallelTerminationStrategy: PID 24992 died... 13:05:25.093095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=24992): Terminated: ok {rc=0} 13:05:25.139051 --- ParallelTerminationStrategy: PID 24995 died... 13:05:25.158750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=24995): Terminated: ok {rc=0} 13:05:25.204642 --- ParallelTerminationStrategy: PID 24998 died... 13:05:25.224482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=24998): Terminated: ok {rc=0} 13:05:25.311610 bus /sierra_3: Setting Powered False 13:05:26.408816 bus /sierra_3: Setting Powered False 13:05:27.526694 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:05:28.761353 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:28.768116 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:05:28.788845 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:05:28.817929 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:05:28.871419 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:05:28.893738 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:05:28.921546 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:05:29.470655 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:05:29.524082 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:29.535541 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:05:29.593434 tst mo_mt_call.py: using LAC 41094 13:05:29.721687 tst mo_mt_call.py: using RAC 39 13:05:29.853291 tst mo_mt_call.py: using CellId 41094 13:05:29.979277 tst mo_mt_call.py: using BVCI 41095 13:05:30.096874 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:30.108303 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:30.119538 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:30.130772 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:30.142254 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:30.153858 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:05:30.273211 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:05:30.392614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:30.929140 run create_hlr_db(pid=25004): Launched 13:05:31.095188 bus /sierra_2: Setting Powered False 13:05:32.159352 run create_hlr_db(pid=25004): Terminated: ok {rc=0} 13:05:32.594868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25006): Launched 13:05:32.896783 run osmo-hlr_10.42.42.2(pid=25007): Launched 13:05:33.013229 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:33.543890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25009): Launched 13:05:33.846538 run osmo-stp_10.42.42.5(pid=25010): Launched 13:05:33.961226 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:34.507359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25012): Launched 13:05:34.809879 run osmo-msc_10.42.42.6(pid=25013): Launched 13:05:34.978388 run osmo-stp_10.42.42.5(pid=25010): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25010)] 13:05:35.106138 run osmo-stp_10.42.42.5(pid=25010): stdout: | (launched: 2022-12-14_13:05:33.791035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:35.234068 run osmo-stp_10.42.42.5(pid=25010): stderr: | 20221214130533961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130533961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130533962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130533962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130533963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130533963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130533963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:35.360393 run osmo-stp_10.42.42.5(pid=25010): stdout: | (launched: 2022-12-14_13:05:33.791035) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:35.480531 run osmo-stp_10.42.42.5(pid=25010): stderr: | 20221214130533961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130533961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130533962 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130533962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130533963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130533963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130533963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:35.624723 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25010): Process ended prematurely: osmo-stp_10.42.42.5(pid=25010) [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25010)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:05:35.633865 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:05:35.660096 run osmo-hlr_10.42.42.2(pid=25007): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25007)] 13:05:35.707554 run osmo-hlr_10.42.42.2(pid=25007): stdout: | (launched: 2022-12-14_13:05:32.841589) 13:05:35.756727 run osmo-hlr_10.42.42.2(pid=25007): stderr: | 20221214130533017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130533017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130533017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130533017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130533017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130533017 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130533027 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130533037 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130533037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130533037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:35.825012 run osmo-msc_10.42.42.6(pid=25013): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25013)] 13:05:35.872109 run osmo-msc_10.42.42.6(pid=25013): stdout: | (launched: 2022-12-14_13:05:34.754150) 13:05:35.920628 run osmo-msc_10.42.42.6(pid=25013): stderr: | 20221214130535024 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130535024 DLGLOBAL DEBUG validating counter group 0x7f9793d48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130535024 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130535024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130535025 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130535025 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130535026 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130535027 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130535027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130535027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:35.969677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25006): Terminating (SIGTERM) 13:05:36.008846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25009): Terminating (SIGTERM) 13:05:36.047881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25012): Terminating (SIGTERM) 13:05:36.087250 --- ParallelTerminationStrategy: PID 25006 died... 13:05:36.106408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25006): Terminated: ok {rc=0} 13:05:36.150273 --- ParallelTerminationStrategy: PID 25009 died... 13:05:36.169026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25009): Terminated: ok {rc=0} 13:05:36.212446 --- ParallelTerminationStrategy: PID 25012 died... 13:05:36.230895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25012): Terminated: ok {rc=0} 13:05:36.315656 bus /sierra_3: Setting Powered False 13:05:37.414674 bus /sierra_3: Setting Powered False 13:05:38.528229 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:05:39.674021 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:39.685714 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:05:39.741477 tst mo_mt_call_osmux.py: using LAC 41095 13:05:39.861719 tst mo_mt_call_osmux.py: using RAC 40 13:05:39.984137 tst mo_mt_call_osmux.py: using CellId 41095 13:05:40.110282 tst mo_mt_call_osmux.py: using BVCI 41096 13:05:40.228058 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:40.239685 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:40.250807 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:40.262164 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:40.273901 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:05:40.285434 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:05:40.401207 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:05:40.519267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:41.022925 run create_hlr_db(pid=25015): Launched 13:05:41.146690 bus /sierra_2: Setting Powered False 13:05:42.210706 run create_hlr_db(pid=25015): Terminated: ok {rc=0} 13:05:42.643773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25017): Launched 13:05:42.945606 run osmo-hlr_10.42.42.2(pid=25018): Launched 13:05:43.060607 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:43.585845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25020): Launched 13:05:43.888747 run osmo-stp_10.42.42.5(pid=25021): Launched 13:05:44.004196 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:44.550551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25023): Launched 13:05:44.852853 run osmo-msc_10.42.42.6(pid=25024): Launched 13:05:45.021940 run osmo-stp_10.42.42.5(pid=25021): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25021)] 13:05:45.149703 run osmo-stp_10.42.42.5(pid=25021): stdout: | (launched: 2022-12-14_13:05:43.833214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:45.277100 run osmo-stp_10.42.42.5(pid=25021): stderr: | 20221214130544003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130544003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130544004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130544004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130544005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130544005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130544005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:45.403384 run osmo-stp_10.42.42.5(pid=25021): stdout: | (launched: 2022-12-14_13:05:43.833214) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:45.523505 run osmo-stp_10.42.42.5(pid=25021): stderr: | 20221214130544003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130544003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130544004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130544004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130544005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130544005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130544005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:45.667552 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25021): Process ended prematurely: osmo-stp_10.42.42.5(pid=25021) [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25021)] [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:05:45.676440 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:05:45.702687 run osmo-hlr_10.42.42.2(pid=25018): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25018)] 13:05:45.750444 run osmo-hlr_10.42.42.2(pid=25018): stdout: | (launched: 2022-12-14_13:05:42.890087) 13:05:45.799387 run osmo-hlr_10.42.42.2(pid=25018): stderr: | 20221214130543069 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130543069 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130543069 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130543069 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130543069 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130543069 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130543081 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130543089 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130543090 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130543090 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:45.895826 run osmo-msc_10.42.42.6(pid=25024): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25024)] 13:05:45.947412 run osmo-msc_10.42.42.6(pid=25024): stdout: | (launched: 2022-12-14_13:05:44.797303) 13:05:46.001984 run osmo-msc_10.42.42.6(pid=25024): stderr: | 20221214130545067 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130545067 DLGLOBAL DEBUG validating counter group 0x7f6a0939ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130545067 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130545067 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130545067 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130545067 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130545069 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130545070 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130545070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130545070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:46.058033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25017): Terminating (SIGTERM) 13:05:46.101489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25020): Terminating (SIGTERM) 13:05:46.147851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25023): Terminating (SIGTERM) 13:05:46.194310 --- ParallelTerminationStrategy: PID 25017 died... 13:05:46.216432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25017): Terminated: ok {rc=0} 13:05:46.268657 --- ParallelTerminationStrategy: PID 25020 died... 13:05:46.289757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25020): Terminated: ok {rc=0} 13:05:46.338990 --- ParallelTerminationStrategy: PID 25023 died... 13:05:46.360652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25023): Terminated: ok {rc=0} 13:05:46.452295 bus /sierra_3: Setting Powered False 13:05:47.550768 bus /sierra_3: Setting Powered False 13:05:48.668137 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:05:49.906716 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:05:49.913559 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:05:49.934375 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:05:49.963788 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:05:50.015583 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:05:50.036817 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:05:50.064414 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:05:50.613203 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:05:50.662374 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:50.673697 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:05:50.728821 tst mo_mt_call.py: using LAC 41096 13:05:50.857460 tst mo_mt_call.py: using RAC 41 13:05:50.986563 tst mo_mt_call.py: using CellId 41096 13:05:51.115982 tst mo_mt_call.py: using BVCI 41097 13:05:51.227376 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:51.238506 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:51.249405 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:51.260160 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:51.271052 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:05:51.281993 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:05:51.396326 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:05:51.510036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:05:51.978674 run create_hlr_db(pid=25029): Launched 13:05:52.108021 bus /sierra_2: Setting Powered False 13:05:53.172836 run create_hlr_db(pid=25029): Terminated: ok {rc=0} 13:05:53.625927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25031): Launched 13:05:53.949947 run osmo-hlr_10.42.42.2(pid=25032): Launched 13:05:54.073370 run osmo-stp_10.42.42.5: Starting osmo-stp 13:05:54.633162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25034): Launched 13:05:54.957084 run osmo-stp_10.42.42.5(pid=25035): Launched 13:05:55.081196 run osmo-msc_10.42.42.6: Starting osmo-msc 13:05:55.669156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25037): Launched 13:05:55.993711 run osmo-msc_10.42.42.6(pid=25038): Launched 13:05:56.175195 run osmo-stp_10.42.42.5(pid=25035): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25035)] 13:05:56.313545 run osmo-stp_10.42.42.5(pid=25035): stdout: | (launched: 2022-12-14_13:05:54.898068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:56.452069 run osmo-stp_10.42.42.5(pid=25035): stderr: | 20221214130555091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130555091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130555091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130555092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130555092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130555092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130555092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:56.589245 run osmo-stp_10.42.42.5(pid=25035): stdout: | (launched: 2022-12-14_13:05:54.898068) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:05:56.719151 run osmo-stp_10.42.42.5(pid=25035): stderr: | 20221214130555091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130555091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130555091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130555092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130555092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130555092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130555092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:05:56.874402 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25035): Process ended prematurely: osmo-stp_10.42.42.5(pid=25035) [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25035)] [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:05:56.883846 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:05:56.911617 run osmo-hlr_10.42.42.2(pid=25032): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25032)] 13:05:56.962253 run osmo-hlr_10.42.42.2(pid=25032): stdout: | (launched: 2022-12-14_13:05:53.891105) 13:05:57.014364 run osmo-hlr_10.42.42.2(pid=25032): stderr: | 20221214130554091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130554091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130554091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130554091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130554091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130554091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130554104 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130554112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130554112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130554112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:05:57.087394 run osmo-msc_10.42.42.6(pid=25038): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25038)] 13:05:57.137345 run osmo-msc_10.42.42.6(pid=25038): stdout: | (launched: 2022-12-14_13:05:55.934693) 13:05:57.189439 run osmo-msc_10.42.42.6(pid=25038): stderr: | 20221214130556255 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130556255 DLGLOBAL DEBUG validating counter group 0x7fd9bd2cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130556255 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130556255 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130556256 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130556256 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130556257 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130556258 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130556258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130556258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:05:57.241959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25031): Terminating (SIGTERM) 13:05:57.283682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25034): Terminating (SIGTERM) 13:05:57.325592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25037): Terminating (SIGTERM) 13:05:57.368597 --- ParallelTerminationStrategy: PID 25031 died... 13:05:57.389239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25031): Terminated: ok {rc=0} 13:05:57.436159 --- ParallelTerminationStrategy: PID 25034 died... 13:05:57.456015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25034): Terminated: ok {rc=0} 13:05:57.502768 --- ParallelTerminationStrategy: PID 25037 died... 13:05:57.522691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25037): Terminated: ok {rc=0} 13:05:57.610168 bus /sierra_3: Setting Powered False 13:05:58.709048 bus /sierra_3: Setting Powered False 13:05:59.826782 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:06:00.986016 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:00.999849 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:06:01.061475 tst mo_mt_call_osmux.py: using LAC 41097 13:06:01.193076 tst mo_mt_call_osmux.py: using RAC 42 13:06:01.322830 tst mo_mt_call_osmux.py: using CellId 41097 13:06:01.455721 tst mo_mt_call_osmux.py: using BVCI 41098 13:06:01.580728 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.593717 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.606320 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.619053 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.632742 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:06:01.647075 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:06:01.787169 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:06:01.909788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:02.424480 run create_hlr_db(pid=25040): Launched 13:06:02.550440 bus /sierra_2: Setting Powered False 13:06:03.614780 run create_hlr_db(pid=25040): Terminated: ok {rc=0} 13:06:04.049862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25042): Launched 13:06:04.352705 run osmo-hlr_10.42.42.2(pid=25043): Launched 13:06:04.467168 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:05.002058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25045): Launched 13:06:05.305270 run osmo-stp_10.42.42.5(pid=25046): Launched 13:06:05.420428 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:05.966662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25048): Launched 13:06:06.269175 run osmo-msc_10.42.42.6(pid=25049): Launched 13:06:06.438471 run osmo-stp_10.42.42.5(pid=25046): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25046)] 13:06:06.566127 run osmo-stp_10.42.42.5(pid=25046): stdout: | (launched: 2022-12-14_13:06:05.249734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:06.693608 run osmo-stp_10.42.42.5(pid=25046): stderr: | 20221214130605421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130605421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130605421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130605422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130605422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130605422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130605422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:06.819497 run osmo-stp_10.42.42.5(pid=25046): stdout: | (launched: 2022-12-14_13:06:05.249734) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:06.940112 run osmo-stp_10.42.42.5(pid=25046): stderr: | 20221214130605421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130605421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130605421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130605422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130605422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130605422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130605422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:07.084037 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25046): Process ended prematurely: osmo-stp_10.42.42.5(pid=25046) [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25046)] [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:06:07.092817 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:06:07.119262 run osmo-hlr_10.42.42.2(pid=25043): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25043)] 13:06:07.167478 run osmo-hlr_10.42.42.2(pid=25043): stdout: | (launched: 2022-12-14_13:06:04.296870) 13:06:07.216452 run osmo-hlr_10.42.42.2(pid=25043): stderr: | 20221214130604475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130604475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130604475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130604475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130604475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130604475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130604488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130604498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130604499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130604499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:07.285180 run osmo-msc_10.42.42.6(pid=25049): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25049)] 13:06:07.332502 run osmo-msc_10.42.42.6(pid=25049): stdout: | (launched: 2022-12-14_13:06:06.213766) 13:06:07.381479 run osmo-msc_10.42.42.6(pid=25049): stderr: | 20221214130606485 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130606485 DLGLOBAL DEBUG validating counter group 0x7f505c395c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130606486 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130606486 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130606486 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130606486 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130606488 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130606488 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130606488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130606488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:07.430728 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25042): Terminating (SIGTERM) 13:06:07.470000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25045): Terminating (SIGTERM) 13:06:07.510625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25048): Terminating (SIGTERM) 13:06:07.550465 --- ParallelTerminationStrategy: PID 25042 died... 13:06:07.569604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25042): Terminated: ok {rc=0} 13:06:07.613317 --- ParallelTerminationStrategy: PID 25045 died... 13:06:07.631897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25045): Terminated: ok {rc=0} 13:06:07.675377 --- ParallelTerminationStrategy: PID 25048 died... 13:06:07.693854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25048): Terminated: ok {rc=0} 13:06:07.778677 bus /sierra_3: Setting Powered False 13:06:08.877301 bus /sierra_3: Setting Powered False 13:06:09.991695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:06:11.222384 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:11.228082 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:06:11.248166 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:06:11.274607 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:06:11.325566 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:06:11.345917 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:06:11.371656 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:06:11.920008 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:06:11.968318 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:11.979094 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:06:12.035182 tst mo_mt_call.py: using LAC 41098 13:06:12.159429 tst mo_mt_call.py: using RAC 43 13:06:12.277637 tst mo_mt_call.py: using CellId 41098 13:06:12.394475 tst mo_mt_call.py: using BVCI 41099 13:06:12.503516 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.514340 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.524761 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.535191 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.545667 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:12.556620 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:12.672035 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:12.786273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:13.254718 run create_hlr_db(pid=25054): Launched 13:06:13.378357 bus /sierra_2: Setting Powered False 13:06:14.439286 run create_hlr_db(pid=25054): Terminated: ok {rc=0} 13:06:14.881228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25056): Launched 13:06:15.205907 run osmo-hlr_10.42.42.2(pid=25057): Launched 13:06:15.330335 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:15.897801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25059): Launched 13:06:16.265523 run osmo-stp_10.42.42.5(pid=25060): Launched 13:06:16.606529 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:17.204485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25062): Launched 13:06:17.542188 run osmo-msc_10.42.42.6(pid=25063): Launched 13:06:17.723322 run osmo-stp_10.42.42.5(pid=25060): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25060)] 13:06:17.861202 run osmo-stp_10.42.42.5(pid=25060): stdout: | (launched: 2022-12-14_13:06:16.190507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:17.999012 run osmo-stp_10.42.42.5(pid=25060): stderr: | 20221214130616413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130616413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130616414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130616414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130616415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130616415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130616415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:18.137446 run osmo-stp_10.42.42.5(pid=25060): stdout: | (launched: 2022-12-14_13:06:16.190507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:18.267647 run osmo-stp_10.42.42.5(pid=25060): stderr: | 20221214130616413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130616413 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130616414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130616414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130616415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130616415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130616415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:18.423511 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25060): Process ended prematurely: osmo-stp_10.42.42.5(pid=25060) [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25060)] [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:06:18.433130 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:06:18.461066 run osmo-hlr_10.42.42.2(pid=25057): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25057)] 13:06:18.511523 run osmo-hlr_10.42.42.2(pid=25057): stdout: | (launched: 2022-12-14_13:06:15.147161) 13:06:18.563613 run osmo-hlr_10.42.42.2(pid=25057): stderr: | 20221214130615345 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130615345 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130615345 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130615345 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130615345 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130615345 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130615358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130615367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130615367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130615367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:18.636288 run osmo-msc_10.42.42.6(pid=25063): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25063)] 13:06:18.686296 run osmo-msc_10.42.42.6(pid=25063): stdout: | (launched: 2022-12-14_13:06:17.483060) 13:06:18.738635 run osmo-msc_10.42.42.6(pid=25063): stderr: | 20221214130617805 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130617806 DLGLOBAL DEBUG validating counter group 0x7fb1b154ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130617806 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130617806 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130617806 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130617806 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130617808 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130617808 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130617808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130617808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:18.790766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25056): Terminating (SIGTERM) 13:06:18.832796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25059): Terminating (SIGTERM) 13:06:18.874958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25062): Terminating (SIGTERM) 13:06:18.917984 --- ParallelTerminationStrategy: PID 25056 died... 13:06:18.938209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25056): Terminated: ok {rc=0} 13:06:18.985082 --- ParallelTerminationStrategy: PID 25059 died... 13:06:19.005240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25059): Terminated: ok {rc=0} 13:06:19.051900 --- ParallelTerminationStrategy: PID 25062 died... 13:06:19.071968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25062): Terminated: ok {rc=0} 13:06:19.160284 bus /sierra_3: Setting Powered False 13:06:20.258884 bus /sierra_3: Setting Powered False 13:06:21.371345 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:06:22.521436 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:22.533129 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:06:22.591611 tst mo_mt_call_osmux.py: using LAC 41099 13:06:22.717734 tst mo_mt_call_osmux.py: using RAC 44 13:06:22.844446 tst mo_mt_call_osmux.py: using CellId 41099 13:06:22.977102 tst mo_mt_call_osmux.py: using BVCI 41100 13:06:23.095805 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.107140 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.118210 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.129171 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.140410 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:06:23.151819 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:23.266505 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:06:23.381254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:23.849235 run create_hlr_db(pid=25065): Launched 13:06:23.972632 bus /sierra_2: Setting Powered False 13:06:25.033387 run create_hlr_db(pid=25065): Terminated: ok {rc=0} 13:06:25.478040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25067): Launched 13:06:25.803142 run osmo-hlr_10.42.42.2(pid=25068): Launched 13:06:25.927409 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:26.489074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25070): Launched 13:06:26.812162 run osmo-stp_10.42.42.5(pid=25071): Launched 13:06:26.935477 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:27.526945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25073): Launched 13:06:27.853096 run osmo-msc_10.42.42.6(pid=25074): Launched 13:06:28.035061 run osmo-stp_10.42.42.5(pid=25071): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25071)] 13:06:28.173080 run osmo-stp_10.42.42.5(pid=25071): stdout: | (launched: 2022-12-14_13:06:26.753504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:28.311443 run osmo-stp_10.42.42.5(pid=25071): stderr: | 20221214130626949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130626949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130626949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130626950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130626950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130626950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130626950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:28.448920 run osmo-stp_10.42.42.5(pid=25071): stdout: | (launched: 2022-12-14_13:06:26.753504) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:28.579065 run osmo-stp_10.42.42.5(pid=25071): stderr: | 20221214130626949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130626949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130626949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130626950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130626950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130626950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130626950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:28.734627 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25071): Process ended prematurely: osmo-stp_10.42.42.5(pid=25071) [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25071)] [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:06:28.744286 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:06:28.771911 run osmo-hlr_10.42.42.2(pid=25068): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25068)] 13:06:28.822351 run osmo-hlr_10.42.42.2(pid=25068): stdout: | (launched: 2022-12-14_13:06:25.744260) 13:06:28.874264 run osmo-hlr_10.42.42.2(pid=25068): stderr: | 20221214130625944 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130625944 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130625944 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130625944 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130625944 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130625944 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130625956 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130625964 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130625964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130625964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:28.946761 run osmo-msc_10.42.42.6(pid=25074): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25074)] 13:06:28.996572 run osmo-msc_10.42.42.6(pid=25074): stdout: | (launched: 2022-12-14_13:06:27.794008) 13:06:29.048360 run osmo-msc_10.42.42.6(pid=25074): stderr: | 20221214130628116 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130628116 DLGLOBAL DEBUG validating counter group 0x7eff80db9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130628116 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130628116 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130628116 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130628116 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130628118 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130628119 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130628119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130628119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:29.100330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25067): Terminating (SIGTERM) 13:06:29.142198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25070): Terminating (SIGTERM) 13:06:29.184003 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25073): Terminating (SIGTERM) 13:06:29.226397 --- ParallelTerminationStrategy: PID 25067 died... 13:06:29.246774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25067): Terminated: ok {rc=0} 13:06:29.292884 --- ParallelTerminationStrategy: PID 25070 died... 13:06:29.312633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25070): Terminated: ok {rc=0} 13:06:29.358943 --- ParallelTerminationStrategy: PID 25073 died... 13:06:29.378630 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25073): Terminated: ok {rc=0} 13:06:29.466813 bus /sierra_3: Setting Powered False 13:06:30.565316 bus /sierra_3: Setting Powered False 13:06:31.695621 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 emergency:oc2g --------------------------------------------------------------------- 13:06:32.924013 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:32.928600 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 13:06:32.949357 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 13:06:32.976562 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 13:06:33.059897 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 13:06:33.080108 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 13:06:33.106414 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 13:06:33.687155 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2405 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 13:06:33.692276 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:33.702848 tst emergency:oc2g: Using 1 x bts (candidates: 1) 13:06:33.737666 tst emergency_mo_mt_call.py: using LAC 41100 13:06:33.864031 tst emergency_mo_mt_call.py: using RAC 45 13:06:33.982905 tst emergency_mo_mt_call.py: using CellId 41100 13:06:34.101374 tst emergency_mo_mt_call.py: using BVCI 41101 13:06:34.211713 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:34.222752 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:34.233423 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:34.243794 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:34.254169 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:34.264877 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:06:34.376482 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:06:34.494278 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:34.990385 run create_hlr_db(pid=25079): Launched 13:06:35.113754 bus /sierra_2: Setting Powered False 13:06:36.176911 run create_hlr_db(pid=25079): Terminated: ok {rc=0} 13:06:36.602522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25081): Launched 13:06:36.898799 run osmo-hlr_10.42.42.2(pid=25082): Launched 13:06:37.011655 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:37.521862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25084): Launched 13:06:37.818838 run osmo-stp_10.42.42.5(pid=25085): Launched 13:06:37.942528 tst emergency_mo_mt_call.py: using MSISDN 8702 13:06:38.094710 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:38.628795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25087): Launched 13:06:38.925903 run osmo-msc_10.42.42.6(pid=25088): Launched 13:06:39.090916 run osmo-stp_10.42.42.5(pid=25085): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25085)] 13:06:39.215522 run osmo-stp_10.42.42.5(pid=25085): stdout: | (launched: 2022-12-14_13:06:37.764063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:39.340477 run osmo-stp_10.42.42.5(pid=25085): stderr: | 20221214130637933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130637933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130637933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130637933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130637936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130637936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130637936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:39.464524 run osmo-stp_10.42.42.5(pid=25085): stdout: | (launched: 2022-12-14_13:06:37.764063) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:39.583098 run osmo-stp_10.42.42.5(pid=25085): stderr: | 20221214130637933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130637933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130637933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130637933 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130637936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130637936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130637936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:39.725214 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25085): Process ended prematurely: osmo-stp_10.42.42.5(pid=25085) [trial-2405↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25085)] [trial-2405↪emergency:oc2g↪emergency_mo_mt_call.py:19] 13:06:39.733585 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 13:06:39.759604 run osmo-hlr_10.42.42.2(pid=25082): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25082)] 13:06:39.806803 run osmo-hlr_10.42.42.2(pid=25082): stdout: | (launched: 2022-12-14_13:06:36.844076) 13:06:39.855650 run osmo-hlr_10.42.42.2(pid=25082): stderr: | 20221214130637020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130637020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130637020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130637020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130637020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130637020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130637032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130637042 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130637042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130637042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:39.923883 run osmo-msc_10.42.42.6(pid=25088): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25088)] 13:06:39.970974 run osmo-msc_10.42.42.6(pid=25088): stdout: | (launched: 2022-12-14_13:06:38.870988) 13:06:40.019811 run osmo-msc_10.42.42.6(pid=25088): stderr: | 20221214130639142 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130639142 DLGLOBAL DEBUG validating counter group 0x7f67373f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130639142 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130639142 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130639142 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130639142 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130639144 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130639145 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130639145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130639145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:40.069125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25081): Terminating (SIGTERM) 13:06:40.108030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25084): Terminating (SIGTERM) 13:06:40.147348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25087): Terminating (SIGTERM) 13:06:40.187049 --- ParallelTerminationStrategy: PID 25081 died... 13:06:40.205732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25081): Terminated: ok {rc=0} 13:06:40.249599 --- ParallelTerminationStrategy: PID 25084 died... 13:06:40.268318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25084): Terminated: ok {rc=0} 13:06:40.312556 --- ParallelTerminationStrategy: PID 25087 died... 13:06:40.331635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25087): Terminated: ok {rc=0} 13:06:40.417928 bus /sierra_3: Setting Powered False 13:06:41.517036 bus /sierra_3: Setting Powered False 13:06:42.629789 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 13:06:43.715982 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:43.727693 tst emergency:oc2g: Using 1 x bts (candidates: 1) 13:06:43.763872 tst emergency_preemptive_call.py: using LAC 41101 13:06:43.889252 tst emergency_preemptive_call.py: using RAC 46 13:06:44.013239 tst emergency_preemptive_call.py: using CellId 41101 13:06:44.137077 tst emergency_preemptive_call.py: using BVCI 41102 13:06:44.253490 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:44.264339 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:44.275261 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:44.286169 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:44.297920 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 13:06:44.309491 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:06:44.424464 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:06:44.544005 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:06:44.658425 tst emergency:oc2g: Using 1 x modem (candidates: 4) 13:06:44.772644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:06:45.236264 run create_hlr_db(pid=25090): Launched 13:06:45.359000 bus /sierra_2: Setting Powered False 13:06:46.439055 run create_hlr_db(pid=25090): Terminated: ok {rc=0} 13:06:46.965665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25092): Launched 13:06:47.281230 run osmo-hlr_10.42.42.2(pid=25093): Launched 13:06:47.395178 run osmo-stp_10.42.42.5: Starting osmo-stp 13:06:47.923259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25095): Launched 13:06:48.219900 run osmo-stp_10.42.42.5(pid=25096): Launched 13:06:48.340483 tst emergency_preemptive_call.py: using MSISDN 8703 13:06:48.493449 run osmo-msc_10.42.42.6: Starting osmo-msc 13:06:49.024756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25098): Launched 13:06:49.321624 run osmo-msc_10.42.42.6(pid=25099): Launched 13:06:49.486797 run osmo-stp_10.42.42.5(pid=25096): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25096)] 13:06:49.611896 run osmo-stp_10.42.42.5(pid=25096): stdout: | (launched: 2022-12-14_13:06:48.165143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:49.737630 run osmo-stp_10.42.42.5(pid=25096): stderr: | 20221214130648336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130648336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130648336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130648337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130648337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130648338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130648338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:49.861342 run osmo-stp_10.42.42.5(pid=25096): stdout: | (launched: 2022-12-14_13:06:48.165143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:06:49.978973 run osmo-stp_10.42.42.5(pid=25096): stderr: | 20221214130648336 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130648336 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130648336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130648337 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130648337 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130648338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130648338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:06:50.120136 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25096): Process ended prematurely: osmo-stp_10.42.42.5(pid=25096) [trial-2405↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25096)] [trial-2405↪emergency:oc2g↪emergency_preemptive_call.py:32] 13:06:50.128555 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 13:06:50.154581 run osmo-hlr_10.42.42.2(pid=25093): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25093)] 13:06:50.202359 run osmo-hlr_10.42.42.2(pid=25093): stdout: | (launched: 2022-12-14_13:06:47.223019) 13:06:50.251404 run osmo-hlr_10.42.42.2(pid=25093): stderr: | 20221214130647403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130647403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130647403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130647403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130647403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130647403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130647419 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130647428 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130647428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130647428 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:06:50.320228 run osmo-msc_10.42.42.6(pid=25099): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25099)] 13:06:50.368072 run osmo-msc_10.42.42.6(pid=25099): stdout: | (launched: 2022-12-14_13:06:49.266474) 13:06:50.416908 run osmo-msc_10.42.42.6(pid=25099): stderr: | 20221214130649541 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214130649541 DLGLOBAL DEBUG validating counter group 0x7fce2f654c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214130649541 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214130649541 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214130649541 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214130649541 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214130649543 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214130649544 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214130649544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214130649544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:06:50.466248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25092): Terminating (SIGTERM) 13:06:50.505603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25095): Terminating (SIGTERM) 13:06:50.545047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25098): Terminating (SIGTERM) 13:06:50.584780 --- ParallelTerminationStrategy: PID 25092 died... 13:06:50.603934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25092): Terminated: ok {rc=0} 13:06:50.647551 --- ParallelTerminationStrategy: PID 25095 died... 13:06:50.666185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25095): Terminated: ok {rc=0} 13:06:50.709634 --- ParallelTerminationStrategy: PID 25098 died... 13:06:50.728321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25098): Terminated: ok {rc=0} 13:06:50.812224 bus /sierra_9: Setting Powered False 13:06:51.910411 bus /sierra_9: Setting Powered False 13:06:53.028117 bus /sierra_8: Setting Powered False 13:06:54.125955 bus /sierra_8: Setting Powered False 13:06:55.241592 bus /sierra_3: Setting Powered False 13:06:56.341437 bus /sierra_3: Setting Powered False 13:06:57.458077 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:oc2g --------------------------------------------------------------------- 13:06:58.721774 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:06:58.726335 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 13:06:58.747070 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 13:06:58.786537 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 13:06:58.874365 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 13:06:58.895079 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 13:06:58.934257 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 13:06:59.523285 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 13:06:59.576744 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:06:59.587523 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:06:59.622691 tst cs_paging_gprs_active.py: using LAC 41102 13:06:59.750487 tst cs_paging_gprs_active.py: using RAC 47 13:06:59.880090 tst cs_paging_gprs_active.py: using CellId 41102 13:07:00.006546 tst cs_paging_gprs_active.py: using BVCI 41103 13:07:00.127082 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:00.137947 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:00.148522 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:00.159146 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:00.169973 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:00.180785 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:00.191777 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:00.202709 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:00.213883 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:07:00.329582 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:07:00.443897 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:07:00.648533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:00.981846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25105): Launched 13:07:01.329797 run iperf3-srv_10.42.42.10(pid=25106): Launched 13:07:01.455394 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:07:01.662509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:01.979778 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25107): Launched 13:07:02.265807 run iperf3-srv_10.42.42.10(pid=25108): Launched 13:07:02.395436 tst cs_paging_gprs_active.py:38: start network... 13:07:02.617344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:03.122093 run create_hlr_db(pid=25109): Launched 13:07:03.245426 bus /sierra_2: Setting Powered False 13:07:04.309779 run create_hlr_db(pid=25109): Terminated: ok {rc=0} 13:07:04.763245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25111): Launched 13:07:05.088230 run osmo-hlr_10.42.42.2(pid=25112): Launched 13:07:05.219128 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:05.777898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25116): Launched 13:07:06.103658 run osmo-stp_10.42.42.5(pid=25117): Launched 13:07:06.227725 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:06.788465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25119): Launched 13:07:06.913198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:07.188002 run patchelf(pid=25120): Launched 13:07:07.367987 run osmo-stp_10.42.42.5(pid=25117): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25117)] 13:07:07.505798 run osmo-stp_10.42.42.5(pid=25117): stdout: | (launched: 2022-12-14_13:07:06.044412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:07.644482 run osmo-stp_10.42.42.5(pid=25117): stderr: | 20221214130706236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130706236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130706238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130706238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130706239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130706239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130706239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:07.783459 run osmo-stp_10.42.42.5(pid=25117): stdout: | (launched: 2022-12-14_13:07:06.044412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:07.916617 run osmo-stp_10.42.42.5(pid=25117): stderr: | 20221214130706236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130706236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130706238 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130706238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130706239 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130706239 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130706239 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:08.074340 run patchelf(pid=25120): Terminating (SIGINT) 13:07:08.256703 run patchelf(pid=25120): Terminated: ok {rc=0} 13:07:08.389175 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25117): Process ended prematurely: osmo-stp_10.42.42.5(pid=25117) [trial-2405↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25117)] [trial-2405↪gprs:oc2g↪cs_paging_gprs_active.py:38] 13:07:08.399020 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:07:08.427649 run osmo-hlr_10.42.42.2(pid=25112): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25112)] 13:07:08.478640 run osmo-hlr_10.42.42.2(pid=25112): stdout: | (launched: 2022-12-14_13:07:05.029395) 13:07:08.530646 run osmo-hlr_10.42.42.2(pid=25112): stderr: | 20221214130705235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130705235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130705235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130705235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130705235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130705235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130705249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130705257 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130705257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130705257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:08.583380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25105): Terminating (SIGTERM) 13:07:08.624729 run iperf3-srv_10.42.42.10(pid=25106): Terminating (SIGTERM) 13:07:08.666676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25107): Terminating (SIGTERM) 13:07:08.708586 run iperf3-srv_10.42.42.10(pid=25108): Terminating (SIGTERM) 13:07:08.750458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25111): Terminating (SIGTERM) 13:07:08.792195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25116): Terminating (SIGTERM) 13:07:08.834261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25119): Terminating (SIGTERM) 13:07:08.876649 --- ParallelTerminationStrategy: PID 25105 died... 13:07:08.896846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25105): Terminated: ok {rc=0} 13:07:08.943064 --- ParallelTerminationStrategy: PID 25106 died... 13:07:08.962787 run iperf3-srv_10.42.42.10(pid=25106): Terminated {rc=256} 13:07:09.008796 --- ParallelTerminationStrategy: PID 25107 died... 13:07:09.028885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25107): Terminated: ok {rc=0} 13:07:09.075179 --- ParallelTerminationStrategy: PID 25108 died... 13:07:09.094811 run iperf3-srv_10.42.42.10(pid=25108): Terminated {rc=256} 13:07:09.140571 --- ParallelTerminationStrategy: PID 25111 died... 13:07:09.160355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25111): Terminated: ok {rc=0} 13:07:09.206454 --- ParallelTerminationStrategy: PID 25116 died... 13:07:09.226150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25116): Terminated: ok {rc=0} 13:07:09.272229 --- ParallelTerminationStrategy: PID 25119 died... 13:07:09.292012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25119): Terminated: ok {rc=0} 13:07:09.379603 bus /gobi_0: Setting Powered False 13:07:10.476659 bus /gobi_0: Setting Powered False 13:07:11.593128 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g iperf3.py ---------------------------------------------- 13:07:12.734774 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:12.745822 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:07:12.780611 tst iperf3.py: using LAC 41103 13:07:12.900179 tst iperf3.py: using RAC 48 13:07:13.020326 tst iperf3.py: using CellId 41103 13:07:13.141512 tst iperf3.py: using BVCI 41104 13:07:13.251552 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:13.261986 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:13.272207 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:13.282393 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:13.292694 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:13.302795 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:13.312942 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:13.323088 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:13.333432 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:07:13.454301 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:07:13.658673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:13.963129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25121): Launched 13:07:14.228041 run iperf3-srv_10.42.42.10(pid=25122): Launched 13:07:14.341752 tst iperf3.py:8: start network... 13:07:14.545931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:15.014753 run create_hlr_db(pid=25123): Launched 13:07:15.138101 bus /gobi_6: Setting Powered False 13:07:16.230858 run create_hlr_db(pid=25123): Terminated: ok {rc=0} 13:07:16.733766 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25125): Launched 13:07:17.065903 run osmo-hlr_10.42.42.2(pid=25126): Launched 13:07:17.256483 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:17.779923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25128): Launched 13:07:18.082625 run osmo-stp_10.42.42.5(pid=25129): Launched 13:07:18.197945 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:18.720940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25131): Launched 13:07:18.837228 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:19.092570 run patchelf(pid=25132): Launched 13:07:19.260819 run osmo-stp_10.42.42.5(pid=25129): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25129)] 13:07:19.388484 run osmo-stp_10.42.42.5(pid=25129): stdout: | (launched: 2022-12-14_13:07:18.027233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:19.517776 run osmo-stp_10.42.42.5(pid=25129): stderr: | 20221214130718195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130718195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130718195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130718196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130718198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130718198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130718199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:19.647724 run osmo-stp_10.42.42.5(pid=25129): stdout: | (launched: 2022-12-14_13:07:18.027233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:19.771432 run osmo-stp_10.42.42.5(pid=25129): stderr: | 20221214130718195 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130718195 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130718195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130718196 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130718198 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130718198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130718199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:19.918659 run patchelf(pid=25132): Terminating (SIGINT) 13:07:20.087928 run patchelf(pid=25132): Terminated: ok {rc=0} 13:07:20.210195 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25129): Process ended prematurely: osmo-stp_10.42.42.5(pid=25129) [trial-2405↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25129)] [trial-2405↪gprs:oc2g↪iperf3.py:8] 13:07:20.219741 tst iperf3.py:8: Test FAILED (7.5 sec) 13:07:20.246681 run osmo-hlr_10.42.42.2(pid=25126): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25126)] 13:07:20.294078 run osmo-hlr_10.42.42.2(pid=25126): stdout: | (launched: 2022-12-14_13:07:16.995070) 13:07:20.342710 run osmo-hlr_10.42.42.2(pid=25126): stderr: | 20221214130717267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130717267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130717267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130717267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130717267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130717267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130717280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130717288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130717288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130717288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:20.392082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25121): Terminating (SIGTERM) 13:07:20.431453 run iperf3-srv_10.42.42.10(pid=25122): Terminating (SIGTERM) 13:07:20.470538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25125): Terminating (SIGTERM) 13:07:20.510059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25128): Terminating (SIGTERM) 13:07:20.549346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25131): Terminating (SIGTERM) 13:07:20.589726 --- ParallelTerminationStrategy: PID 25121 died... 13:07:20.609085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25121): Terminated: ok {rc=0} 13:07:20.652590 --- ParallelTerminationStrategy: PID 25122 died... 13:07:20.671156 run iperf3-srv_10.42.42.10(pid=25122): Terminated {rc=256} 13:07:20.714632 --- ParallelTerminationStrategy: PID 25125 died... 13:07:20.733280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25125): Terminated: ok {rc=0} 13:07:20.776645 --- ParallelTerminationStrategy: PID 25128 died... 13:07:20.795079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25128): Terminated: ok {rc=0} 13:07:20.838564 --- ParallelTerminationStrategy: PID 25131 died... 13:07:20.857217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25131): Terminated: ok {rc=0} 13:07:20.942048 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g iperf3m4.py ---------------------------------------------- 13:07:22.087912 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:22.099178 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:07:22.136421 tst iperf3m4.py: using LAC 41104 13:07:22.265689 tst iperf3m4.py: using RAC 49 13:07:22.392523 tst iperf3m4.py: using CellId 41104 13:07:22.521701 tst iperf3m4.py: using BVCI 41105 13:07:22.642049 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:22.653085 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:22.664083 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:22.674810 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:22.685776 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:22.696685 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:22.707821 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:22.718803 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:22.729980 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:07:22.846434 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:07:22.969443 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:07:23.084164 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:07:23.196747 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:07:23.401143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:23.707269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25133): Launched 13:07:23.971534 run iperf3-srv_10.42.42.10(pid=25134): Launched 13:07:24.084803 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:07:24.288369 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:24.592619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25135): Launched 13:07:24.856547 run iperf3-srv_10.42.42.10(pid=25136): Launched 13:07:24.969514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:07:25.171210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:25.473793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25137): Launched 13:07:25.737112 run iperf3-srv_10.42.42.10(pid=25138): Launched 13:07:25.849988 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:07:26.051408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:07:26.354008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25139): Launched 13:07:26.617092 run iperf3-srv_10.42.42.10(pid=25140): Launched 13:07:26.731032 tst iperf3m4.py:8: start network... 13:07:26.932080 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:27.398753 run create_hlr_db(pid=25141): Launched 13:07:27.523690 bus /gobi_6: Setting Powered False 13:07:28.585453 run create_hlr_db(pid=25141): Terminated: ok {rc=0} 13:07:29.029559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25143): Launched 13:07:29.354649 run osmo-hlr_10.42.42.2(pid=25144): Launched 13:07:29.478900 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:30.038864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25146): Launched 13:07:30.364358 run osmo-stp_10.42.42.5(pid=25147): Launched 13:07:30.489083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:31.070558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25149): Launched 13:07:31.201331 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:31.476133 run patchelf(pid=25150): Launched 13:07:31.659084 run osmo-stp_10.42.42.5(pid=25147): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25147)] 13:07:31.790289 run osmo-stp_10.42.42.5(pid=25147): stdout: | (launched: 2022-12-14_13:07:30.305114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:31.924049 run osmo-stp_10.42.42.5(pid=25147): stderr: | 20221214130730499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130730499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130730499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130730500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130730500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130730500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130730500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:32.058400 run osmo-stp_10.42.42.5(pid=25147): stdout: | (launched: 2022-12-14_13:07:30.305114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:32.184608 run osmo-stp_10.42.42.5(pid=25147): stderr: | 20221214130730499 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130730499 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130730499 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130730500 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130730500 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130730500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130730500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:32.332599 run patchelf(pid=25150): Terminating (SIGINT) 13:07:32.503907 run patchelf(pid=25150): Terminated: ok {rc=0} 13:07:32.627025 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25147): Process ended prematurely: osmo-stp_10.42.42.5(pid=25147) [trial-2405↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25147)] [trial-2405↪gprs:oc2g↪iperf3m4.py:8] 13:07:32.636373 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:07:32.664479 run osmo-hlr_10.42.42.2(pid=25144): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25144)] 13:07:32.712867 run osmo-hlr_10.42.42.2(pid=25144): stdout: | (launched: 2022-12-14_13:07:29.295485) 13:07:32.762782 run osmo-hlr_10.42.42.2(pid=25144): stderr: | 20221214130729494 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130729494 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130729494 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130729495 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130729495 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130729495 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130729507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130729515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130729515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130729515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:32.813088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25133): Terminating (SIGTERM) 13:07:32.853127 run iperf3-srv_10.42.42.10(pid=25134): Terminating (SIGTERM) 13:07:32.892603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25135): Terminating (SIGTERM) 13:07:32.932058 run iperf3-srv_10.42.42.10(pid=25136): Terminating (SIGTERM) 13:07:32.971447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25137): Terminating (SIGTERM) 13:07:33.011155 run iperf3-srv_10.42.42.10(pid=25138): Terminating (SIGTERM) 13:07:33.050701 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25139): Terminating (SIGTERM) 13:07:33.090291 run iperf3-srv_10.42.42.10(pid=25140): Terminating (SIGTERM) 13:07:33.129735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25143): Terminating (SIGTERM) 13:07:33.169696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25146): Terminating (SIGTERM) 13:07:33.209569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25149): Terminating (SIGTERM) 13:07:33.249571 --- ParallelTerminationStrategy: PID 25133 died... 13:07:33.268264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25133): Terminated: ok {rc=0} 13:07:33.312395 --- ParallelTerminationStrategy: PID 25134 died... 13:07:33.331256 run iperf3-srv_10.42.42.10(pid=25134): Terminated {rc=256} 13:07:33.375004 --- ParallelTerminationStrategy: PID 25135 died... 13:07:33.393709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25135): Terminated: ok {rc=0} 13:07:33.437477 --- ParallelTerminationStrategy: PID 25136 died... 13:07:33.456419 run iperf3-srv_10.42.42.10(pid=25136): Terminated {rc=256} 13:07:33.499800 --- ParallelTerminationStrategy: PID 25137 died... 13:07:33.518518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25137): Terminated: ok {rc=0} 13:07:33.562237 --- ParallelTerminationStrategy: PID 25138 died... 13:07:33.580775 run iperf3-srv_10.42.42.10(pid=25138): Terminated {rc=256} 13:07:33.624884 --- ParallelTerminationStrategy: PID 25139 died... 13:07:33.643956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25139): Terminated: ok {rc=0} 13:07:33.687767 --- ParallelTerminationStrategy: PID 25140 died... 13:07:33.706669 run iperf3-srv_10.42.42.10(pid=25140): Terminated {rc=256} 13:07:33.750486 --- ParallelTerminationStrategy: PID 25143 died... 13:07:33.769241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25143): Terminated: ok {rc=0} 13:07:33.813194 --- ParallelTerminationStrategy: PID 25146 died... 13:07:33.831747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25146): Terminated: ok {rc=0} 13:07:33.875820 --- ParallelTerminationStrategy: PID 25149 died... 13:07:33.894592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25149): Terminated: ok {rc=0} 13:07:33.979549 bus /gobi_4: Setting Powered False 13:07:35.078697 bus /gobi_4: Setting Powered False 13:07:36.192646 bus /gobi_1: Setting Powered False 13:07:37.290674 bus /gobi_1: Setting Powered False 13:07:38.400385 bus /gobi_0: Setting Powered False 13:07:39.497499 bus /gobi_0: Setting Powered False 13:07:40.613421 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g ping.py ---------------------------------------------- 13:07:41.714344 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:41.725700 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:07:41.761349 tst ping.py: using LAC 41105 13:07:41.887090 tst ping.py: using RAC 50 13:07:42.013772 tst ping.py: using CellId 41105 13:07:42.134094 tst ping.py: using BVCI 41106 13:07:42.243261 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:42.253994 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:42.264448 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:42.275240 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:42.285583 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:42.297480 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:42.308434 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:42.319271 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:07:42.433807 tst ping.py:19: start network... 13:07:42.633932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:43.094413 run create_hlr_db(pid=25151): Launched 13:07:43.216237 bus /gobi_6: Setting Powered False 13:07:44.275952 run create_hlr_db(pid=25151): Terminated: ok {rc=0} 13:07:44.712211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25153): Launched 13:07:45.033054 run osmo-hlr_10.42.42.2(pid=25154): Launched 13:07:45.156093 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:45.711226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25156): Launched 13:07:46.068594 run osmo-stp_10.42.42.5(pid=25157): Launched 13:07:46.299931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:46.942787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25159): Launched 13:07:47.073888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:47.349649 run patchelf(pid=25160): Launched 13:07:47.528706 run osmo-stp_10.42.42.5(pid=25157): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25157)] 13:07:47.663853 run osmo-stp_10.42.42.5(pid=25157): stdout: | (launched: 2022-12-14_13:07:46.004785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:47.800844 run osmo-stp_10.42.42.5(pid=25157): stderr: | 20221214130746314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130746314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130746315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130746315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130746316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130746316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130746316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:47.938114 run osmo-stp_10.42.42.5(pid=25157): stdout: | (launched: 2022-12-14_13:07:46.004785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:48.069525 run osmo-stp_10.42.42.5(pid=25157): stderr: | 20221214130746314 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130746314 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130746315 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130746315 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130746316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130746316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130746316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:48.225452 run patchelf(pid=25160): Terminating (SIGINT) 13:07:48.405107 run patchelf(pid=25160): Terminated: ok {rc=0} 13:07:48.534313 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25157): Process ended prematurely: osmo-stp_10.42.42.5(pid=25157) [trial-2405↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25157)] [trial-2405↪gprs:oc2g↪ping.py:22] 13:07:48.543620 tst ping.py:22: Test FAILED (6.8 sec) 13:07:48.571903 run osmo-hlr_10.42.42.2(pid=25154): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25154)] 13:07:48.622989 run osmo-hlr_10.42.42.2(pid=25154): stdout: | (launched: 2022-12-14_13:07:44.974504) 13:07:48.675303 run osmo-hlr_10.42.42.2(pid=25154): stderr: | 20221214130745173 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130745173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130745173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130745173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130745173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130745173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130745185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130745193 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130745193 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130745193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:48.727787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25153): Terminating (SIGTERM) 13:07:48.769829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25156): Terminating (SIGTERM) 13:07:48.812136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25159): Terminating (SIGTERM) 13:07:48.854887 --- ParallelTerminationStrategy: PID 25153 died... 13:07:48.875594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25153): Terminated: ok {rc=0} 13:07:48.922341 --- ParallelTerminationStrategy: PID 25156 died... 13:07:48.942500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25156): Terminated: ok {rc=0} 13:07:48.989290 --- ParallelTerminationStrategy: PID 25159 died... 13:07:49.009399 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25159): Terminated: ok {rc=0} 13:07:49.098266 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 13:07:50.188266 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:50.199617 tst gprs:oc2g: Using 1 x bts (candidates: 1) 13:07:50.233486 tst ping_idle_ping.py: using LAC 41106 13:07:50.358968 tst ping_idle_ping.py: using RAC 51 13:07:50.488025 tst ping_idle_ping.py: using CellId 41106 13:07:50.611911 tst ping_idle_ping.py: using BVCI 41107 13:07:50.729991 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:50.741292 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:50.752158 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:50.763077 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:50.774235 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:50.785630 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:50.796825 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 13:07:50.808001 tst gprs:oc2g: Using 1 x modem (candidates: 4) 13:07:50.927079 tst ping_idle_ping.py:24: start network... 13:07:51.144069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:07:51.645314 run create_hlr_db(pid=25161): Launched 13:07:51.767422 bus /gobi_6: Setting Powered False 13:07:52.830735 run create_hlr_db(pid=25161): Terminated: ok {rc=0} 13:07:53.259510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25163): Launched 13:07:53.558450 run osmo-hlr_10.42.42.2(pid=25164): Launched 13:07:53.671780 run osmo-stp_10.42.42.5: Starting osmo-stp 13:07:54.202323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25166): Launched 13:07:54.501631 run osmo-stp_10.42.42.5(pid=25167): Launched 13:07:54.615933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:07:55.130274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25169): Launched 13:07:55.243543 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:07:55.495454 run patchelf(pid=25170): Launched 13:07:55.660758 run osmo-stp_10.42.42.5(pid=25167): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25167)] 13:07:55.786747 run osmo-stp_10.42.42.5(pid=25167): stdout: | (launched: 2022-12-14_13:07:54.446332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:55.914322 run osmo-stp_10.42.42.5(pid=25167): stderr: | 20221214130754615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130754615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130754615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130754616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130754616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130754616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130754616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:56.041669 run osmo-stp_10.42.42.5(pid=25167): stdout: | (launched: 2022-12-14_13:07:54.446332) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:07:56.163820 run osmo-stp_10.42.42.5(pid=25167): stderr: | 20221214130754615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130754615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130754615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130754616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130754616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130754616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130754616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:07:56.308471 run patchelf(pid=25170): Terminating (SIGINT) 13:07:56.475969 run patchelf(pid=25170): Terminated: ok {rc=0} 13:07:56.596109 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25167): Process ended prematurely: osmo-stp_10.42.42.5(pid=25167) [trial-2405↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25167)] [trial-2405↪gprs:oc2g↪ping_idle_ping.py:27] 13:07:56.604861 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:07:56.631479 run osmo-hlr_10.42.42.2(pid=25164): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25164)] 13:07:56.678671 run osmo-hlr_10.42.42.2(pid=25164): stdout: | (launched: 2022-12-14_13:07:53.502708) 13:07:56.727619 run osmo-hlr_10.42.42.2(pid=25164): stderr: | 20221214130753680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130753681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130753681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130753681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130753681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130753681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130753692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130753703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130753703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130753703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:07:56.777179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25163): Terminating (SIGTERM) 13:07:56.816586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25166): Terminating (SIGTERM) 13:07:56.855999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25169): Terminating (SIGTERM) 13:07:56.896206 --- ParallelTerminationStrategy: PID 25163 died... 13:07:56.915523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25163): Terminated: ok {rc=0} 13:07:56.959573 --- ParallelTerminationStrategy: PID 25166 died... 13:07:56.978424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25166): Terminated: ok {rc=0} 13:07:57.022401 --- ParallelTerminationStrategy: PID 25169 died... 13:07:57.041236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25169): Terminated: ok {rc=0} 13:07:57.127428 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 13:07:58.416375 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:07:58.421531 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:07:58.441657 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:07:58.479381 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:07:58.564596 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:07:58.584549 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:07:58.621959 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:07:59.217121 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:07:59.271014 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:07:59.282095 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:07:59.318524 tst cs_paging_gprs_active.py: using LAC 41107 13:07:59.444128 tst cs_paging_gprs_active.py: using RAC 52 13:07:59.568385 tst cs_paging_gprs_active.py: using CellId 41107 13:07:59.692910 tst cs_paging_gprs_active.py: using BVCI 41108 13:07:59.808911 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:07:59.819988 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:07:59.830917 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:07:59.841740 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:07:59.852674 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:07:59.863695 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:07:59.874919 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:07:59.885984 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:07:59.897137 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:00.013360 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:00.131247 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:08:00.350617 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:00.673552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25174): Launched 13:08:00.970594 run iperf3-srv_10.42.42.10(pid=25175): Launched 13:08:01.096934 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:08:01.318350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:01.648810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25176): Launched 13:08:01.956131 run iperf3-srv_10.42.42.10(pid=25177): Launched 13:08:02.112720 tst cs_paging_gprs_active.py:38: start network... 13:08:02.317477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:02.782286 run create_hlr_db(pid=25178): Launched 13:08:02.904727 bus /gobi_6: Setting Powered False 13:08:03.965257 run create_hlr_db(pid=25178): Terminated: ok {rc=0} 13:08:04.402615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25180): Launched 13:08:04.723422 run osmo-hlr_10.42.42.2(pid=25181): Launched 13:08:04.845837 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:05.396262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25183): Launched 13:08:05.717211 run osmo-stp_10.42.42.5(pid=25184): Launched 13:08:05.839827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:06.392807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25186): Launched 13:08:06.515831 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:06.786052 run patchelf(pid=25187): Launched 13:08:06.963634 run osmo-stp_10.42.42.5(pid=25184): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25184)] 13:08:07.099767 run osmo-stp_10.42.42.5(pid=25184): stdout: | (launched: 2022-12-14_13:08:05.658839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:07.237622 run osmo-stp_10.42.42.5(pid=25184): stderr: | 20221214130805850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130805850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130805851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130805851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130805852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130805852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130805852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:07.375045 run osmo-stp_10.42.42.5(pid=25184): stdout: | (launched: 2022-12-14_13:08:05.658839) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:07.507219 run osmo-stp_10.42.42.5(pid=25184): stderr: | 20221214130805850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130805850 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130805851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130805851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130805852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130805852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130805852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:07.663318 run patchelf(pid=25187): Terminating (SIGINT) 13:08:07.842133 run patchelf(pid=25187): Terminated: ok {rc=0} 13:08:07.971264 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25184): Process ended prematurely: osmo-stp_10.42.42.5(pid=25184) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25184)] [trial-2405↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:08:07.981391 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:08:08.009659 run osmo-hlr_10.42.42.2(pid=25181): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25181)] 13:08:08.060257 run osmo-hlr_10.42.42.2(pid=25181): stdout: | (launched: 2022-12-14_13:08:04.665693) 13:08:08.112245 run osmo-hlr_10.42.42.2(pid=25181): stderr: | 20221214130804862 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130804862 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130804862 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130804862 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130804862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130804862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130804875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130804883 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130804883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130804883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:08.165158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25174): Terminating (SIGTERM) 13:08:08.207006 run iperf3-srv_10.42.42.10(pid=25175): Terminating (SIGTERM) 13:08:08.249354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25176): Terminating (SIGTERM) 13:08:08.291649 run iperf3-srv_10.42.42.10(pid=25177): Terminating (SIGTERM) 13:08:08.333603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25180): Terminating (SIGTERM) 13:08:08.375688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25183): Terminating (SIGTERM) 13:08:08.418418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25186): Terminating (SIGTERM) 13:08:08.460606 --- ParallelTerminationStrategy: PID 25174 died... 13:08:08.480865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25174): Terminated: ok {rc=0} 13:08:08.527232 --- ParallelTerminationStrategy: PID 25175 died... 13:08:08.546789 run iperf3-srv_10.42.42.10(pid=25175): Terminated {rc=256} 13:08:08.592584 --- ParallelTerminationStrategy: PID 25176 died... 13:08:08.612175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25176): Terminated: ok {rc=0} 13:08:08.658079 --- ParallelTerminationStrategy: PID 25177 died... 13:08:08.677673 run iperf3-srv_10.42.42.10(pid=25177): Terminated {rc=256} 13:08:08.723504 --- ParallelTerminationStrategy: PID 25180 died... 13:08:08.743135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25180): Terminated: ok {rc=0} 13:08:08.788795 --- ParallelTerminationStrategy: PID 25183 died... 13:08:08.808807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25183): Terminated: ok {rc=0} 13:08:08.854201 --- ParallelTerminationStrategy: PID 25186 died... 13:08:08.873872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25186): Terminated: ok {rc=0} 13:08:08.961624 bus /gobi_0: Setting Powered False 13:08:10.059387 bus /gobi_0: Setting Powered False 13:08:11.175484 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:08:12.319198 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:12.330726 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:08:12.367544 tst iperf3.py: using LAC 41108 13:08:12.486913 tst iperf3.py: using RAC 53 13:08:12.606068 tst iperf3.py: using CellId 41108 13:08:12.725168 tst iperf3.py: using BVCI 41109 13:08:12.832496 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:12.843150 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:12.853644 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:12.864074 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:12.874392 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:12.884607 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:12.895037 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:12.905377 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:12.915878 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:13.031602 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:08:13.231707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:13.530756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25188): Launched 13:08:13.789106 run iperf3-srv_10.42.42.10(pid=25189): Launched 13:08:13.900355 tst iperf3.py:8: start network... 13:08:14.098658 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:14.557552 run create_hlr_db(pid=25190): Launched 13:08:14.679381 bus /gobi_6: Setting Powered False 13:08:15.738358 run create_hlr_db(pid=25190): Terminated: ok {rc=0} 13:08:16.179292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25192): Launched 13:08:16.491532 run osmo-hlr_10.42.42.2(pid=25193): Launched 13:08:16.771070 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:17.454482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25195): Launched 13:08:17.775548 run osmo-stp_10.42.42.5(pid=25196): Launched 13:08:17.897838 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:18.448327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25198): Launched 13:08:18.570740 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:18.840491 run patchelf(pid=25199): Launched 13:08:19.017981 run osmo-stp_10.42.42.5(pid=25196): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25196)] 13:08:19.153983 run osmo-stp_10.42.42.5(pid=25196): stdout: | (launched: 2022-12-14_13:08:17.718093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:19.291298 run osmo-stp_10.42.42.5(pid=25196): stderr: | 20221214130817911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130817911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130817911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130817911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130817912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130817912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130817912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:19.429406 run osmo-stp_10.42.42.5(pid=25196): stdout: | (launched: 2022-12-14_13:08:17.718093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:19.561193 run osmo-stp_10.42.42.5(pid=25196): stderr: | 20221214130817911 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130817911 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130817911 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130817911 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130817912 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130817912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130817912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:19.717178 run patchelf(pid=25199): Terminating (SIGINT) 13:08:19.895831 run patchelf(pid=25199): Terminated: ok {rc=0} 13:08:20.025129 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25196): Process ended prematurely: osmo-stp_10.42.42.5(pid=25196) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25196)] [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 13:08:20.035270 tst iperf3.py:8: Test FAILED (7.8 sec) 13:08:20.063404 run osmo-hlr_10.42.42.2(pid=25193): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25193)] 13:08:20.114052 run osmo-hlr_10.42.42.2(pid=25193): stdout: | (launched: 2022-12-14_13:08:16.428604) 13:08:20.165948 run osmo-hlr_10.42.42.2(pid=25193): stderr: | 20221214130816660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130816660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130816660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130816660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130816660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130816660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130816697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130816715 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130816715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130816715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:20.218466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25188): Terminating (SIGTERM) 13:08:20.260195 run iperf3-srv_10.42.42.10(pid=25189): Terminating (SIGTERM) 13:08:20.304182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25192): Terminating (SIGTERM) 13:08:20.346924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25195): Terminating (SIGTERM) 13:08:20.389364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25198): Terminating (SIGTERM) 13:08:20.431920 --- ParallelTerminationStrategy: PID 25188 died... 13:08:20.452023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25188): Terminated: ok {rc=0} 13:08:20.498321 --- ParallelTerminationStrategy: PID 25189 died... 13:08:20.517817 run iperf3-srv_10.42.42.10(pid=25189): Terminated {rc=256} 13:08:20.563808 --- ParallelTerminationStrategy: PID 25192 died... 13:08:20.583385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25192): Terminated: ok {rc=0} 13:08:20.629372 --- ParallelTerminationStrategy: PID 25195 died... 13:08:20.649161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25195): Terminated: ok {rc=0} 13:08:20.695404 --- ParallelTerminationStrategy: PID 25198 died... 13:08:20.715140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25198): Terminated: ok {rc=0} 13:08:20.803276 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:08:21.952537 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:21.964324 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:08:22.000816 tst iperf3m4.py: using LAC 41109 13:08:22.126189 tst iperf3m4.py: using RAC 54 13:08:22.253589 tst iperf3m4.py: using CellId 41109 13:08:22.372221 tst iperf3m4.py: using BVCI 41110 13:08:22.482062 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:22.492852 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:22.503472 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:22.513915 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:22.524173 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:22.534484 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:22.545625 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:22.556451 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:22.567690 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:22.688636 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:22.803726 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:22.925164 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:23.043727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:08:23.245673 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:23.546629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25200): Launched 13:08:23.805656 run iperf3-srv_10.42.42.10(pid=25201): Launched 13:08:23.917205 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:08:24.116670 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:24.415753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25202): Launched 13:08:24.675183 run iperf3-srv_10.42.42.10(pid=25203): Launched 13:08:24.786587 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:08:24.985406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:25.285257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25204): Launched 13:08:25.544361 run iperf3-srv_10.42.42.10(pid=25205): Launched 13:08:25.655413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:08:25.854466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:08:26.153276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25206): Launched 13:08:26.413079 run iperf3-srv_10.42.42.10(pid=25207): Launched 13:08:26.524629 tst iperf3m4.py:8: start network... 13:08:26.724078 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:27.186816 run create_hlr_db(pid=25208): Launched 13:08:27.308835 bus /gobi_6: Setting Powered False 13:08:28.369135 run create_hlr_db(pid=25208): Terminated: ok {rc=0} 13:08:28.785283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25210): Launched 13:08:29.083706 run osmo-hlr_10.42.42.2(pid=25211): Launched 13:08:29.198014 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:29.709663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25213): Launched 13:08:30.007017 run osmo-stp_10.42.42.5(pid=25214): Launched 13:08:30.119904 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:30.633011 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25216): Launched 13:08:30.748336 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:31.033834 run patchelf(pid=25217): Launched 13:08:31.213538 run osmo-stp_10.42.42.5(pid=25214): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25214)] 13:08:31.342567 run osmo-stp_10.42.42.5(pid=25214): stdout: | (launched: 2022-12-14_13:08:29.952301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:31.473609 run osmo-stp_10.42.42.5(pid=25214): stderr: | 20221214130830123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130830123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130830123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130830124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130830124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130830124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130830125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:31.605899 run osmo-stp_10.42.42.5(pid=25214): stdout: | (launched: 2022-12-14_13:08:29.952301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:31.730971 run osmo-stp_10.42.42.5(pid=25214): stderr: | 20221214130830123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130830123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130830123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130830124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130830124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130830124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130830125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:31.879501 run patchelf(pid=25217): Terminating (SIGINT) 13:08:32.051431 run patchelf(pid=25217): Terminated: ok {rc=0} 13:08:32.175935 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25214): Process ended prematurely: osmo-stp_10.42.42.5(pid=25214) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25214)] [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 13:08:32.186167 tst iperf3m4.py:8: Test FAILED (10.3 sec) 13:08:32.213973 run osmo-hlr_10.42.42.2(pid=25211): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25211)] 13:08:32.261610 run osmo-hlr_10.42.42.2(pid=25211): stdout: | (launched: 2022-12-14_13:08:29.028886) 13:08:32.310758 run osmo-hlr_10.42.42.2(pid=25211): stderr: | 20221214130829202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130829202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130829202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130829202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130829202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130829203 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130829215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130829224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130829224 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130829224 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:32.360306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25200): Terminating (SIGTERM) 13:08:32.399804 run iperf3-srv_10.42.42.10(pid=25201): Terminating (SIGTERM) 13:08:32.439233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25202): Terminating (SIGTERM) 13:08:32.478736 run iperf3-srv_10.42.42.10(pid=25203): Terminating (SIGTERM) 13:08:32.518051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25204): Terminating (SIGTERM) 13:08:32.557539 run iperf3-srv_10.42.42.10(pid=25205): Terminating (SIGTERM) 13:08:32.596702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25206): Terminating (SIGTERM) 13:08:32.636074 run iperf3-srv_10.42.42.10(pid=25207): Terminating (SIGTERM) 13:08:32.675503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25210): Terminating (SIGTERM) 13:08:32.714919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25213): Terminating (SIGTERM) 13:08:32.754319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25216): Terminating (SIGTERM) 13:08:32.793853 --- ParallelTerminationStrategy: PID 25200 died... 13:08:32.812888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25200): Terminated: ok {rc=0} 13:08:32.856858 --- ParallelTerminationStrategy: PID 25201 died... 13:08:32.875351 run iperf3-srv_10.42.42.10(pid=25201): Terminated {rc=256} 13:08:32.919257 --- ParallelTerminationStrategy: PID 25202 died... 13:08:32.937926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25202): Terminated: ok {rc=0} 13:08:32.981695 --- ParallelTerminationStrategy: PID 25203 died... 13:08:33.000190 run iperf3-srv_10.42.42.10(pid=25203): Terminated {rc=256} 13:08:33.043710 --- ParallelTerminationStrategy: PID 25204 died... 13:08:33.062417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25204): Terminated: ok {rc=0} 13:08:33.106361 --- ParallelTerminationStrategy: PID 25205 died... 13:08:33.124937 run iperf3-srv_10.42.42.10(pid=25205): Terminated {rc=256} 13:08:33.169078 --- ParallelTerminationStrategy: PID 25206 died... 13:08:33.187787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25206): Terminated: ok {rc=0} 13:08:33.231751 --- ParallelTerminationStrategy: PID 25207 died... 13:08:33.250520 run iperf3-srv_10.42.42.10(pid=25207): Terminated {rc=256} 13:08:33.294284 --- ParallelTerminationStrategy: PID 25210 died... 13:08:33.312897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25210): Terminated: ok {rc=0} 13:08:33.356688 --- ParallelTerminationStrategy: PID 25213 died... 13:08:33.375336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25213): Terminated: ok {rc=0} 13:08:33.419185 --- ParallelTerminationStrategy: PID 25216 died... 13:08:33.437896 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25216): Terminated: ok {rc=0} 13:08:33.523433 bus /gobi_4: Setting Powered False 13:08:34.622921 bus /gobi_4: Setting Powered False 13:08:35.736772 bus /gobi_1: Setting Powered False 13:08:36.834750 bus /gobi_1: Setting Powered False 13:08:37.949747 bus /gobi_0: Setting Powered False 13:08:39.047424 bus /gobi_0: Setting Powered False 13:08:40.160731 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 13:08:41.262815 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:41.274614 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:08:41.313255 tst ping.py: using LAC 41110 13:08:41.428568 tst ping.py: using RAC 55 13:08:41.543511 tst ping.py: using CellId 41110 13:08:41.660349 tst ping.py: using BVCI 41111 13:08:41.766615 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:41.777474 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:41.787868 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:41.798439 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:41.808723 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:41.819042 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:41.829548 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:41.840421 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:41.956551 tst ping.py:19: start network... 13:08:42.168002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:42.654296 run create_hlr_db(pid=25218): Launched 13:08:42.774623 bus /gobi_6: Setting Powered False 13:08:43.836768 run create_hlr_db(pid=25218): Terminated: ok {rc=0} 13:08:44.256438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25220): Launched 13:08:44.550433 run osmo-hlr_10.42.42.2(pid=25221): Launched 13:08:44.661708 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:45.167153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25223): Launched 13:08:45.461991 run osmo-stp_10.42.42.5(pid=25224): Launched 13:08:45.573104 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:46.108378 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25226): Launched 13:08:46.233251 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:46.492551 run patchelf(pid=25227): Launched 13:08:46.734929 run osmo-stp_10.42.42.5(pid=25224): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25224)] 13:08:46.915661 run osmo-stp_10.42.42.5(pid=25224): stdout: | (launched: 2022-12-14_13:08:45.407642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:47.062979 run osmo-stp_10.42.42.5(pid=25224): stderr: | 20221214130845578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130845579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130845579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130845579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130845580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130845580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130845580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:47.196674 run osmo-stp_10.42.42.5(pid=25224): stdout: | (launched: 2022-12-14_13:08:45.407642) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:47.320120 run osmo-stp_10.42.42.5(pid=25224): stderr: | 20221214130845578 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130845579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130845579 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130845579 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130845580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130845580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130845580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:47.463572 run patchelf(pid=25227): Terminating (SIGINT) 13:08:47.629545 run patchelf(pid=25227): Terminated: ok {rc=0} 13:08:47.748831 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25224): Process ended prematurely: osmo-stp_10.42.42.5(pid=25224) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25224)] [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 13:08:47.757985 tst ping.py:22: Test FAILED (6.5 sec) 13:08:47.784646 run osmo-hlr_10.42.42.2(pid=25221): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25221)] 13:08:47.832835 run osmo-hlr_10.42.42.2(pid=25221): stdout: | (launched: 2022-12-14_13:08:44.496253) 13:08:47.882284 run osmo-hlr_10.42.42.2(pid=25221): stderr: | 20221214130844674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130844674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130844674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130844674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130844674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130844674 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130844687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130844696 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130844696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130844696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:47.931976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25220): Terminating (SIGTERM) 13:08:47.972181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25223): Terminating (SIGTERM) 13:08:48.012182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25226): Terminating (SIGTERM) 13:08:48.052434 --- ParallelTerminationStrategy: PID 25220 died... 13:08:48.071904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25220): Terminated: ok {rc=0} 13:08:48.116258 --- ParallelTerminationStrategy: PID 25223 died... 13:08:48.135130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25223): Terminated: ok {rc=0} 13:08:48.179265 --- ParallelTerminationStrategy: PID 25226 died... 13:08:48.198172 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25226): Terminated: ok {rc=0} 13:08:48.283729 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:08:49.371943 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:49.383276 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:08:49.421248 tst ping_idle_ping.py: using LAC 41111 13:08:49.545972 tst ping_idle_ping.py: using RAC 56 13:08:49.675167 tst ping_idle_ping.py: using CellId 41111 13:08:49.798888 tst ping_idle_ping.py: using BVCI 41112 13:08:49.915200 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:49.926323 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:49.937271 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:49.948143 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:49.959232 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:49.970372 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:49.981668 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:08:49.992832 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:08:50.107096 tst ping_idle_ping.py:24: start network... 13:08:50.305274 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:08:50.766108 run create_hlr_db(pid=25228): Launched 13:08:50.887976 bus /gobi_6: Setting Powered False 13:08:51.947391 run create_hlr_db(pid=25228): Terminated: ok {rc=0} 13:08:52.379185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25230): Launched 13:08:52.696713 run osmo-hlr_10.42.42.2(pid=25231): Launched 13:08:52.818080 run osmo-stp_10.42.42.5: Starting osmo-stp 13:08:53.366174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25233): Launched 13:08:53.682659 run osmo-stp_10.42.42.5(pid=25234): Launched 13:08:53.803213 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:08:54.349612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25236): Launched 13:08:54.470596 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:08:54.738196 run patchelf(pid=25237): Launched 13:08:54.913935 run osmo-stp_10.42.42.5(pid=25234): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25234)] 13:08:55.048031 run osmo-stp_10.42.42.5(pid=25234): stdout: | (launched: 2022-12-14_13:08:53.624833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:55.183832 run osmo-stp_10.42.42.5(pid=25234): stderr: | 20221214130853814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130853814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130853815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130853815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130853816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130853816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130853816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:55.319796 run osmo-stp_10.42.42.5(pid=25234): stdout: | (launched: 2022-12-14_13:08:53.624833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:08:55.451195 run osmo-stp_10.42.42.5(pid=25234): stderr: | 20221214130853814 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130853814 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130853815 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130853815 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130853816 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130853816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130853816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:08:55.605612 run patchelf(pid=25237): Terminating (SIGINT) 13:08:55.782554 run patchelf(pid=25237): Terminated: ok {rc=0} 13:08:55.909902 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25234): Process ended prematurely: osmo-stp_10.42.42.5(pid=25234) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25234)] [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 13:08:55.919374 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:08:55.947158 run osmo-hlr_10.42.42.2(pid=25231): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25231)] 13:08:55.997494 run osmo-hlr_10.42.42.2(pid=25231): stdout: | (launched: 2022-12-14_13:08:52.638809) 13:08:56.049680 run osmo-hlr_10.42.42.2(pid=25231): stderr: | 20221214130852835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130852835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130852835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130852835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130852835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130852835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130852848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130852856 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130852856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130852856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:08:56.101806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25230): Terminating (SIGTERM) 13:08:56.143327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25233): Terminating (SIGTERM) 13:08:56.185237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25236): Terminating (SIGTERM) 13:08:56.227240 --- ParallelTerminationStrategy: PID 25230 died... 13:08:56.247528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25230): Terminated: ok {rc=0} 13:08:56.293737 --- ParallelTerminationStrategy: PID 25233 died... 13:08:56.313438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25233): Terminated: ok {rc=0} 13:08:56.360014 --- ParallelTerminationStrategy: PID 25236 died... 13:08:56.379847 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25236): Terminated: ok {rc=0} 13:08:56.468183 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:08:57.756432 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:08:57.762851 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:08:57.783698 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:08:57.822174 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:08:57.907182 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:08:57.927151 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:08:57.964425 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:08:58.561749 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:08:58.615675 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:08:58.626985 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:08:58.685450 tst cs_paging_gprs_active.py: using LAC 41112 13:08:58.812782 tst cs_paging_gprs_active.py: using RAC 57 13:08:58.938590 tst cs_paging_gprs_active.py: using CellId 41112 13:08:59.064032 tst cs_paging_gprs_active.py: using BVCI 41113 13:08:59.180754 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:08:59.191964 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:08:59.202861 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:08:59.213744 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:08:59.224721 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:08:59.235878 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:08:59.247168 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:08:59.258258 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:08:59.269741 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:08:59.385760 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:08:59.506501 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:08:59.725427 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:00.049112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25241): Launched 13:09:00.329739 run iperf3-srv_10.42.42.10(pid=25242): Launched 13:09:00.451067 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:09:00.669435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:01.009705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25243): Launched 13:09:01.304545 run iperf3-srv_10.42.42.10(pid=25244): Launched 13:09:01.433162 tst cs_paging_gprs_active.py:38: start network... 13:09:01.643380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:02.200432 run create_hlr_db(pid=25282): Launched 13:09:02.401997 bus /gobi_6: Setting Powered False 13:09:03.489225 run create_hlr_db(pid=25282): Terminated: ok {rc=0} 13:09:04.030263 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25518): Launched 13:09:04.373671 run osmo-hlr_10.42.42.2(pid=25519): Launched 13:09:04.612870 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:05.350931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25521): Launched 13:09:05.685727 run osmo-stp_10.42.42.5(pid=25522): Launched 13:09:05.928407 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:06.605732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25526): Launched 13:09:06.733014 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:07.002262 run patchelf(pid=25527): Launched 13:09:07.188849 run osmo-stp_10.42.42.5(pid=25522): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25522)] 13:09:07.320177 run osmo-stp_10.42.42.5(pid=25522): stdout: | (launched: 2022-12-14_13:09:05.613983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:07.454546 run osmo-stp_10.42.42.5(pid=25522): stderr: | 20221214130905928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130905928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130905928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130905929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130905929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130905929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130905930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:07.591354 run osmo-stp_10.42.42.5(pid=25522): stdout: | (launched: 2022-12-14_13:09:05.613983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:07.720268 run osmo-stp_10.42.42.5(pid=25522): stderr: | 20221214130905928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130905928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130905928 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130905929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130905929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130905929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130905930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:07.870322 run patchelf(pid=25527): Terminating (SIGINT) 13:09:08.042636 run patchelf(pid=25527): Terminated: ok {rc=0} 13:09:08.168348 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25522): Process ended prematurely: osmo-stp_10.42.42.5(pid=25522) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25522)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:09:08.179265 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 13:09:08.207815 run osmo-hlr_10.42.42.2(pid=25519): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25519)] 13:09:08.258445 run osmo-hlr_10.42.42.2(pid=25519): stdout: | (launched: 2022-12-14_13:09:04.303444) 13:09:08.309439 run osmo-hlr_10.42.42.2(pid=25519): stderr: | 20221214130904655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130904655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130904656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130904656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130904656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130904656 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130904667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130904675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130904676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130904676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:08.360928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25241): Terminating (SIGTERM) 13:09:08.402476 run iperf3-srv_10.42.42.10(pid=25242): Terminating (SIGTERM) 13:09:08.446694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25243): Terminating (SIGTERM) 13:09:08.489656 run iperf3-srv_10.42.42.10(pid=25244): Terminating (SIGTERM) 13:09:08.533923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25518): Terminating (SIGTERM) 13:09:08.576323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25521): Terminating (SIGTERM) 13:09:08.620911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25526): Terminating (SIGTERM) 13:09:08.666393 --- ParallelTerminationStrategy: PID 25241 died... 13:09:08.685865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25241): Terminated: ok {rc=0} 13:09:08.733815 --- ParallelTerminationStrategy: PID 25242 died... 13:09:08.753404 run iperf3-srv_10.42.42.10(pid=25242): Terminated {rc=256} 13:09:08.798263 --- ParallelTerminationStrategy: PID 25243 died... 13:09:08.817695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25243): Terminated: ok {rc=0} 13:09:08.863717 --- ParallelTerminationStrategy: PID 25244 died... 13:09:08.882945 run iperf3-srv_10.42.42.10(pid=25244): Terminated {rc=256} 13:09:08.927863 --- ParallelTerminationStrategy: PID 25518 died... 13:09:08.947347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25518): Terminated: ok {rc=0} 13:09:08.992552 --- ParallelTerminationStrategy: PID 25521 died... 13:09:09.013190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25521): Terminated: ok {rc=0} 13:09:09.060779 --- ParallelTerminationStrategy: PID 25526 died... 13:09:09.080594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25526): Terminated: ok {rc=0} 13:09:09.167624 bus /gobi_0: Setting Powered False 13:09:10.267891 bus /gobi_0: Setting Powered False 13:09:11.384145 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:09:12.538577 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:12.551395 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:09:12.614203 tst iperf3.py: using LAC 41113 13:09:12.742066 tst iperf3.py: using RAC 58 13:09:12.869328 tst iperf3.py: using CellId 41113 13:09:12.997840 tst iperf3.py: using BVCI 41114 13:09:13.119860 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:13.133078 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:13.145155 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:13.157161 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:13.170169 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:13.183305 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:13.196818 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:13.209868 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:13.222988 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:13.345535 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:09:13.568445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:13.909722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25528): Launched 13:09:14.209721 run iperf3-srv_10.42.42.10(pid=25529): Launched 13:09:14.343730 tst iperf3.py:8: start network... 13:09:14.567789 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:15.086068 run create_hlr_db(pid=25530): Launched 13:09:15.247256 bus /gobi_6: Setting Powered False 13:09:16.339497 run create_hlr_db(pid=25530): Terminated: ok {rc=0} 13:09:16.781217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25532): Launched 13:09:17.111163 run osmo-hlr_10.42.42.2(pid=25533): Launched 13:09:17.377585 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:17.977702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25535): Launched 13:09:18.377678 run osmo-stp_10.42.42.5(pid=25536): Launched 13:09:18.654323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:19.233724 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25538): Launched 13:09:19.367865 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:19.661719 run patchelf(pid=25539): Launched 13:09:19.854710 run osmo-stp_10.42.42.5(pid=25536): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25536)] 13:09:19.996495 run osmo-stp_10.42.42.5(pid=25536): stdout: | (launched: 2022-12-14_13:09:18.309780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:20.140034 run osmo-stp_10.42.42.5(pid=25536): stderr: | 20221214130918511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130918511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130918512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130918512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130918512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130918512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130918513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:20.284092 run osmo-stp_10.42.42.5(pid=25536): stdout: | (launched: 2022-12-14_13:09:18.309780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:20.420296 run osmo-stp_10.42.42.5(pid=25536): stderr: | 20221214130918511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130918511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130918512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130918512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130918512 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130918512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130918513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:20.584257 run patchelf(pid=25539): Terminating (SIGINT) 13:09:20.772594 run patchelf(pid=25539): Terminated: ok {rc=0} 13:09:20.908271 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25536): Process ended prematurely: osmo-stp_10.42.42.5(pid=25536) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25536)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 13:09:20.919212 tst iperf3.py:8: Test FAILED (8.4 sec) 13:09:20.948246 run osmo-hlr_10.42.42.2(pid=25533): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25533)] 13:09:21.003152 run osmo-hlr_10.42.42.2(pid=25533): stdout: | (launched: 2022-12-14_13:09:17.042149) 13:09:21.058845 run osmo-hlr_10.42.42.2(pid=25533): stderr: | 20221214130917315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130917315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130917315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130917315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130917315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130917315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130917332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130917348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130917348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130917348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:21.113696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25528): Terminating (SIGTERM) 13:09:21.174992 run iperf3-srv_10.42.42.10(pid=25529): Terminating (SIGTERM) 13:09:21.221171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25532): Terminating (SIGTERM) 13:09:21.266223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25535): Terminating (SIGTERM) 13:09:21.310746 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25538): Terminating (SIGTERM) 13:09:21.357474 --- ParallelTerminationStrategy: PID 25528 died... 13:09:21.379341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25528): Terminated: ok {rc=0} 13:09:21.431847 --- ParallelTerminationStrategy: PID 25529 died... 13:09:21.453420 run iperf3-srv_10.42.42.10(pid=25529): Terminated {rc=256} 13:09:21.503175 --- ParallelTerminationStrategy: PID 25532 died... 13:09:21.525348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25532): Terminated: ok {rc=0} 13:09:21.574292 --- ParallelTerminationStrategy: PID 25535 died... 13:09:21.596149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25535): Terminated: ok {rc=0} 13:09:21.646341 --- ParallelTerminationStrategy: PID 25538 died... 13:09:21.669495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25538): Terminated: ok {rc=0} 13:09:21.764254 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:09:22.923831 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:22.936587 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:09:22.997493 tst iperf3m4.py: using LAC 41114 13:09:23.129287 tst iperf3m4.py: using RAC 59 13:09:23.258463 tst iperf3m4.py: using CellId 41114 13:09:23.391815 tst iperf3m4.py: using BVCI 41115 13:09:23.513846 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:23.526568 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:23.538628 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:23.550743 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:23.563960 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:23.577195 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:23.591151 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:23.604523 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:23.617562 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:23.744575 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:23.871940 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:23.995400 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:24.120066 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:09:24.346928 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:24.687950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25540): Launched 13:09:24.993019 run iperf3-srv_10.42.42.10(pid=25541): Launched 13:09:25.130705 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:09:25.356107 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:25.705698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25542): Launched 13:09:26.013678 run iperf3-srv_10.42.42.10(pid=25543): Launched 13:09:26.146686 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:09:26.358803 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:26.659021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25544): Launched 13:09:26.919533 run iperf3-srv_10.42.42.10(pid=25545): Launched 13:09:27.031190 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:09:27.230785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:09:27.530791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25546): Launched 13:09:27.791310 run iperf3-srv_10.42.42.10(pid=25547): Launched 13:09:27.902878 tst iperf3m4.py:8: start network... 13:09:28.102240 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:28.564590 run create_hlr_db(pid=25548): Launched 13:09:28.686692 bus /gobi_6: Setting Powered False 13:09:29.746659 run create_hlr_db(pid=25548): Terminated: ok {rc=0} 13:09:30.185477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25550): Launched 13:09:30.507400 run osmo-hlr_10.42.42.2(pid=25551): Launched 13:09:30.631808 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:31.199962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25553): Launched 13:09:31.526932 run osmo-stp_10.42.42.5(pid=25554): Launched 13:09:31.763572 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:32.386649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25556): Launched 13:09:32.501268 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:32.754364 run patchelf(pid=25557): Launched 13:09:32.920303 run osmo-stp_10.42.42.5(pid=25554): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25554)] 13:09:33.047303 run osmo-stp_10.42.42.5(pid=25554): stdout: | (launched: 2022-12-14_13:09:31.463133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:33.175746 run osmo-stp_10.42.42.5(pid=25554): stderr: | 20221214130931798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130931798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130931799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130931799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130931799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130931799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130931800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:33.304353 run osmo-stp_10.42.42.5(pid=25554): stdout: | (launched: 2022-12-14_13:09:31.463133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:33.427000 run osmo-stp_10.42.42.5(pid=25554): stderr: | 20221214130931798 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130931798 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130931799 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130931799 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130931799 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130931799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130931800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:33.572729 run patchelf(pid=25557): Terminating (SIGINT) 13:09:33.742240 run patchelf(pid=25557): Terminated: ok {rc=0} 13:09:33.863513 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25554): Process ended prematurely: osmo-stp_10.42.42.5(pid=25554) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25554)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:09:33.872823 tst iperf3m4.py:8: Test FAILED (11.0 sec) 13:09:33.900065 run osmo-hlr_10.42.42.2(pid=25551): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25551)] 13:09:33.947497 run osmo-hlr_10.42.42.2(pid=25551): stdout: | (launched: 2022-12-14_13:09:30.449223) 13:09:33.996664 run osmo-hlr_10.42.42.2(pid=25551): stderr: | 20221214130930645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130930645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130930645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130930646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130930646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130930646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130930658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130930668 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130930668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130930668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:34.046114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25540): Terminating (SIGTERM) 13:09:34.085610 run iperf3-srv_10.42.42.10(pid=25541): Terminating (SIGTERM) 13:09:34.125091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25542): Terminating (SIGTERM) 13:09:34.164445 run iperf3-srv_10.42.42.10(pid=25543): Terminating (SIGTERM) 13:09:34.203573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25544): Terminating (SIGTERM) 13:09:34.243016 run iperf3-srv_10.42.42.10(pid=25545): Terminating (SIGTERM) 13:09:34.282454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25546): Terminating (SIGTERM) 13:09:34.321801 run iperf3-srv_10.42.42.10(pid=25547): Terminating (SIGTERM) 13:09:34.361155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25550): Terminating (SIGTERM) 13:09:34.401034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25553): Terminating (SIGTERM) 13:09:34.440226 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25556): Terminating (SIGTERM) 13:09:34.479636 --- ParallelTerminationStrategy: PID 25540 died... 13:09:34.498560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25540): Terminated: ok {rc=0} 13:09:34.542390 --- ParallelTerminationStrategy: PID 25541 died... 13:09:34.560773 run iperf3-srv_10.42.42.10(pid=25541): Terminated {rc=256} 13:09:34.604292 --- ParallelTerminationStrategy: PID 25542 died... 13:09:34.622780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25542): Terminated: ok {rc=0} 13:09:34.666514 --- ParallelTerminationStrategy: PID 25543 died... 13:09:34.685012 run iperf3-srv_10.42.42.10(pid=25543): Terminated {rc=256} 13:09:34.728530 --- ParallelTerminationStrategy: PID 25544 died... 13:09:34.747000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25544): Terminated: ok {rc=0} 13:09:34.790619 --- ParallelTerminationStrategy: PID 25545 died... 13:09:34.809083 run iperf3-srv_10.42.42.10(pid=25545): Terminated {rc=256} 13:09:34.852589 --- ParallelTerminationStrategy: PID 25546 died... 13:09:34.871125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25546): Terminated: ok {rc=0} 13:09:34.914712 --- ParallelTerminationStrategy: PID 25547 died... 13:09:34.933304 run iperf3-srv_10.42.42.10(pid=25547): Terminated {rc=256} 13:09:34.976874 --- ParallelTerminationStrategy: PID 25550 died... 13:09:34.995387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25550): Terminated: ok {rc=0} 13:09:35.038997 --- ParallelTerminationStrategy: PID 25553 died... 13:09:35.057645 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25553): Terminated: ok {rc=0} 13:09:35.101223 --- ParallelTerminationStrategy: PID 25556 died... 13:09:35.119674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25556): Terminated: ok {rc=0} 13:09:35.204674 bus /gobi_4: Setting Powered False 13:09:36.303735 bus /gobi_4: Setting Powered False 13:09:37.418959 bus /gobi_1: Setting Powered False 13:09:38.518009 bus /gobi_1: Setting Powered False 13:09:39.632294 bus /gobi_0: Setting Powered False 13:09:40.730092 bus /gobi_0: Setting Powered False 13:09:41.844373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:09:42.946535 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:42.958059 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:09:43.014118 tst ping.py: using LAC 41115 13:09:43.129921 tst ping.py: using RAC 60 13:09:43.248443 tst ping.py: using CellId 41115 13:09:43.364573 tst ping.py: using BVCI 41116 13:09:43.471188 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:43.482016 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:43.492363 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:43.502820 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:43.513303 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:43.523743 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:43.534372 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:43.544769 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:43.657208 tst ping.py:19: start network... 13:09:43.855207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:44.310284 run create_hlr_db(pid=25558): Launched 13:09:44.430797 bus /gobi_6: Setting Powered False 13:09:45.493851 run create_hlr_db(pid=25558): Terminated: ok {rc=0} 13:09:45.933780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25560): Launched 13:09:46.244640 run osmo-hlr_10.42.42.2(pid=25561): Launched 13:09:46.478427 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:47.071239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25563): Launched 13:09:47.377914 run osmo-stp_10.42.42.5(pid=25564): Launched 13:09:47.489199 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:47.998169 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25566): Launched 13:09:48.110884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:48.360491 run patchelf(pid=25567): Launched 13:09:48.524198 run osmo-stp_10.42.42.5(pid=25564): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25564)] 13:09:48.648874 run osmo-stp_10.42.42.5(pid=25564): stdout: | (launched: 2022-12-14_13:09:47.323883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:48.775072 run osmo-stp_10.42.42.5(pid=25564): stderr: | 20221214130947496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130947496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130947496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130947497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130947497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130947497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130947497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:48.901780 run osmo-stp_10.42.42.5(pid=25564): stdout: | (launched: 2022-12-14_13:09:47.323883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:49.022918 run osmo-stp_10.42.42.5(pid=25564): stderr: | 20221214130947496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130947496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130947496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130947497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130947497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130947497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130947497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:49.166330 run patchelf(pid=25567): Terminating (SIGINT) 13:09:49.331456 run patchelf(pid=25567): Terminated: ok {rc=0} 13:09:49.450641 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25564): Process ended prematurely: osmo-stp_10.42.42.5(pid=25564) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25564)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 13:09:49.459425 tst ping.py:22: Test FAILED (6.5 sec) 13:09:49.485838 run osmo-hlr_10.42.42.2(pid=25561): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25561)] 13:09:49.533098 run osmo-hlr_10.42.42.2(pid=25561): stdout: | (launched: 2022-12-14_13:09:46.183702) 13:09:49.581800 run osmo-hlr_10.42.42.2(pid=25561): stderr: | 20221214130946535 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130946535 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130946535 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130946535 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130946535 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130946535 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130946551 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130946565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130946565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130946566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:49.630886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25560): Terminating (SIGTERM) 13:09:49.670191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25563): Terminating (SIGTERM) 13:09:49.709458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25566): Terminating (SIGTERM) 13:09:49.749219 --- ParallelTerminationStrategy: PID 25560 died... 13:09:49.768329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25560): Terminated: ok {rc=0} 13:09:49.812784 --- ParallelTerminationStrategy: PID 25563 died... 13:09:49.831317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25563): Terminated: ok {rc=0} 13:09:49.875309 --- ParallelTerminationStrategy: PID 25566 died... 13:09:49.893927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25566): Terminated: ok {rc=0} 13:09:49.979549 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:09:51.067198 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:51.078620 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:09:51.133739 tst ping_idle_ping.py: using LAC 41116 13:09:51.251954 tst ping_idle_ping.py: using RAC 61 13:09:51.367420 tst ping_idle_ping.py: using CellId 41116 13:09:51.483660 tst ping_idle_ping.py: using BVCI 41117 13:09:51.592583 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:51.603426 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:51.613972 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:51.624377 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:51.634756 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:51.645260 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:51.655867 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:09:51.666361 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:09:51.779581 tst ping_idle_ping.py:24: start network... 13:09:51.977774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:09:52.437415 run create_hlr_db(pid=25568): Launched 13:09:52.559345 bus /gobi_6: Setting Powered False 13:09:53.619022 run create_hlr_db(pid=25568): Terminated: ok {rc=0} 13:09:54.053222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25570): Launched 13:09:54.371916 run osmo-hlr_10.42.42.2(pid=25571): Launched 13:09:54.494177 run osmo-stp_10.42.42.5: Starting osmo-stp 13:09:55.042705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25573): Launched 13:09:55.359496 run osmo-stp_10.42.42.5(pid=25574): Launched 13:09:55.481853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:09:56.031260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25576): Launched 13:09:56.153294 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:09:56.421985 run patchelf(pid=25577): Launched 13:09:56.598506 run osmo-stp_10.42.42.5(pid=25574): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25574)] 13:09:56.733370 run osmo-stp_10.42.42.5(pid=25574): stdout: | (launched: 2022-12-14_13:09:55.301679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:56.869356 run osmo-stp_10.42.42.5(pid=25574): stderr: | 20221214130955493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130955494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130955494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130955494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130955495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130955495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130955495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:57.005599 run osmo-stp_10.42.42.5(pid=25574): stdout: | (launched: 2022-12-14_13:09:55.301679) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:09:57.136386 run osmo-stp_10.42.42.5(pid=25574): stderr: | 20221214130955493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214130955494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214130955494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214130955494 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214130955495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214130955495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214130955495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:09:57.291041 run patchelf(pid=25577): Terminating (SIGINT) 13:09:57.468683 run patchelf(pid=25577): Terminated: ok {rc=0} 13:09:57.596797 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25574): Process ended prematurely: osmo-stp_10.42.42.5(pid=25574) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25574)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:09:57.606242 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:09:57.633999 run osmo-hlr_10.42.42.2(pid=25571): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25571)] 13:09:57.685221 run osmo-hlr_10.42.42.2(pid=25571): stdout: | (launched: 2022-12-14_13:09:54.313885) 13:09:57.737507 run osmo-hlr_10.42.42.2(pid=25571): stderr: | 20221214130954509 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214130954510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214130954510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214130954510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214130954510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214130954510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214130954521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214130954529 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214130954529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214130954529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:09:57.789907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25570): Terminating (SIGTERM) 13:09:57.831704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25573): Terminating (SIGTERM) 13:09:57.874574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25576): Terminating (SIGTERM) 13:09:57.917202 --- ParallelTerminationStrategy: PID 25570 died... 13:09:57.937582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25570): Terminated: ok {rc=0} 13:09:57.984568 --- ParallelTerminationStrategy: PID 25573 died... 13:09:58.004721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25573): Terminated: ok {rc=0} 13:09:58.051402 --- ParallelTerminationStrategy: PID 25576 died... 13:09:58.071554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25576): Terminated: ok {rc=0} 13:09:58.159814 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:09:59.449161 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:09:59.455265 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:09:59.475729 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:09:59.514262 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:09:59.598899 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:09:59.618788 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:09:59.656081 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:10:00.250933 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:10:00.299275 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:00.309991 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:00.366090 tst cs_paging_gprs_active.py: using LAC 41117 13:10:00.497653 tst cs_paging_gprs_active.py: using RAC 62 13:10:00.623442 tst cs_paging_gprs_active.py: using CellId 41117 13:10:00.741792 tst cs_paging_gprs_active.py: using BVCI 41118 13:10:00.851356 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:00.862961 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:00.874074 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:00.888760 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:00.900405 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:00.912117 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:00.923581 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:00.934545 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:00.945917 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:01.080215 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:01.203239 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:10:01.431040 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:01.753739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25585): Launched 13:10:02.038672 run iperf3-srv_10.42.42.10(pid=25586): Launched 13:10:02.186918 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:10:02.396409 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:02.698021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25587): Launched 13:10:02.958440 run iperf3-srv_10.42.42.10(pid=25588): Launched 13:10:03.070726 tst cs_paging_gprs_active.py:38: start network... 13:10:03.271519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:03.736156 run create_hlr_db(pid=25589): Launched 13:10:03.858325 bus /gobi_6: Setting Powered False 13:10:04.918412 run create_hlr_db(pid=25589): Terminated: ok {rc=0} 13:10:05.358323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25591): Launched 13:10:05.680769 run osmo-hlr_10.42.42.2(pid=25592): Launched 13:10:05.804643 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:06.362328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25594): Launched 13:10:06.685428 run osmo-stp_10.42.42.5(pid=25595): Launched 13:10:06.808933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:07.365452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25597): Launched 13:10:07.489611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:07.761697 run patchelf(pid=25598): Launched 13:10:07.940736 run osmo-stp_10.42.42.5(pid=25595): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25595)] 13:10:08.077233 run osmo-stp_10.42.42.5(pid=25595): stdout: | (launched: 2022-12-14_13:10:06.626942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:08.215588 run osmo-stp_10.42.42.5(pid=25595): stderr: | 20221214131006819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131006819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131006819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131006819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131006822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131006822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131006822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:08.353999 run osmo-stp_10.42.42.5(pid=25595): stdout: | (launched: 2022-12-14_13:10:06.626942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:08.486935 run osmo-stp_10.42.42.5(pid=25595): stderr: | 20221214131006819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131006819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131006819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131006819 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131006822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131006822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131006822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:08.643667 run patchelf(pid=25598): Terminating (SIGINT) 13:10:08.824023 run patchelf(pid=25598): Terminated: ok {rc=0} 13:10:08.954215 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25595): Process ended prematurely: osmo-stp_10.42.42.5(pid=25595) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25595)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:10:08.964339 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:10:08.992491 run osmo-hlr_10.42.42.2(pid=25592): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25592)] 13:10:09.042984 run osmo-hlr_10.42.42.2(pid=25592): stdout: | (launched: 2022-12-14_13:10:05.622416) 13:10:09.094581 run osmo-hlr_10.42.42.2(pid=25592): stderr: | 20221214131005822 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131005822 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131005822 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131005822 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131005822 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131005822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131005834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131005842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131005842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131005843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:09.147485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25585): Terminating (SIGTERM) 13:10:09.189199 run iperf3-srv_10.42.42.10(pid=25586): Terminating (SIGTERM) 13:10:09.231326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25587): Terminating (SIGTERM) 13:10:09.273528 run iperf3-srv_10.42.42.10(pid=25588): Terminating (SIGTERM) 13:10:09.315730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25591): Terminating (SIGTERM) 13:10:09.357944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25594): Terminating (SIGTERM) 13:10:09.399739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25597): Terminating (SIGTERM) 13:10:09.442519 --- ParallelTerminationStrategy: PID 25585 died... 13:10:09.463753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25585): Terminated: ok {rc=0} 13:10:09.510216 --- ParallelTerminationStrategy: PID 25586 died... 13:10:09.529885 run iperf3-srv_10.42.42.10(pid=25586): Terminated {rc=256} 13:10:09.575745 --- ParallelTerminationStrategy: PID 25587 died... 13:10:09.595381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25587): Terminated: ok {rc=0} 13:10:09.641236 --- ParallelTerminationStrategy: PID 25588 died... 13:10:09.660674 run iperf3-srv_10.42.42.10(pid=25588): Terminated {rc=256} 13:10:09.706321 --- ParallelTerminationStrategy: PID 25591 died... 13:10:09.725995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25591): Terminated: ok {rc=0} 13:10:09.772015 --- ParallelTerminationStrategy: PID 25594 died... 13:10:09.791724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25594): Terminated: ok {rc=0} 13:10:09.837670 --- ParallelTerminationStrategy: PID 25597 died... 13:10:09.857383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25597): Terminated: ok {rc=0} 13:10:09.945231 bus /gobi_0: Setting Powered False 13:10:11.043554 bus /gobi_0: Setting Powered False 13:10:12.158986 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:10:13.305303 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:13.316642 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:13.376408 tst iperf3.py: using LAC 41118 13:10:13.494759 tst iperf3.py: using RAC 63 13:10:13.619060 tst iperf3.py: using CellId 41118 13:10:13.736739 tst iperf3.py: using BVCI 41119 13:10:13.844910 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:13.855723 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:13.866172 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:13.876591 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:13.886918 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:13.897871 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:13.908682 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:13.919753 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:13.930325 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:14.042709 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:10:14.244289 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:14.544809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25600): Launched 13:10:14.805403 run iperf3-srv_10.42.42.10(pid=25601): Launched 13:10:14.917520 tst iperf3.py:8: start network... 13:10:15.117588 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:15.579971 run create_hlr_db(pid=25602): Launched 13:10:15.703051 bus /gobi_6: Setting Powered False 13:10:16.799858 run create_hlr_db(pid=25602): Terminated: ok {rc=0} 13:10:17.273205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25604): Launched 13:10:17.595409 run osmo-hlr_10.42.42.2(pid=25605): Launched 13:10:17.720082 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:18.275031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25607): Launched 13:10:18.596941 run osmo-stp_10.42.42.5(pid=25608): Launched 13:10:18.721101 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:19.276031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25610): Launched 13:10:19.399443 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:19.674060 run patchelf(pid=25611): Launched 13:10:19.853395 run osmo-stp_10.42.42.5(pid=25608): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25608)] 13:10:19.990265 run osmo-stp_10.42.42.5(pid=25608): stdout: | (launched: 2022-12-14_13:10:18.539051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:20.128252 run osmo-stp_10.42.42.5(pid=25608): stderr: | 20221214131018734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131018734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131018734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131018734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131018735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131018735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131018735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:20.267130 run osmo-stp_10.42.42.5(pid=25608): stdout: | (launched: 2022-12-14_13:10:18.539051) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:20.399098 run osmo-stp_10.42.42.5(pid=25608): stderr: | 20221214131018734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131018734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131018734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131018734 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131018735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131018735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131018735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:20.556315 run patchelf(pid=25611): Terminating (SIGINT) 13:10:20.737072 run patchelf(pid=25611): Terminated: ok {rc=0} 13:10:20.867301 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25608): Process ended prematurely: osmo-stp_10.42.42.5(pid=25608) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25608)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 13:10:20.877499 tst iperf3.py:8: Test FAILED (7.6 sec) 13:10:20.905528 run osmo-hlr_10.42.42.2(pid=25605): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25605)] 13:10:20.955750 run osmo-hlr_10.42.42.2(pid=25605): stdout: | (launched: 2022-12-14_13:10:17.537432) 13:10:21.007613 run osmo-hlr_10.42.42.2(pid=25605): stderr: | 20221214131017735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131017735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131017735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131017735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131017735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131017735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131017748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131017756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131017756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131017756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:21.059991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25600): Terminating (SIGTERM) 13:10:21.102157 run iperf3-srv_10.42.42.10(pid=25601): Terminating (SIGTERM) 13:10:21.144546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25604): Terminating (SIGTERM) 13:10:21.186962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25607): Terminating (SIGTERM) 13:10:21.228939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25610): Terminating (SIGTERM) 13:10:21.270757 --- ParallelTerminationStrategy: PID 25600 died... 13:10:21.290981 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25600): Terminated: ok {rc=0} 13:10:21.337806 --- ParallelTerminationStrategy: PID 25601 died... 13:10:21.357764 run iperf3-srv_10.42.42.10(pid=25601): Terminated {rc=256} 13:10:21.403689 --- ParallelTerminationStrategy: PID 25604 died... 13:10:21.423359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25604): Terminated: ok {rc=0} 13:10:21.469668 --- ParallelTerminationStrategy: PID 25607 died... 13:10:21.489351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25607): Terminated: ok {rc=0} 13:10:21.535544 --- ParallelTerminationStrategy: PID 25610 died... 13:10:21.555353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25610): Terminated: ok {rc=0} 13:10:21.642835 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:10:22.794596 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:22.806647 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:22.864815 tst iperf3m4.py: using LAC 41119 13:10:22.983072 tst iperf3m4.py: using RAC 64 13:10:23.102422 tst iperf3m4.py: using CellId 41119 13:10:23.221388 tst iperf3m4.py: using BVCI 41120 13:10:23.331838 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:23.342726 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:23.353569 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:23.367853 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:23.380452 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:23.392608 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:23.404931 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:23.417354 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:23.429740 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:23.549915 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:23.667865 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:23.787195 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:23.902974 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:10:24.106368 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:24.408526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25612): Launched 13:10:24.670429 run iperf3-srv_10.42.42.10(pid=25613): Launched 13:10:24.782872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:10:24.984781 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:25.285433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25614): Launched 13:10:25.547184 run iperf3-srv_10.42.42.10(pid=25615): Launched 13:10:25.659368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:10:25.859716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:26.161216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25616): Launched 13:10:26.422417 run iperf3-srv_10.42.42.10(pid=25617): Launched 13:10:26.534677 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:10:26.735242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:10:27.036737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25618): Launched 13:10:27.298714 run iperf3-srv_10.42.42.10(pid=25619): Launched 13:10:27.410842 tst iperf3m4.py:8: start network... 13:10:27.611691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:28.075776 run create_hlr_db(pid=25620): Launched 13:10:28.199025 bus /gobi_6: Setting Powered False 13:10:29.258668 run create_hlr_db(pid=25620): Terminated: ok {rc=0} 13:10:29.699541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25622): Launched 13:10:30.021536 run osmo-hlr_10.42.42.2(pid=25623): Launched 13:10:30.145668 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:30.700055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25626): Launched 13:10:31.066712 run osmo-stp_10.42.42.5(pid=25627): Launched 13:10:31.422183 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:32.039683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25629): Launched 13:10:32.174876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:32.450258 run patchelf(pid=25630): Launched 13:10:32.629313 run osmo-stp_10.42.42.5(pid=25627): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25627)] 13:10:32.765427 run osmo-stp_10.42.42.5(pid=25627): stdout: | (launched: 2022-12-14_13:10:31.001207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:32.903261 run osmo-stp_10.42.42.5(pid=25627): stderr: | 20221214131031221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131031221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131031221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131031222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131031222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131031222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131031222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:33.041204 run osmo-stp_10.42.42.5(pid=25627): stdout: | (launched: 2022-12-14_13:10:31.001207) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:33.173384 run osmo-stp_10.42.42.5(pid=25627): stderr: | 20221214131031221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131031221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131031221 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131031222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131031222 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131031222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131031222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:33.330163 run patchelf(pid=25630): Terminating (SIGINT) 13:10:33.510740 run patchelf(pid=25630): Terminated: ok {rc=0} 13:10:33.640849 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25627): Process ended prematurely: osmo-stp_10.42.42.5(pid=25627) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25627)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:10:33.650976 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:10:33.679460 run osmo-hlr_10.42.42.2(pid=25623): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25623)] 13:10:33.730328 run osmo-hlr_10.42.42.2(pid=25623): stdout: | (launched: 2022-12-14_13:10:29.963343) 13:10:33.782879 run osmo-hlr_10.42.42.2(pid=25623): stderr: | 20221214131030161 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131030161 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131030161 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131030161 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131030161 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131030161 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131030173 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131030182 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131030182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131030182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:33.835495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25612): Terminating (SIGTERM) 13:10:33.877520 run iperf3-srv_10.42.42.10(pid=25613): Terminating (SIGTERM) 13:10:33.920043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25614): Terminating (SIGTERM) 13:10:33.962193 run iperf3-srv_10.42.42.10(pid=25615): Terminating (SIGTERM) 13:10:34.004572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25616): Terminating (SIGTERM) 13:10:34.046810 run iperf3-srv_10.42.42.10(pid=25617): Terminating (SIGTERM) 13:10:34.090526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25618): Terminating (SIGTERM) 13:10:34.132646 run iperf3-srv_10.42.42.10(pid=25619): Terminating (SIGTERM) 13:10:34.174997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25622): Terminating (SIGTERM) 13:10:34.216869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25626): Terminating (SIGTERM) 13:10:34.259208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25629): Terminating (SIGTERM) 13:10:34.301762 --- ParallelTerminationStrategy: PID 25612 died... 13:10:34.322011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25612): Terminated: ok {rc=0} 13:10:34.368697 --- ParallelTerminationStrategy: PID 25613 died... 13:10:34.388428 run iperf3-srv_10.42.42.10(pid=25613): Terminated {rc=256} 13:10:34.434669 --- ParallelTerminationStrategy: PID 25614 died... 13:10:34.454433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25614): Terminated: ok {rc=0} 13:10:34.501075 --- ParallelTerminationStrategy: PID 25615 died... 13:10:34.520706 run iperf3-srv_10.42.42.10(pid=25615): Terminated {rc=256} 13:10:34.566902 --- ParallelTerminationStrategy: PID 25616 died... 13:10:34.586645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25616): Terminated: ok {rc=0} 13:10:34.633152 --- ParallelTerminationStrategy: PID 25617 died... 13:10:34.652759 run iperf3-srv_10.42.42.10(pid=25617): Terminated {rc=256} 13:10:34.698978 --- ParallelTerminationStrategy: PID 25618 died... 13:10:34.718847 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25618): Terminated: ok {rc=0} 13:10:34.765037 --- ParallelTerminationStrategy: PID 25619 died... 13:10:34.784812 run iperf3-srv_10.42.42.10(pid=25619): Terminated {rc=256} 13:10:34.830881 --- ParallelTerminationStrategy: PID 25622 died... 13:10:34.850730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25622): Terminated: ok {rc=0} 13:10:34.897067 --- ParallelTerminationStrategy: PID 25626 died... 13:10:34.916845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25626): Terminated: ok {rc=0} 13:10:34.963106 --- ParallelTerminationStrategy: PID 25629 died... 13:10:34.982846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25629): Terminated: ok {rc=0} 13:10:35.070880 bus /gobi_4: Setting Powered False 13:10:36.170221 bus /gobi_4: Setting Powered False 13:10:37.285615 bus /gobi_1: Setting Powered False 13:10:38.383052 bus /gobi_1: Setting Powered False 13:10:39.498604 bus /gobi_0: Setting Powered False 13:10:40.597382 bus /gobi_0: Setting Powered False 13:10:41.713857 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:10:42.816020 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:42.827835 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:42.886484 tst ping.py: using LAC 41120 13:10:43.010474 tst ping.py: using RAC 65 13:10:43.134639 tst ping.py: using CellId 41120 13:10:43.258903 tst ping.py: using BVCI 41121 13:10:43.375352 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:43.386713 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:43.397732 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:43.408649 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:43.419951 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:43.431169 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:43.442605 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:43.453834 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:43.569538 tst ping.py:19: start network... 13:10:43.767454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:44.224448 run create_hlr_db(pid=25631): Launched 13:10:44.346223 bus /gobi_6: Setting Powered False 13:10:45.405506 run create_hlr_db(pid=25631): Terminated: ok {rc=0} 13:10:45.850189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25633): Launched 13:10:46.208731 run osmo-hlr_10.42.42.2(pid=25634): Launched 13:10:46.436713 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:47.053591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25636): Launched 13:10:47.361699 run osmo-stp_10.42.42.5(pid=25637): Launched 13:10:47.474519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:47.999768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25639): Launched 13:10:48.111525 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:48.359995 run patchelf(pid=25640): Launched 13:10:48.523198 run osmo-stp_10.42.42.5(pid=25637): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25637)] 13:10:48.647874 run osmo-stp_10.42.42.5(pid=25637): stdout: | (launched: 2022-12-14_13:10:47.301703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:48.774048 run osmo-stp_10.42.42.5(pid=25637): stderr: | 20221214131047476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131047476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131047476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131047477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131047477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131047477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131047477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:48.900175 run osmo-stp_10.42.42.5(pid=25637): stdout: | (launched: 2022-12-14_13:10:47.301703) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:49.021196 run osmo-stp_10.42.42.5(pid=25637): stderr: | 20221214131047476 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131047476 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131047476 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131047477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131047477 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131047477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131047477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:49.164369 run patchelf(pid=25640): Terminating (SIGINT) 13:10:49.328808 run patchelf(pid=25640): Terminated: ok {rc=0} 13:10:49.447902 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=25637): Process ended prematurely: osmo-stp_10.42.42.5(pid=25637) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25637)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 13:10:49.456694 tst ping.py:22: Test FAILED (6.6 sec) 13:10:49.483285 run osmo-hlr_10.42.42.2(pid=25634): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25634)] 13:10:49.531120 run osmo-hlr_10.42.42.2(pid=25634): stdout: | (launched: 2022-12-14_13:10:46.142259) 13:10:49.580710 run osmo-hlr_10.42.42.2(pid=25634): stderr: | 20221214131046357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131046358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131046358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131046358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131046358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131046358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131046378 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131046399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131046399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131046399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:49.630382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25633): Terminating (SIGTERM) 13:10:49.670209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25636): Terminating (SIGTERM) 13:10:49.709722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25639): Terminating (SIGTERM) 13:10:49.749479 --- ParallelTerminationStrategy: PID 25633 died... 13:10:49.768442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25633): Terminated: ok {rc=0} 13:10:49.812342 --- ParallelTerminationStrategy: PID 25636 died... 13:10:49.831047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25636): Terminated: ok {rc=0} 13:10:49.875037 --- ParallelTerminationStrategy: PID 25639 died... 13:10:49.893684 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25639): Terminated: ok {rc=0} 13:10:49.979465 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:10:51.066650 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:51.078059 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:10:51.136309 tst ping_idle_ping.py: using LAC 41121 13:10:51.262089 tst ping_idle_ping.py: using RAC 66 13:10:51.387966 tst ping_idle_ping.py: using CellId 41121 13:10:51.514626 tst ping_idle_ping.py: using BVCI 41122 13:10:51.622634 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:51.633584 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:51.644193 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:51.654833 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:51.665418 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:51.677108 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:51.688369 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:10:51.699506 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:10:51.818107 tst ping_idle_ping.py:24: start network... 13:10:52.034125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:10:52.506700 run create_hlr_db(pid=25644): Launched 13:10:52.627826 bus /gobi_6: Setting Powered False 13:10:53.687663 run create_hlr_db(pid=25644): Terminated: ok {rc=0} 13:10:54.101439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25646): Launched 13:10:54.398333 run osmo-hlr_10.42.42.2(pid=25647): Launched 13:10:54.511300 run osmo-stp_10.42.42.5: Starting osmo-stp 13:10:55.037314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25649): Launched 13:10:55.333232 run osmo-stp_10.42.42.5(pid=25650): Launched 13:10:55.445735 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:10:55.956848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25652): Launched 13:10:56.069505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:10:56.319187 run patchelf(pid=25653): Launched 13:10:56.482950 run osmo-stp_10.42.42.5(pid=25650): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25650)] 13:10:56.607796 run osmo-stp_10.42.42.5(pid=25650): stdout: | (launched: 2022-12-14_13:10:55.279083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:56.734207 run osmo-stp_10.42.42.5(pid=25650): stderr: | 20221214131055449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131055449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131055450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131055450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131055451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131055451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131055451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:56.860859 run osmo-stp_10.42.42.5(pid=25650): stdout: | (launched: 2022-12-14_13:10:55.279083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:10:56.981829 run osmo-stp_10.42.42.5(pid=25650): stderr: | 20221214131055449 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131055449 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131055450 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131055450 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131055451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131055451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131055451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:10:57.125198 run patchelf(pid=25653): Terminating (SIGINT) 13:10:57.290753 run patchelf(pid=25653): Terminated: ok {rc=0} 13:10:57.410098 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=25650): Process ended prematurely: osmo-stp_10.42.42.5(pid=25650) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25650)] [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:10:57.418815 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:10:57.444836 run osmo-hlr_10.42.42.2(pid=25647): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25647)] 13:10:57.492233 run osmo-hlr_10.42.42.2(pid=25647): stdout: | (launched: 2022-12-14_13:10:54.344118) 13:10:57.541163 run osmo-hlr_10.42.42.2(pid=25647): stderr: | 20221214131054520 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131054520 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131054520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131054520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131054520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131054520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131054532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131054541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131054541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131054541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:10:57.590441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25646): Terminating (SIGTERM) 13:10:57.629661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25649): Terminating (SIGTERM) 13:10:57.668807 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25652): Terminating (SIGTERM) 13:10:57.708183 --- ParallelTerminationStrategy: PID 25646 died... 13:10:57.727101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25646): Terminated: ok {rc=0} 13:10:57.770589 --- ParallelTerminationStrategy: PID 25649 died... 13:10:57.788753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25649): Terminated: ok {rc=0} 13:10:57.832117 --- ParallelTerminationStrategy: PID 25652 died... 13:10:57.850397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25652): Terminated: ok {rc=0} 13:10:57.934926 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:10:59.217591 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:10:59.223975 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:10:59.243937 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:10:59.278939 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:10:59.331203 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:10:59.352068 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:10:59.387004 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:10:59.945576 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:10:59.951842 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:10:59.963996 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:11:00.024937 tst switch_tch_pdch.py: using LAC 41122 13:11:00.149435 tst switch_tch_pdch.py: using RAC 67 13:11:00.266409 tst switch_tch_pdch.py: using CellId 41122 13:11:00.382864 tst switch_tch_pdch.py: using BVCI 41123 13:11:00.488835 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:00.500129 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:00.511058 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:00.522027 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:00.532598 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:00.543376 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:00.554284 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:11:00.565001 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:11:00.684147 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:11:00.799972 tst switch_tch_pdch.py:51: start network... 13:11:01.000810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:01.476488 run create_hlr_db(pid=25657): Launched 13:11:01.631810 bus /gobi_6: Setting Powered False 13:11:02.691090 run create_hlr_db(pid=25657): Terminated: ok {rc=0} 13:11:03.123103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25659): Launched 13:11:03.438773 run osmo-hlr_10.42.42.2(pid=25660): Launched 13:11:03.560270 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:04.106235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25662): Launched 13:11:04.422342 run osmo-stp_10.42.42.5(pid=25663): Launched 13:11:04.543842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:05.089060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25665): Launched 13:11:05.209771 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:05.476234 run patchelf(pid=25666): Launched 13:11:05.652097 run osmo-stp_10.42.42.5(pid=25663): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25663)] 13:11:05.785876 run osmo-stp_10.42.42.5(pid=25663): stdout: | (launched: 2022-12-14_13:11:04.364601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:05.921404 run osmo-stp_10.42.42.5(pid=25663): stderr: | 20221214131104555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131104555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131104556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131104556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131104556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131104557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131104557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:06.056615 run osmo-stp_10.42.42.5(pid=25663): stdout: | (launched: 2022-12-14_13:11:04.364601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:06.186348 run osmo-stp_10.42.42.5(pid=25663): stderr: | 20221214131104555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131104555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131104556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131104556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131104556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131104557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131104557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:06.340376 run patchelf(pid=25666): Terminating (SIGINT) 13:11:06.517110 run patchelf(pid=25666): Terminated: ok {rc=0} 13:11:06.644574 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25663): Process ended prematurely: osmo-stp_10.42.42.5(pid=25663) [trial-2405↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25663)] [trial-2405↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:11:06.653938 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 13:11:06.681475 run osmo-hlr_10.42.42.2(pid=25660): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25660)] 13:11:06.731746 run osmo-hlr_10.42.42.2(pid=25660): stdout: | (launched: 2022-12-14_13:11:03.381670) 13:11:06.783359 run osmo-hlr_10.42.42.2(pid=25660): stderr: | 20221214131103576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131103576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131103576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131103576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131103576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131103576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131103588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131103596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131103596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131103597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:06.835195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25659): Terminating (SIGTERM) 13:11:06.876856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25662): Terminating (SIGTERM) 13:11:06.918602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25665): Terminating (SIGTERM) 13:11:06.960873 --- ParallelTerminationStrategy: PID 25659 died... 13:11:06.981192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25659): Terminated: ok {rc=0} 13:11:07.027213 --- ParallelTerminationStrategy: PID 25662 died... 13:11:07.046849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25662): Terminated: ok {rc=0} 13:11:07.093057 --- ParallelTerminationStrategy: PID 25665 died... 13:11:07.112813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25665): Terminated: ok {rc=0} 13:11:07.200164 bus /gobi_0: Setting Powered False 13:11:08.297733 bus /gobi_0: Setting Powered False 13:11:09.413489 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:11:10.646726 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:10.652457 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:11:10.672672 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:11:10.706868 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:11:10.758135 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:11:10.778379 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:11:10.812116 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:11:11.369251 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:11:11.374669 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:11.386044 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:11:11.443693 tst switch_tch_pdch.py: using LAC 41123 13:11:11.568324 tst switch_tch_pdch.py: using RAC 68 13:11:11.693300 tst switch_tch_pdch.py: using CellId 41123 13:11:11.818322 tst switch_tch_pdch.py: using BVCI 41124 13:11:11.933080 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:11.944426 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:11.955431 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:11.966581 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:11.977965 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:11.989458 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:12.001062 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:11:12.012367 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:11:12.128496 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:11:12.244470 tst switch_tch_pdch.py:51: start network... 13:11:12.442574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:12.875565 run create_hlr_db(pid=25670): Launched 13:11:12.997543 bus /gobi_6: Setting Powered False 13:11:14.057991 run create_hlr_db(pid=25670): Terminated: ok {rc=0} 13:11:14.444323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25672): Launched 13:11:14.738226 run osmo-hlr_10.42.42.2(pid=25673): Launched 13:11:14.849611 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:15.329559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25675): Launched 13:11:15.624685 run osmo-stp_10.42.42.5(pid=25676): Launched 13:11:15.737884 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:11:16.266288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25678): Launched 13:11:16.384201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:11:16.657783 run patchelf(pid=25679): Launched 13:11:16.829053 run osmo-stp_10.42.42.5(pid=25676): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25676)] 13:11:16.956678 run osmo-stp_10.42.42.5(pid=25676): stdout: | (launched: 2022-12-14_13:11:15.570296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:17.085313 run osmo-stp_10.42.42.5(pid=25676): stderr: | 20221214131115740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131115740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131115740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131115741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131115741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131115741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131115741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:17.213195 run osmo-stp_10.42.42.5(pid=25676): stdout: | (launched: 2022-12-14_13:11:15.570296) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:17.333377 run osmo-stp_10.42.42.5(pid=25676): stderr: | 20221214131115740 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131115740 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131115740 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131115741 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131115741 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131115741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131115741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:17.475865 run patchelf(pid=25679): Terminating (SIGINT) 13:11:17.640122 run patchelf(pid=25679): Terminated: ok {rc=0} 13:11:17.758727 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=25676): Process ended prematurely: osmo-stp_10.42.42.5(pid=25676) [trial-2405↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25676)] [trial-2405↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:11:17.767588 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:11:17.793980 run osmo-hlr_10.42.42.2(pid=25673): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25673)] 13:11:17.841265 run osmo-hlr_10.42.42.2(pid=25673): stdout: | (launched: 2022-12-14_13:11:14.684062) 13:11:17.890150 run osmo-hlr_10.42.42.2(pid=25673): stderr: | 20221214131114856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131114856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131114856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131114856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131114856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131114856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131114870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131114879 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131114879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131114879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:17.939491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25672): Terminating (SIGTERM) 13:11:17.979137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25675): Terminating (SIGTERM) 13:11:18.018341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25678): Terminating (SIGTERM) 13:11:18.057828 --- ParallelTerminationStrategy: PID 25672 died... 13:11:18.076553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25672): Terminated: ok {rc=0} 13:11:18.119927 --- ParallelTerminationStrategy: PID 25675 died... 13:11:18.138279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25675): Terminated: ok {rc=0} 13:11:18.181812 --- ParallelTerminationStrategy: PID 25678 died... 13:11:18.200194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25678): Terminated: ok {rc=0} 13:11:18.283926 bus /gobi_0: Setting Powered False 13:11:19.381889 bus /gobi_0: Setting Powered False 13:11:20.500811 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_sms:trx-b200 --------------------------------------------------------------------- 13:11:21.731244 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:21.734899 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 13:11:21.767143 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 13:11:21.773718 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 13:11:21.824789 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 13:11:21.857209 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 13:11:21.863847 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 13:11:22.404236 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 13:11:22.409387 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 13:11:22.419692 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 13:11:22.466683 tst mo_mt_sms.py: using LAC 41124 13:11:22.583483 tst mo_mt_sms.py: using RAC 69 13:11:22.700345 tst mo_mt_sms.py: using CellId 41124 13:11:22.816392 tst mo_mt_sms.py: using BVCI 41125 13:11:22.922939 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 13:11:23.039069 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 13:11:23.152547 tst mo_mt_sms.py:9: start nitb and bts... 13:11:23.351787 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:11:23.955628 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25684): Launched 13:11:24.251652 run osmo-nitb_10.42.42.2(pid=25685): Launched 13:11:24.414919 run osmo-nitb_10.42.42.2(pid=25685): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25685)] 13:11:24.548519 run osmo-nitb_10.42.42.2(pid=25685): stdout: | (launched: 2022-12-14_13:11:24.196886) 13:11:24.682917 run osmo-nitb_10.42.42.2(pid=25685): stderr: | (launched: 2022-12-14_13:11:24.241582) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:11:24.817503 run osmo-nitb_10.42.42.2(pid=25685): stdout: | (launched: 2022-12-14_13:11:24.196886) 13:11:24.946295 run osmo-nitb_10.42.42.2(pid=25685): stderr: | (launched: 2022-12-14_13:11:24.241582) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25685): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25685) [trial-2405↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25685)] 13:11:25.363111 tst osmo-nitb_10.42.42.2(pid=25685): stdout: | (launched: 2022-12-14_13:11:24.196886) 13:11:25.482460 tst osmo-nitb_10.42.42.2(pid=25685): stderr: | (launched: 2022-12-14_13:11:24.241582) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:11:25.623369 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=25685): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25685) [trial-2405↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25685)] [trial-2405↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 13:11:25.631853 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 13:11:25.638530 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25684): Terminating (SIGTERM) 13:11:25.847331 --- ParallelTerminationStrategy: PID 25684 died... 13:11:25.868629 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25684): Terminated: ok {rc=0} 13:11:25.952278 bus /sierra_3: Setting Powered False 13:11:27.048571 bus /sierra_3: Setting Powered False 13:11:28.162606 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 sms:trx-b200 --------------------------------------------------------------------- 13:11:29.362436 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:29.366366 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 13:11:29.398688 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:11:29.425071 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 13:11:29.473879 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 13:11:29.506170 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:11:29.532771 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 13:11:30.083238 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 13:11:30.088861 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:30.099820 tst sms:trx-b200: Using 1 x bts (candidates: 1) 13:11:30.149427 tst mo_mt_sms.py: using LAC 41125 13:11:30.265270 tst mo_mt_sms.py: using RAC 70 13:11:30.379181 tst mo_mt_sms.py: using CellId 41125 13:11:30.493385 tst mo_mt_sms.py: using BVCI 41126 13:11:30.600062 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:30.610628 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:30.620849 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:30.631085 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:30.641280 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:30.651413 tst sms:trx-b200: Using 1 x modem (candidates: 2) 13:11:30.762658 tst sms:trx-b200: Using 1 x modem (candidates: 2) 13:11:30.887282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:31.372818 run create_hlr_db(pid=25689): Launched 13:11:31.508914 bus /sierra_2: Setting Powered False 13:11:32.568438 run create_hlr_db(pid=25689): Terminated: ok {rc=0} 13:11:32.982726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25691): Launched 13:11:33.277684 run osmo-hlr_10.42.42.2(pid=25692): Launched 13:11:33.389897 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:33.895903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25694): Launched 13:11:34.189178 run osmo-stp_10.42.42.5(pid=25695): Launched 13:11:34.301071 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:34.834149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25697): Launched 13:11:35.127865 run osmo-msc_10.42.42.6(pid=25698): Launched 13:11:35.292695 run osmo-stp_10.42.42.5(pid=25695): ERR: Terminated: ERROR {rc=1} [trial-2405↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25695)] 13:11:35.417273 run osmo-stp_10.42.42.5(pid=25695): stdout: | (launched: 2022-12-14_13:11:34.135352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:35.542113 run osmo-stp_10.42.42.5(pid=25695): stderr: | 20221214131134304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131134305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131134305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131134305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131134307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131134308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131134308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:35.664576 run osmo-stp_10.42.42.5(pid=25695): stdout: | (launched: 2022-12-14_13:11:34.135352) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:35.781891 run osmo-stp_10.42.42.5(pid=25695): stderr: | 20221214131134304 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131134305 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131134305 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131134305 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131134307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131134308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131134308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:35.922207 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=25695): Process ended prematurely: osmo-stp_10.42.42.5(pid=25695) [trial-2405↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25695)] [trial-2405↪sms:trx-b200↪mo_mt_sms.py:16] 13:11:35.930201 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 13:11:35.955782 run osmo-hlr_10.42.42.2(pid=25692): ERR: Terminated: ERROR {rc=237} [trial-2405↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25692)] 13:11:36.003499 run osmo-hlr_10.42.42.2(pid=25692): stdout: | (launched: 2022-12-14_13:11:33.223381) 13:11:36.053166 run osmo-hlr_10.42.42.2(pid=25692): stderr: | 20221214131133395 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131133396 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131133396 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131133396 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131133396 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131133396 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131133408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131133416 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131133416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131133417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:36.122044 run osmo-msc_10.42.42.6(pid=25698): ERR: Terminated: ERROR {rc=2} [trial-2405↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25698)] 13:11:36.169566 run osmo-msc_10.42.42.6(pid=25698): stdout: | (launched: 2022-12-14_13:11:35.073642) 13:11:36.218733 run osmo-msc_10.42.42.6(pid=25698): stderr: | 20221214131135344 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131135344 DLGLOBAL DEBUG validating counter group 0x7f9c2095fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131135344 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131135344 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131135344 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131135344 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131135346 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131135347 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131135347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131135347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:36.268195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25691): Terminating (SIGTERM) 13:11:36.307562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25694): Terminating (SIGTERM) 13:11:36.347180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25697): Terminating (SIGTERM) 13:11:36.386910 --- ParallelTerminationStrategy: PID 25691 died... 13:11:36.406026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25691): Terminated: ok {rc=0} 13:11:36.449839 --- ParallelTerminationStrategy: PID 25694 died... 13:11:36.468249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25694): Terminated: ok {rc=0} 13:11:36.513656 --- ParallelTerminationStrategy: PID 25697 died... 13:11:36.532266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25697): Terminated: ok {rc=0} 13:11:36.615144 bus /sierra_3: Setting Powered False 13:11:37.714600 bus /sierra_3: Setting Powered False 13:11:38.833278 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-b200 --------------------------------------------------------------------- 13:11:40.059395 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:40.062960 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 13:11:40.095398 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 13:11:40.102031 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 13:11:40.139264 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 13:11:40.174271 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 13:11:40.181688 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 13:11:40.695378 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 13:11:40.701336 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 13:11:40.712378 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 13:11:40.759415 tst assert_extension.py: using LAC 41126 13:11:40.875373 tst assert_extension.py: using RAC 71 13:11:40.991090 tst assert_extension.py: using CellId 41126 13:11:41.106805 tst assert_extension.py: using BVCI 41127 13:11:41.213251 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 13:11:41.329640 tst assert_extension.py:10: start nitb and bts... 13:11:41.542876 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:11:42.188410 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25703): Launched 13:11:42.485708 run osmo-nitb_10.42.42.2(pid=25704): Launched 13:11:42.649496 run osmo-nitb_10.42.42.2(pid=25704): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25704)] 13:11:42.782459 run osmo-nitb_10.42.42.2(pid=25704): stdout: | (launched: 2022-12-14_13:11:42.431225) 13:11:42.916159 run osmo-nitb_10.42.42.2(pid=25704): stderr: | (launched: 2022-12-14_13:11:42.475628) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:11:43.050037 run osmo-nitb_10.42.42.2(pid=25704): stdout: | (launched: 2022-12-14_13:11:42.431225) 13:11:43.178543 run osmo-nitb_10.42.42.2(pid=25704): stderr: | (launched: 2022-12-14_13:11:42.475628) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=25704): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25704) [trial-2405↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25704)] 13:11:43.597741 tst osmo-nitb_10.42.42.2(pid=25704): stdout: | (launched: 2022-12-14_13:11:42.431225) 13:11:43.716309 tst osmo-nitb_10.42.42.2(pid=25704): stderr: | (launched: 2022-12-14_13:11:42.475628) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:11:43.856306 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=25704): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25704) [trial-2405↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25704)] [trial-2405↪nitb_ussd:trx-b200↪assert_extension.py:12] 13:11:43.864509 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:11:43.870989 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25703): Terminating (SIGTERM) 13:11:44.079536 --- ParallelTerminationStrategy: PID 25703 died... 13:11:44.100237 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=25703): Terminated: ok {rc=0} 13:11:44.183249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 ussd:trx-b200 --------------------------------------------------------------------- 13:11:45.354617 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:45.358381 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 13:11:45.390618 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:11:45.416923 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 13:11:45.451162 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 13:11:45.483465 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:11:45.509432 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 13:11:46.042511 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 ussd:trx-b200 assert_extension.py ---------------------------------------------- 13:11:46.055392 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:46.071613 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 13:11:46.122483 tst assert_extension.py: using LAC 41127 13:11:46.238737 tst assert_extension.py: using RAC 72 13:11:46.394052 tst assert_extension.py: using CellId 41127 13:11:46.519500 tst assert_extension.py: using BVCI 41128 13:11:46.637790 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:46.649704 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:46.661625 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:46.673774 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:46.686454 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 13:11:46.699227 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 13:11:46.814872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:47.283802 run create_hlr_db(pid=25708): Launched 13:11:47.403720 bus /sierra_2: Setting Powered False 13:11:48.462301 run create_hlr_db(pid=25708): Terminated: ok {rc=0} 13:11:48.874906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25710): Launched 13:11:49.168783 run osmo-hlr_10.42.42.2(pid=25711): Launched 13:11:49.279892 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:49.797915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25713): Launched 13:11:50.092520 run osmo-stp_10.42.42.5(pid=25714): Launched 13:11:50.204704 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:50.737309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25716): Launched 13:11:51.031837 run osmo-msc_10.42.42.6(pid=25717): Launched 13:11:51.197126 run osmo-stp_10.42.42.5(pid=25714): ERR: Terminated: ERROR {rc=1} [trial-2405↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25714)] 13:11:51.321601 run osmo-stp_10.42.42.5(pid=25714): stdout: | (launched: 2022-12-14_13:11:50.037902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:51.446674 run osmo-stp_10.42.42.5(pid=25714): stderr: | 20221214131150206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131150206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131150206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131150207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131150209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131150209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131150209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:51.569709 run osmo-stp_10.42.42.5(pid=25714): stdout: | (launched: 2022-12-14_13:11:50.037902) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:11:51.687260 run osmo-stp_10.42.42.5(pid=25714): stderr: | 20221214131150206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131150206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131150206 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131150207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131150209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131150209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131150209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:11:51.827703 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=25714): Process ended prematurely: osmo-stp_10.42.42.5(pid=25714) [trial-2405↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25714)] [trial-2405↪ussd:trx-b200↪assert_extension.py:17] 13:11:51.835860 tst assert_extension.py:17: Test FAILED (5.8 sec) 13:11:51.862054 run osmo-hlr_10.42.42.2(pid=25711): ERR: Terminated: ERROR {rc=237} [trial-2405↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25711)] 13:11:51.910051 run osmo-hlr_10.42.42.2(pid=25711): stdout: | (launched: 2022-12-14_13:11:49.114808) 13:11:51.959712 run osmo-hlr_10.42.42.2(pid=25711): stderr: | 20221214131149289 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131149289 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131149289 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131149289 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131149289 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131149289 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131149301 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131149310 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131149310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131149310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:11:52.028281 run osmo-msc_10.42.42.6(pid=25717): ERR: Terminated: ERROR {rc=2} [trial-2405↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25717)] 13:11:52.076138 run osmo-msc_10.42.42.6(pid=25717): stdout: | (launched: 2022-12-14_13:11:50.977542) 13:11:52.125400 run osmo-msc_10.42.42.6(pid=25717): stderr: | 20221214131151250 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131151250 DLGLOBAL DEBUG validating counter group 0x7f84c6118c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131151250 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131151250 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131151250 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131151251 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131151252 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131151253 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131151253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131151253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:11:52.175082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25710): Terminating (SIGTERM) 13:11:52.214569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25713): Terminating (SIGTERM) 13:11:52.254253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25716): Terminating (SIGTERM) 13:11:52.293891 --- ParallelTerminationStrategy: PID 25710 died... 13:11:52.313066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25710): Terminated: ok {rc=0} 13:11:52.356673 --- ParallelTerminationStrategy: PID 25713 died... 13:11:52.375258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25713): Terminated: ok {rc=0} 13:11:52.418836 --- ParallelTerminationStrategy: PID 25716 died... 13:11:52.437520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25716): Terminated: ok {rc=0} 13:11:52.523957 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:11:53.738221 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:11:53.745163 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:11:53.779687 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:11:53.807030 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:11:53.859702 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:11:53.894159 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:11:53.921505 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:11:54.471984 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:11:54.525761 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:11:54.537370 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:11:54.607492 tst mo_mt_call.py: using LAC 41128 13:11:54.736695 tst mo_mt_call.py: using RAC 73 13:11:54.855606 tst mo_mt_call.py: using CellId 41128 13:11:54.972162 tst mo_mt_call.py: using BVCI 41129 13:11:55.080306 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:11:55.091233 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:11:55.101979 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:11:55.112595 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:11:55.123373 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:11:55.134030 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:11:55.253188 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:11:55.367516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:11:55.833022 run create_hlr_db(pid=25722): Launched 13:11:55.955049 bus /sierra_2: Setting Powered False 13:11:57.015967 run create_hlr_db(pid=25722): Terminated: ok {rc=0} 13:11:57.456291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25724): Launched 13:11:57.779782 run osmo-hlr_10.42.42.2(pid=25725): Launched 13:11:57.902418 run osmo-stp_10.42.42.5: Starting osmo-stp 13:11:58.456769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25727): Launched 13:11:58.778103 run osmo-stp_10.42.42.5(pid=25728): Launched 13:11:58.900576 run osmo-msc_10.42.42.6: Starting osmo-msc 13:11:59.480045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25730): Launched 13:11:59.781110 run osmo-msc_10.42.42.6(pid=25731): Launched 13:11:59.949214 run osmo-stp_10.42.42.5(pid=25728): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25728)] 13:12:00.076328 run osmo-stp_10.42.42.5(pid=25728): stdout: | (launched: 2022-12-14_13:11:58.720280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:00.203842 run osmo-stp_10.42.42.5(pid=25728): stderr: | 20221214131158912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131158912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131158912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131158913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131158913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131158913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131158913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:00.329098 run osmo-stp_10.42.42.5(pid=25728): stdout: | (launched: 2022-12-14_13:11:58.720280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:00.448820 run osmo-stp_10.42.42.5(pid=25728): stderr: | 20221214131158912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131158912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131158912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131158913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131158913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131158913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131158913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:00.592736 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25728): Process ended prematurely: osmo-stp_10.42.42.5(pid=25728) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25728)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:12:00.601608 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:12:00.627837 run osmo-hlr_10.42.42.2(pid=25725): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25725)] 13:12:00.675679 run osmo-hlr_10.42.42.2(pid=25725): stdout: | (launched: 2022-12-14_13:11:57.721426) 13:12:00.725375 run osmo-hlr_10.42.42.2(pid=25725): stderr: | 20221214131157921 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131157921 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131157921 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131157921 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131157921 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131157921 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131157931 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131157939 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131157939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131157939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:00.794565 run osmo-msc_10.42.42.6(pid=25731): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25731)] 13:12:00.843089 run osmo-msc_10.42.42.6(pid=25731): stdout: | (launched: 2022-12-14_13:11:59.726375) 13:12:00.893374 run osmo-msc_10.42.42.6(pid=25731): stderr: | 20221214131159998 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131159998 DLGLOBAL DEBUG validating counter group 0x7f1be2b25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131159998 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131159998 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131159999 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131159999 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131200001 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131200001 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131200001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131200001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:00.944237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25724): Terminating (SIGTERM) 13:12:00.985108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25727): Terminating (SIGTERM) 13:12:01.027726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25730): Terminating (SIGTERM) 13:12:01.070702 --- ParallelTerminationStrategy: PID 25724 died... 13:12:01.090023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25724): Terminated: ok {rc=0} 13:12:01.134919 --- ParallelTerminationStrategy: PID 25727 died... 13:12:01.153861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25727): Terminated: ok {rc=0} 13:12:01.198451 --- ParallelTerminationStrategy: PID 25730 died... 13:12:01.217525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25730): Terminated: ok {rc=0} 13:12:01.302636 bus /sierra_3: Setting Powered False 13:12:02.400384 bus /sierra_3: Setting Powered False 13:12:03.517962 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:12:04.668082 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:04.681311 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:12:04.753696 tst mo_mt_call_osmux.py: using LAC 41129 13:12:04.873701 tst mo_mt_call_osmux.py: using RAC 74 13:12:04.991353 tst mo_mt_call_osmux.py: using CellId 41129 13:12:05.111013 tst mo_mt_call_osmux.py: using BVCI 41130 13:12:05.221185 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:05.232307 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:05.243261 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:05.253990 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:05.264799 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:12:05.275538 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:12:05.395240 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:12:05.512077 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:05.977727 run create_hlr_db(pid=25733): Launched 13:12:06.100760 bus /sierra_2: Setting Powered False 13:12:07.161441 run create_hlr_db(pid=25733): Terminated: ok {rc=0} 13:12:07.602211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25735): Launched 13:12:07.923382 run osmo-hlr_10.42.42.2(pid=25736): Launched 13:12:08.045690 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:08.601586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25738): Launched 13:12:08.923649 run osmo-stp_10.42.42.5(pid=25739): Launched 13:12:09.046450 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:09.632091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25741): Launched 13:12:09.953457 run osmo-msc_10.42.42.6(pid=25742): Launched 13:12:10.132706 run osmo-stp_10.42.42.5(pid=25739): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25739)] 13:12:10.268759 run osmo-stp_10.42.42.5(pid=25739): stdout: | (launched: 2022-12-14_13:12:08.865398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:10.405642 run osmo-stp_10.42.42.5(pid=25739): stderr: | 20221214131209056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131209056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131209056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131209057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131209057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131209058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131209058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:10.541971 run osmo-stp_10.42.42.5(pid=25739): stdout: | (launched: 2022-12-14_13:12:08.865398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:10.670881 run osmo-stp_10.42.42.5(pid=25739): stderr: | 20221214131209056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131209056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131209056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131209057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131209057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131209058 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131209058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:10.824710 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25739): Process ended prematurely: osmo-stp_10.42.42.5(pid=25739) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25739)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:12:10.834425 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:12:10.862041 run osmo-hlr_10.42.42.2(pid=25736): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25736)] 13:12:10.912836 run osmo-hlr_10.42.42.2(pid=25736): stdout: | (launched: 2022-12-14_13:12:07.865414) 13:12:10.964871 run osmo-hlr_10.42.42.2(pid=25736): stderr: | 20221214131208062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131208062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131208062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131208062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131208062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131208062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131208074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131208082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131208082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131208082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:11.037395 run osmo-msc_10.42.42.6(pid=25742): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25742)] 13:12:11.087641 run osmo-msc_10.42.42.6(pid=25742): stdout: | (launched: 2022-12-14_13:12:09.895103) 13:12:11.139567 run osmo-msc_10.42.42.6(pid=25742): stderr: | 20221214131210213 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131210213 DLGLOBAL DEBUG validating counter group 0x7f5b7e5fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131210214 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131210214 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131210214 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131210214 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131210216 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131210216 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131210216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131210216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:11.191788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25735): Terminating (SIGTERM) 13:12:11.233850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25738): Terminating (SIGTERM) 13:12:11.275600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25741): Terminating (SIGTERM) 13:12:11.318384 --- ParallelTerminationStrategy: PID 25735 died... 13:12:11.338676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25735): Terminated: ok {rc=0} 13:12:11.385317 --- ParallelTerminationStrategy: PID 25738 died... 13:12:11.405286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25738): Terminated: ok {rc=0} 13:12:11.451554 --- ParallelTerminationStrategy: PID 25741 died... 13:12:11.471514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25741): Terminated: ok {rc=0} 13:12:11.559635 bus /sierra_3: Setting Powered False 13:12:12.657300 bus /sierra_3: Setting Powered False 13:12:13.772809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:12:15.022414 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:12:15.029408 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:12:15.063012 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:12:15.090713 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:12:15.147487 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:12:15.180110 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:12:15.207313 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:12:15.756305 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:12:15.809469 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:15.820820 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:12:15.895880 tst mo_mt_call.py: using LAC 41130 13:12:16.031158 tst mo_mt_call.py: using RAC 75 13:12:16.158820 tst mo_mt_call.py: using CellId 41130 13:12:16.291539 tst mo_mt_call.py: using BVCI 41131 13:12:16.416865 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:16.429044 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:16.440865 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:16.452787 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:16.465085 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:16.477268 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:12:16.597689 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:12:16.736577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:17.252079 run create_hlr_db(pid=25747): Launched 13:12:17.378216 bus /sierra_2: Setting Powered False 13:12:18.437911 run create_hlr_db(pid=25747): Terminated: ok {rc=0} 13:12:18.879494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25749): Launched 13:12:19.201671 run osmo-hlr_10.42.42.2(pid=25750): Launched 13:12:19.325505 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:19.878636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25752): Launched 13:12:20.200371 run osmo-stp_10.42.42.5(pid=25753): Launched 13:12:20.323221 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:20.903783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25755): Launched 13:12:21.224852 run osmo-msc_10.42.42.6(pid=25756): Launched 13:12:21.403669 run osmo-stp_10.42.42.5(pid=25753): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25753)] 13:12:21.539959 run osmo-stp_10.42.42.5(pid=25753): stdout: | (launched: 2022-12-14_13:12:20.141917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:21.676711 run osmo-stp_10.42.42.5(pid=25753): stderr: | 20221214131220333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131220333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131220333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131220334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131220334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131220334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131220334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:21.812416 run osmo-stp_10.42.42.5(pid=25753): stdout: | (launched: 2022-12-14_13:12:20.141917) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:21.941544 run osmo-stp_10.42.42.5(pid=25753): stderr: | 20221214131220333 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131220333 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131220333 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131220334 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131220334 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131220334 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131220334 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:22.095788 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25753): Process ended prematurely: osmo-stp_10.42.42.5(pid=25753) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25753)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:12:22.105252 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:12:22.132591 run osmo-hlr_10.42.42.2(pid=25750): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25750)] 13:12:22.182721 run osmo-hlr_10.42.42.2(pid=25750): stdout: | (launched: 2022-12-14_13:12:19.143575) 13:12:22.234231 run osmo-hlr_10.42.42.2(pid=25750): stderr: | 20221214131219340 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131219340 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131219340 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131219340 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131219340 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131219340 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131219393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131219403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131219403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131219403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:22.306260 run osmo-msc_10.42.42.6(pid=25756): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25756)] 13:12:22.355762 run osmo-msc_10.42.42.6(pid=25756): stdout: | (launched: 2022-12-14_13:12:21.166885) 13:12:22.407143 run osmo-msc_10.42.42.6(pid=25756): stderr: | 20221214131221489 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131221489 DLGLOBAL DEBUG validating counter group 0x7f0c31371c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131221489 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131221489 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131221489 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131221490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131221491 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131221491 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131221492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131221492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:22.458648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25749): Terminating (SIGTERM) 13:12:22.500413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25752): Terminating (SIGTERM) 13:12:22.543105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25755): Terminating (SIGTERM) 13:12:22.585238 --- ParallelTerminationStrategy: PID 25749 died... 13:12:22.605383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25749): Terminated: ok {rc=0} 13:12:22.651641 --- ParallelTerminationStrategy: PID 25752 died... 13:12:22.671176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25752): Terminated: ok {rc=0} 13:12:22.717771 --- ParallelTerminationStrategy: PID 25755 died... 13:12:22.737648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25755): Terminated: ok {rc=0} 13:12:22.826185 bus /sierra_3: Setting Powered False 13:12:23.923917 bus /sierra_3: Setting Powered False 13:12:25.039546 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:12:26.188866 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:26.201241 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:12:26.273391 tst mo_mt_call_osmux.py: using LAC 41131 13:12:26.402454 tst mo_mt_call_osmux.py: using RAC 76 13:12:26.529894 tst mo_mt_call_osmux.py: using CellId 41131 13:12:26.649301 tst mo_mt_call_osmux.py: using BVCI 41132 13:12:26.758741 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:26.769838 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:26.780716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:26.791519 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:26.802978 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:12:26.814267 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:12:26.931734 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:12:27.051700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:27.550879 run create_hlr_db(pid=25758): Launched 13:12:27.675253 bus /sierra_2: Setting Powered False 13:12:28.738651 run create_hlr_db(pid=25758): Terminated: ok {rc=0} 13:12:29.188347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25760): Launched 13:12:29.511213 run osmo-hlr_10.42.42.2(pid=25761): Launched 13:12:29.635208 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:30.190521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25763): Launched 13:12:30.510859 run osmo-stp_10.42.42.5(pid=25764): Launched 13:12:30.634988 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:31.257688 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25766): Launched 13:12:31.596064 run osmo-msc_10.42.42.6(pid=25767): Launched 13:12:31.885060 run osmo-stp_10.42.42.5(pid=25764): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25764)] 13:12:32.186605 run osmo-stp_10.42.42.5(pid=25764): stdout: | (launched: 2022-12-14_13:12:30.452653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:32.364327 run osmo-stp_10.42.42.5(pid=25764): stderr: | 20221214131230646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131230646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131230646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131230646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131230647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131230647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131230647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:32.493154 run osmo-stp_10.42.42.5(pid=25764): stdout: | (launched: 2022-12-14_13:12:30.452653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:32.613778 run osmo-stp_10.42.42.5(pid=25764): stderr: | 20221214131230646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131230646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131230646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131230646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131230647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131230647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131230647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:32.758396 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25764): Process ended prematurely: osmo-stp_10.42.42.5(pid=25764) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25764)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:12:32.767600 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:12:32.794145 run osmo-hlr_10.42.42.2(pid=25761): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25761)] 13:12:32.843801 run osmo-hlr_10.42.42.2(pid=25761): stdout: | (launched: 2022-12-14_13:12:29.452754) 13:12:32.893891 run osmo-hlr_10.42.42.2(pid=25761): stderr: | 20221214131229650 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131229650 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131229650 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131229650 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131229650 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131229650 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131229663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131229672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131229672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131229672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:32.963921 run osmo-msc_10.42.42.6(pid=25767): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25767)] 13:12:33.011851 run osmo-msc_10.42.42.6(pid=25767): stdout: | (launched: 2022-12-14_13:12:31.531152) 13:12:33.061941 run osmo-msc_10.42.42.6(pid=25767): stderr: | 20221214131231981 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131231981 DLGLOBAL DEBUG validating counter group 0x7f5daebb8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131231981 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131231981 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131231982 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131231982 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131231983 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131231984 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131231984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131231984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:33.113083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25760): Terminating (SIGTERM) 13:12:33.153572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25763): Terminating (SIGTERM) 13:12:33.194040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25766): Terminating (SIGTERM) 13:12:33.234590 --- ParallelTerminationStrategy: PID 25760 died... 13:12:33.254349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25760): Terminated: ok {rc=0} 13:12:33.299201 --- ParallelTerminationStrategy: PID 25763 died... 13:12:33.318660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25763): Terminated: ok {rc=0} 13:12:33.363073 --- ParallelTerminationStrategy: PID 25766 died... 13:12:33.382279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25766): Terminated: ok {rc=0} 13:12:33.469396 bus /sierra_3: Setting Powered False 13:12:34.568017 bus /sierra_3: Setting Powered False 13:12:35.682678 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:12:36.938256 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:12:36.945879 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:12:36.978214 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:12:37.004746 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:12:37.054967 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:12:37.087090 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:12:37.113723 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:12:37.664461 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:12:37.713360 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:37.724324 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:12:37.792506 tst mo_mt_call.py: using LAC 41132 13:12:37.911088 tst mo_mt_call.py: using RAC 77 13:12:38.032204 tst mo_mt_call.py: using CellId 41132 13:12:38.157617 tst mo_mt_call.py: using BVCI 41133 13:12:38.266873 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:38.277887 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:38.288544 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:38.299187 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:38.309883 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:38.321490 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:12:38.441461 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:12:38.557314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:39.023244 run create_hlr_db(pid=25772): Launched 13:12:39.147017 bus /sierra_2: Setting Powered False 13:12:40.206642 run create_hlr_db(pid=25772): Terminated: ok {rc=0} 13:12:40.649071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25774): Launched 13:12:40.971244 run osmo-hlr_10.42.42.2(pid=25775): Launched 13:12:41.094125 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:41.651154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25777): Launched 13:12:41.973085 run osmo-stp_10.42.42.5(pid=25778): Launched 13:12:42.096860 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:42.680311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25780): Launched 13:12:43.002926 run osmo-msc_10.42.42.6(pid=25781): Launched 13:12:43.183946 run osmo-stp_10.42.42.5(pid=25778): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25778)] 13:12:43.320923 run osmo-stp_10.42.42.5(pid=25778): stdout: | (launched: 2022-12-14_13:12:41.914878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:43.457661 run osmo-stp_10.42.42.5(pid=25778): stderr: | 20221214131242106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131242106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131242106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131242106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131242107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131242107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131242107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:43.594497 run osmo-stp_10.42.42.5(pid=25778): stdout: | (launched: 2022-12-14_13:12:41.914878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:43.723811 run osmo-stp_10.42.42.5(pid=25778): stderr: | 20221214131242106 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131242106 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131242106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131242106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131242107 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131242107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131242107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:43.878391 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25778): Process ended prematurely: osmo-stp_10.42.42.5(pid=25778) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25778)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:12:43.887861 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:12:43.915494 run osmo-hlr_10.42.42.2(pid=25775): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25775)] 13:12:43.966285 run osmo-hlr_10.42.42.2(pid=25775): stdout: | (launched: 2022-12-14_13:12:40.913239) 13:12:44.018152 run osmo-hlr_10.42.42.2(pid=25775): stderr: | 20221214131241112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131241112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131241112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131241112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131241112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131241112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131241125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131241133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131241134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131241134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:44.090491 run osmo-msc_10.42.42.6(pid=25781): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25781)] 13:12:44.140161 run osmo-msc_10.42.42.6(pid=25781): stdout: | (launched: 2022-12-14_13:12:42.944307) 13:12:44.191841 run osmo-msc_10.42.42.6(pid=25781): stderr: | 20221214131243265 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131243266 DLGLOBAL DEBUG validating counter group 0x7f379e9a8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131243266 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131243266 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131243266 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131243266 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131243268 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131243268 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131243268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131243268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:44.243980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25774): Terminating (SIGTERM) 13:12:44.285929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25777): Terminating (SIGTERM) 13:12:44.327708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25780): Terminating (SIGTERM) 13:12:44.369971 --- ParallelTerminationStrategy: PID 25774 died... 13:12:44.390210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25774): Terminated: ok {rc=0} 13:12:44.436511 --- ParallelTerminationStrategy: PID 25777 died... 13:12:44.456817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25777): Terminated: ok {rc=0} 13:12:44.503457 --- ParallelTerminationStrategy: PID 25780 died... 13:12:44.523441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25780): Terminated: ok {rc=0} 13:12:44.611931 bus /sierra_3: Setting Powered False 13:12:45.709612 bus /sierra_3: Setting Powered False 13:12:46.838775 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:12:47.994638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:48.006216 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:12:48.074791 tst mo_mt_call_osmux.py: using LAC 41133 13:12:48.194015 tst mo_mt_call_osmux.py: using RAC 78 13:12:48.323214 tst mo_mt_call_osmux.py: using CellId 41133 13:12:48.451354 tst mo_mt_call_osmux.py: using BVCI 41134 13:12:48.568627 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:48.580125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:48.591608 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:48.602922 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:48.614570 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:12:48.626197 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:12:48.742735 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:12:48.857883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:12:49.324690 run create_hlr_db(pid=25783): Launched 13:12:49.448361 bus /sierra_2: Setting Powered False 13:12:50.509054 run create_hlr_db(pid=25783): Terminated: ok {rc=0} 13:12:50.929046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25785): Launched 13:12:51.230345 run osmo-hlr_10.42.42.2(pid=25786): Launched 13:12:51.344146 run osmo-stp_10.42.42.5: Starting osmo-stp 13:12:51.859278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25788): Launched 13:12:52.158522 run osmo-stp_10.42.42.5(pid=25789): Launched 13:12:52.271749 run osmo-msc_10.42.42.6: Starting osmo-msc 13:12:52.829634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25791): Launched 13:12:53.129615 run osmo-msc_10.42.42.6(pid=25792): Launched 13:12:53.298574 run osmo-stp_10.42.42.5(pid=25789): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25789)] 13:12:53.427144 run osmo-stp_10.42.42.5(pid=25789): stdout: | (launched: 2022-12-14_13:12:52.103760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:53.554201 run osmo-stp_10.42.42.5(pid=25789): stderr: | 20221214131252273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131252273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131252273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131252274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131252274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131252274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131252274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:53.678996 run osmo-stp_10.42.42.5(pid=25789): stdout: | (launched: 2022-12-14_13:12:52.103760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:12:53.798569 run osmo-stp_10.42.42.5(pid=25789): stderr: | 20221214131252273 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131252273 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131252273 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131252274 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131252274 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131252274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131252274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:12:53.941993 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25789): Process ended prematurely: osmo-stp_10.42.42.5(pid=25789) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25789)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:12:53.950534 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:12:53.976519 run osmo-hlr_10.42.42.2(pid=25786): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25786)] 13:12:54.023871 run osmo-hlr_10.42.42.2(pid=25786): stdout: | (launched: 2022-12-14_13:12:51.174948) 13:12:54.073085 run osmo-hlr_10.42.42.2(pid=25786): stderr: | 20221214131251353 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131251353 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131251353 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131251353 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131251353 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131251353 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131251366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131251376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131251376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131251377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:12:54.141605 run osmo-msc_10.42.42.6(pid=25792): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25792)] 13:12:54.188739 run osmo-msc_10.42.42.6(pid=25792): stdout: | (launched: 2022-12-14_13:12:53.074754) 13:12:54.237518 run osmo-msc_10.42.42.6(pid=25792): stderr: | 20221214131253346 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131253347 DLGLOBAL DEBUG validating counter group 0x7fa825235c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131253347 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131253347 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131253347 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131253347 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131253349 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131253349 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131253350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131253350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:12:54.286770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25785): Terminating (SIGTERM) 13:12:54.326679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25788): Terminating (SIGTERM) 13:12:54.366002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25791): Terminating (SIGTERM) 13:12:54.405536 --- ParallelTerminationStrategy: PID 25785 died... 13:12:54.424382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25785): Terminated: ok {rc=0} 13:12:54.467906 --- ParallelTerminationStrategy: PID 25788 died... 13:12:54.486321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25788): Terminated: ok {rc=0} 13:12:54.529547 --- ParallelTerminationStrategy: PID 25791 died... 13:12:54.548054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25791): Terminated: ok {rc=0} 13:12:54.633836 bus /sierra_3: Setting Powered False 13:12:55.732412 bus /sierra_3: Setting Powered False 13:12:56.846035 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:12:58.097342 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:12:58.104302 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:12:58.137603 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:12:58.165494 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:12:58.219543 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:12:58.254304 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:12:58.281551 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:12:58.831050 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:12:58.883475 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:12:58.894997 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:12:58.965497 tst mo_mt_call.py: using LAC 41134 13:12:59.091479 tst mo_mt_call.py: using RAC 79 13:12:59.217025 tst mo_mt_call.py: using CellId 41134 13:12:59.343202 tst mo_mt_call.py: using BVCI 41135 13:12:59.459850 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:12:59.471699 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:12:59.483074 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:12:59.494448 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:12:59.506284 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:12:59.517953 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:12:59.632824 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:12:59.751722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:00.252029 run create_hlr_db(pid=25797): Launched 13:13:00.375066 bus /sierra_2: Setting Powered False 13:13:01.437283 run create_hlr_db(pid=25797): Terminated: ok {rc=0} 13:13:01.905962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25799): Launched 13:13:02.235721 run osmo-hlr_10.42.42.2(pid=25800): Launched 13:13:02.360381 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:02.922051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25802): Launched 13:13:03.244879 run osmo-stp_10.42.42.5(pid=25803): Launched 13:13:03.369434 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:03.957221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25805): Launched 13:13:04.279832 run osmo-msc_10.42.42.6(pid=25806): Launched 13:13:04.460366 run osmo-stp_10.42.42.5(pid=25803): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25803)] 13:13:04.598561 run osmo-stp_10.42.42.5(pid=25803): stdout: | (launched: 2022-12-14_13:13:03.186871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:04.736857 run osmo-stp_10.42.42.5(pid=25803): stderr: | 20221214131303381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131303382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131303382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131303382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131303383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131303383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131303383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:04.873189 run osmo-stp_10.42.42.5(pid=25803): stdout: | (launched: 2022-12-14_13:13:03.186871) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:05.002607 run osmo-stp_10.42.42.5(pid=25803): stderr: | 20221214131303381 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131303382 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131303382 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131303382 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131303383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131303383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131303383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:05.156865 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25803): Process ended prematurely: osmo-stp_10.42.42.5(pid=25803) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25803)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:13:05.166537 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:13:05.194199 run osmo-hlr_10.42.42.2(pid=25800): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25800)] 13:13:05.244920 run osmo-hlr_10.42.42.2(pid=25800): stdout: | (launched: 2022-12-14_13:13:02.177642) 13:13:05.296748 run osmo-hlr_10.42.42.2(pid=25800): stderr: | 20221214131302374 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131302374 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131302374 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131302374 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131302374 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131302374 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131302392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131302401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131302401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131302402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:05.369100 run osmo-msc_10.42.42.6(pid=25806): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25806)] 13:13:05.418557 run osmo-msc_10.42.42.6(pid=25806): stdout: | (launched: 2022-12-14_13:13:04.221456) 13:13:05.470890 run osmo-msc_10.42.42.6(pid=25806): stderr: | 20221214131304540 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131304541 DLGLOBAL DEBUG validating counter group 0x7f4dc9843c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131304541 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131304541 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131304541 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131304541 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131304543 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131304543 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131304543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131304543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:05.523087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25799): Terminating (SIGTERM) 13:13:05.565040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25802): Terminating (SIGTERM) 13:13:05.607085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25805): Terminating (SIGTERM) 13:13:05.649229 --- ParallelTerminationStrategy: PID 25799 died... 13:13:05.669619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25799): Terminated: ok {rc=0} 13:13:05.716041 --- ParallelTerminationStrategy: PID 25802 died... 13:13:05.735754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25802): Terminated: ok {rc=0} 13:13:05.782223 --- ParallelTerminationStrategy: PID 25805 died... 13:13:05.802120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25805): Terminated: ok {rc=0} 13:13:05.890692 bus /sierra_3: Setting Powered False 13:13:06.989325 bus /sierra_3: Setting Powered False 13:13:08.107701 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:13:09.252459 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:09.264050 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:13:09.330606 tst mo_mt_call_osmux.py: using LAC 41135 13:13:09.448484 tst mo_mt_call_osmux.py: using RAC 80 13:13:09.565404 tst mo_mt_call_osmux.py: using CellId 41135 13:13:09.692241 tst mo_mt_call_osmux.py: using BVCI 41136 13:13:09.811371 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:09.823056 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:09.834534 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:09.845932 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:09.857724 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:13:09.869470 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:13:09.987800 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:13:10.103529 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:10.569372 run create_hlr_db(pid=25808): Launched 13:13:10.692552 bus /sierra_2: Setting Powered False 13:13:11.751978 run create_hlr_db(pid=25808): Terminated: ok {rc=0} 13:13:12.173330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25810): Launched 13:13:12.474214 run osmo-hlr_10.42.42.2(pid=25811): Launched 13:13:12.589333 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:13.121335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25813): Launched 13:13:13.423066 run osmo-stp_10.42.42.5(pid=25814): Launched 13:13:13.537647 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:14.082591 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25816): Launched 13:13:14.382828 run osmo-msc_10.42.42.6(pid=25817): Launched 13:13:14.550760 run osmo-stp_10.42.42.5(pid=25814): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25814)] 13:13:14.678152 run osmo-stp_10.42.42.5(pid=25814): stdout: | (launched: 2022-12-14_13:13:13.367383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:14.805473 run osmo-stp_10.42.42.5(pid=25814): stderr: | 20221214131313539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131313539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131313539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131313540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131313540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131313540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131313540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:14.930609 run osmo-stp_10.42.42.5(pid=25814): stdout: | (launched: 2022-12-14_13:13:13.367383) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:15.050531 run osmo-stp_10.42.42.5(pid=25814): stderr: | 20221214131313539 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131313539 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131313539 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131313540 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131313540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131313540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131313540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:15.193896 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25814): Process ended prematurely: osmo-stp_10.42.42.5(pid=25814) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25814)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:13:15.202701 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:13:15.228717 run osmo-hlr_10.42.42.2(pid=25811): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25811)] 13:13:15.276672 run osmo-hlr_10.42.42.2(pid=25811): stdout: | (launched: 2022-12-14_13:13:12.419509) 13:13:15.326213 run osmo-hlr_10.42.42.2(pid=25811): stderr: | 20221214131312595 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131312595 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131312595 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131312595 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131312595 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131312595 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131312608 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131312617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131312617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131312617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:15.395458 run osmo-msc_10.42.42.6(pid=25817): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25817)] 13:13:15.443872 run osmo-msc_10.42.42.6(pid=25817): stdout: | (launched: 2022-12-14_13:13:14.327790) 13:13:15.493240 run osmo-msc_10.42.42.6(pid=25817): stderr: | 20221214131314599 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131314599 DLGLOBAL DEBUG validating counter group 0x7f473db90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131314599 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131314600 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131314600 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131314600 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131314602 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131314602 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131314602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131314602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:15.542899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25810): Terminating (SIGTERM) 13:13:15.582422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25813): Terminating (SIGTERM) 13:13:15.621984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25816): Terminating (SIGTERM) 13:13:15.661743 --- ParallelTerminationStrategy: PID 25810 died... 13:13:15.680841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25810): Terminated: ok {rc=0} 13:13:15.724917 --- ParallelTerminationStrategy: PID 25813 died... 13:13:15.743541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25813): Terminated: ok {rc=0} 13:13:15.787165 --- ParallelTerminationStrategy: PID 25816 died... 13:13:15.805749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25816): Terminated: ok {rc=0} 13:13:15.913982 bus /sierra_3: Setting Powered False 13:13:17.016720 bus /sierra_3: Setting Powered False 13:13:18.130671 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:13:19.385804 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:13:19.393210 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:13:19.427312 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:13:19.453769 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:13:19.504609 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:13:19.537443 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:13:19.563734 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:13:20.117490 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:13:20.170470 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:20.181897 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:13:20.256931 tst mo_mt_call.py: using LAC 41136 13:13:20.381900 tst mo_mt_call.py: using RAC 81 13:13:20.510484 tst mo_mt_call.py: using CellId 41136 13:13:20.639949 tst mo_mt_call.py: using BVCI 41137 13:13:20.757720 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:20.769165 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:20.780227 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:20.791434 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:20.803039 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:20.814616 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:13:20.933441 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:13:21.050413 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:21.517799 run create_hlr_db(pid=25822): Launched 13:13:21.642692 bus /sierra_2: Setting Powered False 13:13:22.702642 run create_hlr_db(pid=25822): Terminated: ok {rc=0} 13:13:23.123343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25824): Launched 13:13:23.424560 run osmo-hlr_10.42.42.2(pid=25825): Launched 13:13:23.539901 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:24.060345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25827): Launched 13:13:24.361228 run osmo-stp_10.42.42.5(pid=25828): Launched 13:13:24.475785 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:25.018587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25830): Launched 13:13:25.318252 run osmo-msc_10.42.42.6(pid=25831): Launched 13:13:25.484901 run osmo-stp_10.42.42.5(pid=25828): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25828)] 13:13:25.612450 run osmo-stp_10.42.42.5(pid=25828): stdout: | (launched: 2022-12-14_13:13:24.306031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:25.738737 run osmo-stp_10.42.42.5(pid=25828): stderr: | 20221214131324478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131324478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131324479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131324480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131324480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131324480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131324480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:25.863782 run osmo-stp_10.42.42.5(pid=25828): stdout: | (launched: 2022-12-14_13:13:24.306031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:25.983616 run osmo-stp_10.42.42.5(pid=25828): stderr: | 20221214131324478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131324478 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131324479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131324480 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131324480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131324480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131324480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:26.127154 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25828): Process ended prematurely: osmo-stp_10.42.42.5(pid=25828) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25828)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:13:26.136034 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:13:26.162190 run osmo-hlr_10.42.42.2(pid=25825): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25825)] 13:13:26.209528 run osmo-hlr_10.42.42.2(pid=25825): stdout: | (launched: 2022-12-14_13:13:23.369783) 13:13:26.258673 run osmo-hlr_10.42.42.2(pid=25825): stderr: | 20221214131323546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131323546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131323546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131323546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131323546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131323546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131323558 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131323567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131323567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131323567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:26.326788 run osmo-msc_10.42.42.6(pid=25831): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25831)] 13:13:26.373634 run osmo-msc_10.42.42.6(pid=25831): stdout: | (launched: 2022-12-14_13:13:25.263073) 13:13:26.422154 run osmo-msc_10.42.42.6(pid=25831): stderr: | 20221214131325534 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131325534 DLGLOBAL DEBUG validating counter group 0x7f3436384c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131325535 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131325535 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131325535 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131325535 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131325537 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131325537 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131325537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131325537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:26.471151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25824): Terminating (SIGTERM) 13:13:26.511130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25827): Terminating (SIGTERM) 13:13:26.550888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25830): Terminating (SIGTERM) 13:13:26.590535 --- ParallelTerminationStrategy: PID 25824 died... 13:13:26.609735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25824): Terminated: ok {rc=0} 13:13:26.653651 --- ParallelTerminationStrategy: PID 25827 died... 13:13:26.672443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25827): Terminated: ok {rc=0} 13:13:26.716633 --- ParallelTerminationStrategy: PID 25830 died... 13:13:26.735425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25830): Terminated: ok {rc=0} 13:13:26.821900 bus /sierra_3: Setting Powered False 13:13:27.922886 bus /sierra_3: Setting Powered False 13:13:29.038391 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:13:30.181358 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:30.193029 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:13:30.265210 tst mo_mt_call_osmux.py: using LAC 41137 13:13:30.383377 tst mo_mt_call_osmux.py: using RAC 82 13:13:30.504458 tst mo_mt_call_osmux.py: using CellId 41137 13:13:30.621648 tst mo_mt_call_osmux.py: using BVCI 41138 13:13:30.730728 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:30.741942 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:30.752711 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:30.763479 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:30.774596 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:13:30.785576 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:13:30.920284 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:13:31.039621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:31.526083 run create_hlr_db(pid=25833): Launched 13:13:31.685120 bus /sierra_2: Setting Powered False 13:13:32.749118 run create_hlr_db(pid=25833): Terminated: ok {rc=0} 13:13:33.193182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25835): Launched 13:13:33.495030 run osmo-hlr_10.42.42.2(pid=25836): Launched 13:13:33.610308 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:34.129066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25838): Launched 13:13:34.429942 run osmo-stp_10.42.42.5(pid=25839): Launched 13:13:34.544028 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:35.087878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25841): Launched 13:13:35.389968 run osmo-msc_10.42.42.6(pid=25842): Launched 13:13:35.557711 run osmo-stp_10.42.42.5(pid=25839): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25839)] 13:13:35.685458 run osmo-stp_10.42.42.5(pid=25839): stdout: | (launched: 2022-12-14_13:13:34.375073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:35.812429 run osmo-stp_10.42.42.5(pid=25839): stderr: | 20221214131334546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131334546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131334546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131334547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131334547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131334547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131334548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:35.938156 run osmo-stp_10.42.42.5(pid=25839): stdout: | (launched: 2022-12-14_13:13:34.375073) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:36.058367 run osmo-stp_10.42.42.5(pid=25839): stderr: | 20221214131334546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131334546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131334546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131334547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131334547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131334547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131334548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:36.202413 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25839): Process ended prematurely: osmo-stp_10.42.42.5(pid=25839) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25839)] [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:13:36.211360 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:13:36.237707 run osmo-hlr_10.42.42.2(pid=25836): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25836)] 13:13:36.285781 run osmo-hlr_10.42.42.2(pid=25836): stdout: | (launched: 2022-12-14_13:13:33.439910) 13:13:36.335398 run osmo-hlr_10.42.42.2(pid=25836): stderr: | 20221214131333617 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131333617 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131333617 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131333617 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131333617 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131333617 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131333634 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131333644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131333644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131333644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:36.404625 run osmo-msc_10.42.42.6(pid=25842): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25842)] 13:13:36.452086 run osmo-msc_10.42.42.6(pid=25842): stdout: | (launched: 2022-12-14_13:13:35.334879) 13:13:36.501157 run osmo-msc_10.42.42.6(pid=25842): stderr: | 20221214131335606 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131335606 DLGLOBAL DEBUG validating counter group 0x7f99ea404c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131335606 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131335606 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131335607 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131335607 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131335608 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131335609 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131335609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131335609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:36.550146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25835): Terminating (SIGTERM) 13:13:36.589781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25838): Terminating (SIGTERM) 13:13:36.629650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25841): Terminating (SIGTERM) 13:13:36.669821 --- ParallelTerminationStrategy: PID 25835 died... 13:13:36.689185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25835): Terminated: ok {rc=0} 13:13:36.733508 --- ParallelTerminationStrategy: PID 25838 died... 13:13:36.752372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25838): Terminated: ok {rc=0} 13:13:36.796399 --- ParallelTerminationStrategy: PID 25841 died... 13:13:36.815384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25841): Terminated: ok {rc=0} 13:13:36.899374 bus /sierra_3: Setting Powered False 13:13:37.998076 bus /sierra_3: Setting Powered False 13:13:39.114718 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:13:40.366745 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:13:40.373799 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:13:40.407831 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:13:40.437021 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:13:40.490415 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:13:40.523124 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:13:40.549301 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:13:41.102738 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:13:41.150947 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:41.162238 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:13:41.230091 tst mo_mt_call.py: using LAC 41138 13:13:41.347796 tst mo_mt_call.py: using RAC 83 13:13:41.476253 tst mo_mt_call.py: using CellId 41138 13:13:41.605196 tst mo_mt_call.py: using BVCI 41139 13:13:41.725266 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:41.736798 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:41.748397 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:41.759770 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:41.771536 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:41.783234 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:41.899607 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:42.017725 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:42.518130 run create_hlr_db(pid=25848): Launched 13:13:42.641376 bus /sierra_2: Setting Powered False 13:13:43.705071 run create_hlr_db(pid=25848): Terminated: ok {rc=0} 13:13:44.137025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25850): Launched 13:13:44.438562 run osmo-hlr_10.42.42.2(pid=25851): Launched 13:13:44.554077 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:45.090187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25853): Launched 13:13:45.389323 run osmo-stp_10.42.42.5(pid=25854): Launched 13:13:45.503151 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:46.086885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25856): Launched 13:13:46.402679 run osmo-msc_10.42.42.6(pid=25857): Launched 13:13:46.779471 run osmo-stp_10.42.42.5(pid=25854): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25854)] 13:13:46.936817 run osmo-stp_10.42.42.5(pid=25854): stdout: | (launched: 2022-12-14_13:13:45.334485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:47.201296 run osmo-stp_10.42.42.5(pid=25854): stderr: | 20221214131345504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131345504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131345504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131345505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131345507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131345507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131345507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:47.354813 run osmo-stp_10.42.42.5(pid=25854): stdout: | (launched: 2022-12-14_13:13:45.334485) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:47.475467 run osmo-stp_10.42.42.5(pid=25854): stderr: | 20221214131345504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131345504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131345504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131345505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131345507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131345507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131345507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:47.619690 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25854): Process ended prematurely: osmo-stp_10.42.42.5(pid=25854) [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25854)] [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:13:47.628456 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:13:47.654648 run osmo-hlr_10.42.42.2(pid=25851): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25851)] 13:13:47.702648 run osmo-hlr_10.42.42.2(pid=25851): stdout: | (launched: 2022-12-14_13:13:44.383556) 13:13:47.751932 run osmo-hlr_10.42.42.2(pid=25851): stderr: | 20221214131344562 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131344562 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131344562 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131344562 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131344562 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131344562 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131344574 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131344584 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131344585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131344585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:47.820719 run osmo-msc_10.42.42.6(pid=25857): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25857)] 13:13:47.868125 run osmo-msc_10.42.42.6(pid=25857): stdout: | (launched: 2022-12-14_13:13:46.340313) 13:13:47.917360 run osmo-msc_10.42.42.6(pid=25857): stderr: | 20221214131346852 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131346852 DLGLOBAL DEBUG validating counter group 0x7f6f431f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131346852 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131346852 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131346853 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131346853 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131346855 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131346855 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131346855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131346855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:47.967115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25850): Terminating (SIGTERM) 13:13:48.006463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25853): Terminating (SIGTERM) 13:13:48.046021 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25856): Terminating (SIGTERM) 13:13:48.085753 --- ParallelTerminationStrategy: PID 25850 died... 13:13:48.104901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25850): Terminated: ok {rc=0} 13:13:48.148825 --- ParallelTerminationStrategy: PID 25853 died... 13:13:48.167850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25853): Terminated: ok {rc=0} 13:13:48.211475 --- ParallelTerminationStrategy: PID 25856 died... 13:13:48.230122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25856): Terminated: ok {rc=0} 13:13:48.316548 bus /sierra_3: Setting Powered False 13:13:49.416759 bus /sierra_3: Setting Powered False 13:13:50.532824 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:13:51.681023 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:51.693600 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:13:51.765906 tst mo_mt_call_osmux.py: using LAC 41139 13:13:51.893402 tst mo_mt_call_osmux.py: using RAC 84 13:13:52.019591 tst mo_mt_call_osmux.py: using CellId 41139 13:13:52.147683 tst mo_mt_call_osmux.py: using BVCI 41140 13:13:52.264830 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:52.276894 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:52.288357 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:52.299828 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:52.311697 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:13:52.323546 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:52.440240 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:13:52.559428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:13:53.060580 run create_hlr_db(pid=25859): Launched 13:13:53.184114 bus /sierra_2: Setting Powered False 13:13:54.248320 run create_hlr_db(pid=25859): Terminated: ok {rc=0} 13:13:54.681938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25861): Launched 13:13:54.984047 run osmo-hlr_10.42.42.2(pid=25862): Launched 13:13:55.098633 run osmo-stp_10.42.42.5: Starting osmo-stp 13:13:55.631901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25864): Launched 13:13:55.933277 run osmo-stp_10.42.42.5(pid=25865): Launched 13:13:56.047523 run osmo-msc_10.42.42.6: Starting osmo-msc 13:13:56.592596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25867): Launched 13:13:56.894970 run osmo-msc_10.42.42.6(pid=25868): Launched 13:13:57.062670 run osmo-stp_10.42.42.5(pid=25865): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25865)] 13:13:57.190033 run osmo-stp_10.42.42.5(pid=25865): stdout: | (launched: 2022-12-14_13:13:55.878378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:57.317654 run osmo-stp_10.42.42.5(pid=25865): stderr: | 20221214131356049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131356049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131356049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131356050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131356050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131356050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131356051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:57.443364 run osmo-stp_10.42.42.5(pid=25865): stdout: | (launched: 2022-12-14_13:13:55.878378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:13:57.563395 run osmo-stp_10.42.42.5(pid=25865): stderr: | 20221214131356049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131356049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131356049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131356050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131356050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131356050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131356051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:13:57.707172 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25865): Process ended prematurely: osmo-stp_10.42.42.5(pid=25865) [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25865)] [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:13:57.715954 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:13:57.742578 run osmo-hlr_10.42.42.2(pid=25862): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25862)] 13:13:57.790327 run osmo-hlr_10.42.42.2(pid=25862): stdout: | (launched: 2022-12-14_13:13:54.928854) 13:13:57.839747 run osmo-hlr_10.42.42.2(pid=25862): stderr: | 20221214131355105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131355105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131355105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131355105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131355105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131355105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131355118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131355126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131355126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131355126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:13:57.908709 run osmo-msc_10.42.42.6(pid=25868): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25868)] 13:13:57.955987 run osmo-msc_10.42.42.6(pid=25868): stdout: | (launched: 2022-12-14_13:13:56.838809) 13:13:58.005112 run osmo-msc_10.42.42.6(pid=25868): stderr: | 20221214131357111 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131357111 DLGLOBAL DEBUG validating counter group 0x7f297ff1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131357112 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131357112 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131357112 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131357112 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131357114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131357114 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131357114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131357114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:13:58.054367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25861): Terminating (SIGTERM) 13:13:58.093681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25864): Terminating (SIGTERM) 13:13:58.133133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25867): Terminating (SIGTERM) 13:13:58.172550 --- ParallelTerminationStrategy: PID 25861 died... 13:13:58.191581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25861): Terminated: ok {rc=0} 13:13:58.235196 --- ParallelTerminationStrategy: PID 25864 died... 13:13:58.253728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25864): Terminated: ok {rc=0} 13:13:58.297252 --- ParallelTerminationStrategy: PID 25867 died... 13:13:58.315736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25867): Terminated: ok {rc=0} 13:13:58.400733 bus /sierra_3: Setting Powered False 13:13:59.499132 bus /sierra_3: Setting Powered False 13:14:00.615144 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:14:01.897852 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:01.906501 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:14:01.950328 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:14:01.982907 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:14:02.043044 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:14:02.078556 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:14:02.107842 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:14:02.651604 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:14:02.701064 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:02.711898 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:14:02.782395 tst mo_mt_call.py: using LAC 41140 13:14:02.900571 tst mo_mt_call.py: using RAC 85 13:14:03.028784 tst mo_mt_call.py: using CellId 41140 13:14:03.158496 tst mo_mt_call.py: using BVCI 41141 13:14:03.275262 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:03.286577 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:03.297645 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:03.308654 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:03.320128 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:03.331591 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:14:03.451243 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:14:03.568498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:04.034579 run create_hlr_db(pid=25873): Launched 13:14:04.158429 bus /sierra_2: Setting Powered False 13:14:05.219197 run create_hlr_db(pid=25873): Terminated: ok {rc=0} 13:14:05.662002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25875): Launched 13:14:05.984786 run osmo-hlr_10.42.42.2(pid=25876): Launched 13:14:06.107824 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:06.665700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25878): Launched 13:14:06.988802 run osmo-stp_10.42.42.5(pid=25879): Launched 13:14:07.112110 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:07.695372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25881): Launched 13:14:07.997614 run osmo-msc_10.42.42.6(pid=25882): Launched 13:14:08.165962 run osmo-stp_10.42.42.5(pid=25879): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25879)] 13:14:08.292526 run osmo-stp_10.42.42.5(pid=25879): stdout: | (launched: 2022-12-14_13:14:06.930445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:08.421197 run osmo-stp_10.42.42.5(pid=25879): stderr: | 20221214131407124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131407124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131407124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131407125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131407125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131407125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131407125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:08.546766 run osmo-stp_10.42.42.5(pid=25879): stdout: | (launched: 2022-12-14_13:14:06.930445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:08.667286 run osmo-stp_10.42.42.5(pid=25879): stderr: | 20221214131407124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131407124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131407124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131407125 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131407125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131407125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131407125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:08.811425 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25879): Process ended prematurely: osmo-stp_10.42.42.5(pid=25879) [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25879)] [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:14:08.820389 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:14:08.846778 run osmo-hlr_10.42.42.2(pid=25876): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25876)] 13:14:08.893957 run osmo-hlr_10.42.42.2(pid=25876): stdout: | (launched: 2022-12-14_13:14:05.926586) 13:14:08.942571 run osmo-hlr_10.42.42.2(pid=25876): stderr: | 20221214131406124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131406124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131406124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131406124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131406124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131406124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131406136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131406144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131406144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131406144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:09.011266 run osmo-msc_10.42.42.6(pid=25882): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25882)] 13:14:09.058687 run osmo-msc_10.42.42.6(pid=25882): stdout: | (launched: 2022-12-14_13:14:07.942692) 13:14:09.108009 run osmo-msc_10.42.42.6(pid=25882): stderr: | 20221214131408214 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131408215 DLGLOBAL DEBUG validating counter group 0x7fbf01cc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131408215 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131408215 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131408215 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131408215 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131408217 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131408217 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131408218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131408218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:09.157458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25875): Terminating (SIGTERM) 13:14:09.196865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25878): Terminating (SIGTERM) 13:14:09.236519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25881): Terminating (SIGTERM) 13:14:09.276484 --- ParallelTerminationStrategy: PID 25875 died... 13:14:09.295755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25875): Terminated: ok {rc=0} 13:14:09.340064 --- ParallelTerminationStrategy: PID 25878 died... 13:14:09.358824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25878): Terminated: ok {rc=0} 13:14:09.402678 --- ParallelTerminationStrategy: PID 25881 died... 13:14:09.421325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25881): Terminated: ok {rc=0} 13:14:09.507115 bus /sierra_3: Setting Powered False 13:14:10.606215 bus /sierra_3: Setting Powered False 13:14:11.721239 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:14:12.870271 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:12.882313 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:14:12.954849 tst mo_mt_call_osmux.py: using LAC 41141 13:14:13.081139 tst mo_mt_call_osmux.py: using RAC 86 13:14:13.207257 tst mo_mt_call_osmux.py: using CellId 41141 13:14:13.334342 tst mo_mt_call_osmux.py: using BVCI 41142 13:14:13.452545 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:13.464027 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:13.475218 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:13.486335 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:13.497863 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:14:13.509333 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:14:13.626902 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:14:13.746766 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:14.248522 run create_hlr_db(pid=25884): Launched 13:14:14.371256 bus /sierra_2: Setting Powered False 13:14:15.434926 run create_hlr_db(pid=25884): Terminated: ok {rc=0} 13:14:15.880504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25886): Launched 13:14:16.239839 run osmo-hlr_10.42.42.2(pid=25887): Launched 13:14:16.473144 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:17.138140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25889): Launched 13:14:17.455524 run osmo-stp_10.42.42.5(pid=25890): Launched 13:14:17.572165 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:18.119152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25892): Launched 13:14:18.421174 run osmo-msc_10.42.42.6(pid=25893): Launched 13:14:18.590417 run osmo-stp_10.42.42.5(pid=25890): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25890)] 13:14:18.717571 run osmo-stp_10.42.42.5(pid=25890): stdout: | (launched: 2022-12-14_13:14:17.400358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:18.844942 run osmo-stp_10.42.42.5(pid=25890): stderr: | 20221214131417571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131417571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131417571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131417572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131417572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131417572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131417572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:18.970383 run osmo-stp_10.42.42.5(pid=25890): stdout: | (launched: 2022-12-14_13:14:17.400358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:19.090756 run osmo-stp_10.42.42.5(pid=25890): stderr: | 20221214131417571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131417571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131417571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131417572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131417572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131417572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131417572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:19.234941 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25890): Process ended prematurely: osmo-stp_10.42.42.5(pid=25890) [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25890)] [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:14:19.243834 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:14:19.270064 run osmo-hlr_10.42.42.2(pid=25887): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25887)] 13:14:19.318277 run osmo-hlr_10.42.42.2(pid=25887): stdout: | (launched: 2022-12-14_13:14:16.169353) 13:14:19.367798 run osmo-hlr_10.42.42.2(pid=25887): stderr: | 20221214131416510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131416510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131416510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131416510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131416510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131416510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131416522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131416534 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131416535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131416535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:19.436892 run osmo-msc_10.42.42.6(pid=25893): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25893)] 13:14:19.484272 run osmo-msc_10.42.42.6(pid=25893): stdout: | (launched: 2022-12-14_13:14:18.366101) 13:14:19.533626 run osmo-msc_10.42.42.6(pid=25893): stderr: | 20221214131418639 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131418639 DLGLOBAL DEBUG validating counter group 0x7f69742b2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131418640 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131418640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131418640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131418640 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131418642 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131418642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131418642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131418642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:19.583358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25886): Terminating (SIGTERM) 13:14:19.622889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25889): Terminating (SIGTERM) 13:14:19.662577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25892): Terminating (SIGTERM) 13:14:19.702647 --- ParallelTerminationStrategy: PID 25886 died... 13:14:19.721819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25886): Terminated: ok {rc=0} 13:14:19.766069 --- ParallelTerminationStrategy: PID 25889 died... 13:14:19.785000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25889): Terminated: ok {rc=0} 13:14:19.829077 --- ParallelTerminationStrategy: PID 25892 died... 13:14:19.847825 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25892): Terminated: ok {rc=0} 13:14:19.932214 bus /sierra_3: Setting Powered False 13:14:21.030092 bus /sierra_3: Setting Powered False 13:14:22.146674 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 13:14:23.399639 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:23.405167 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 13:14:23.438257 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 13:14:23.465958 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 13:14:23.516196 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 13:14:23.549253 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 13:14:23.576165 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 13:14:24.128637 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 13:14:24.181279 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:24.192591 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 13:14:24.242798 tst mo_mt_call.py: using LAC 41142 13:14:24.359928 tst mo_mt_call.py: using RAC 87 13:14:24.476493 tst mo_mt_call.py: using CellId 41142 13:14:24.593281 tst mo_mt_call.py: using BVCI 41143 13:14:24.703966 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:24.714831 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:24.725504 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:24.736017 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:24.746611 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:24.757318 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:14:24.876486 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:14:24.992350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:25.459724 run create_hlr_db(pid=25898): Launched 13:14:25.582700 bus /sierra_2: Setting Powered False 13:14:26.643430 run create_hlr_db(pid=25898): Terminated: ok {rc=0} 13:14:27.085707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25900): Launched 13:14:27.408015 run osmo-hlr_10.42.42.2(pid=25901): Launched 13:14:27.531330 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:28.088649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25903): Launched 13:14:28.410390 run osmo-stp_10.42.42.5(pid=25904): Launched 13:14:28.533395 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:29.116758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25906): Launched 13:14:29.438138 run osmo-msc_10.42.42.6(pid=25907): Launched 13:14:29.618965 run osmo-stp_10.42.42.5(pid=25904): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25904)] 13:14:29.755892 run osmo-stp_10.42.42.5(pid=25904): stdout: | (launched: 2022-12-14_13:14:28.352008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:29.893261 run osmo-stp_10.42.42.5(pid=25904): stderr: | 20221214131428545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131428545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131428545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131428546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131428546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131428546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131428546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:30.029618 run osmo-stp_10.42.42.5(pid=25904): stdout: | (launched: 2022-12-14_13:14:28.352008) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:30.158937 run osmo-stp_10.42.42.5(pid=25904): stderr: | 20221214131428545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131428545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131428545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131428546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131428546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131428546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131428546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:30.313565 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25904): Process ended prematurely: osmo-stp_10.42.42.5(pid=25904) [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25904)] [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 13:14:30.323157 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:14:30.350503 run osmo-hlr_10.42.42.2(pid=25901): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25901)] 13:14:30.401280 run osmo-hlr_10.42.42.2(pid=25901): stdout: | (launched: 2022-12-14_13:14:27.349886) 13:14:30.453275 run osmo-hlr_10.42.42.2(pid=25901): stderr: | 20221214131427550 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131427550 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131427550 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131427550 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131427550 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131427550 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131427562 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131427570 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131427570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131427570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:30.525506 run osmo-msc_10.42.42.6(pid=25907): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25907)] 13:14:30.575275 run osmo-msc_10.42.42.6(pid=25907): stdout: | (launched: 2022-12-14_13:14:29.379684) 13:14:30.627315 run osmo-msc_10.42.42.6(pid=25907): stderr: | 20221214131429702 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131429702 DLGLOBAL DEBUG validating counter group 0x7fad9b98bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131429702 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131429702 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131429702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131429702 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131429704 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131429705 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131429705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131429705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:30.679552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25900): Terminating (SIGTERM) 13:14:30.721446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25903): Terminating (SIGTERM) 13:14:30.763648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25906): Terminating (SIGTERM) 13:14:30.806485 --- ParallelTerminationStrategy: PID 25900 died... 13:14:30.828001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25900): Terminated: ok {rc=0} 13:14:30.896521 --- ParallelTerminationStrategy: PID 25903 died... 13:14:30.933007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25903): Terminated: ok {rc=0} 13:14:30.979832 --- ParallelTerminationStrategy: PID 25906 died... 13:14:31.000762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25906): Terminated: ok {rc=0} 13:14:31.089673 bus /sierra_3: Setting Powered False 13:14:32.205747 bus /sierra_3: Setting Powered False 13:14:33.322725 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 13:14:34.471354 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:34.483354 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 13:14:34.535459 tst mo_mt_call_osmux.py: using LAC 41143 13:14:34.663702 tst mo_mt_call_osmux.py: using RAC 88 13:14:34.789859 tst mo_mt_call_osmux.py: using CellId 41143 13:14:34.916805 tst mo_mt_call_osmux.py: using BVCI 41144 13:14:35.033818 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:35.045171 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:35.056260 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:35.067481 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:35.078980 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 13:14:35.090438 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:14:35.209803 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 13:14:35.324680 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:35.794213 run create_hlr_db(pid=25909): Launched 13:14:35.918338 bus /sierra_2: Setting Powered False 13:14:36.978833 run create_hlr_db(pid=25909): Terminated: ok {rc=0} 13:14:37.421927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25911): Launched 13:14:37.747486 run osmo-hlr_10.42.42.2(pid=25912): Launched 13:14:37.871410 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:38.426506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25914): Launched 13:14:38.750417 run osmo-stp_10.42.42.5(pid=25915): Launched 13:14:38.873599 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:39.458973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25917): Launched 13:14:39.781647 run osmo-msc_10.42.42.6(pid=25918): Launched 13:14:39.960814 run osmo-stp_10.42.42.5(pid=25915): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25915)] 13:14:40.097607 run osmo-stp_10.42.42.5(pid=25915): stdout: | (launched: 2022-12-14_13:14:38.691441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:40.234766 run osmo-stp_10.42.42.5(pid=25915): stderr: | 20221214131438886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131438886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131438886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131438886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131438887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131438887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131438887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:40.370906 run osmo-stp_10.42.42.5(pid=25915): stdout: | (launched: 2022-12-14_13:14:38.691441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:40.500303 run osmo-stp_10.42.42.5(pid=25915): stderr: | 20221214131438886 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131438886 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131438886 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131438886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131438887 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131438887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131438887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:40.655422 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25915): Process ended prematurely: osmo-stp_10.42.42.5(pid=25915) [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25915)] [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 13:14:40.665075 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:14:40.692606 run osmo-hlr_10.42.42.2(pid=25912): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25912)] 13:14:40.743286 run osmo-hlr_10.42.42.2(pid=25912): stdout: | (launched: 2022-12-14_13:14:37.688574) 13:14:40.795107 run osmo-hlr_10.42.42.2(pid=25912): stderr: | 20221214131437887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131437887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131437887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131437887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131437887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131437887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131437907 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131437916 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131437917 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131437917 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:40.867287 run osmo-msc_10.42.42.6(pid=25918): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25918)] 13:14:40.916763 run osmo-msc_10.42.42.6(pid=25918): stdout: | (launched: 2022-12-14_13:14:39.723302) 13:14:40.968502 run osmo-msc_10.42.42.6(pid=25918): stderr: | 20221214131440044 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131440045 DLGLOBAL DEBUG validating counter group 0x7fc444056c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131440045 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131440045 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131440045 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131440045 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131440047 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131440047 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131440047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131440047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:41.020667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25911): Terminating (SIGTERM) 13:14:41.062740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25914): Terminating (SIGTERM) 13:14:41.105207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25917): Terminating (SIGTERM) 13:14:41.147376 --- ParallelTerminationStrategy: PID 25911 died... 13:14:41.167842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25911): Terminated: ok {rc=0} 13:14:41.214099 --- ParallelTerminationStrategy: PID 25914 died... 13:14:41.233760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25914): Terminated: ok {rc=0} 13:14:41.279796 --- ParallelTerminationStrategy: PID 25917 died... 13:14:41.299572 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25917): Terminated: ok {rc=0} 13:14:41.387091 bus /sierra_3: Setting Powered False 13:14:42.483855 bus /sierra_3: Setting Powered False 13:14:43.602190 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:14:44.852386 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:14:44.858965 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:14:44.892609 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:14:44.921082 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:14:44.973205 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:14:45.006638 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:14:45.033852 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:14:45.589179 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:14:45.641922 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:45.653500 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:14:45.706620 tst mo_mt_call.py: using LAC 41144 13:14:45.837278 tst mo_mt_call.py: using RAC 89 13:14:45.985370 tst mo_mt_call.py: using CellId 41144 13:14:46.120143 tst mo_mt_call.py: using BVCI 41145 13:14:46.240227 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:46.252889 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:46.265482 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:46.278064 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:46.291931 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:46.305554 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:14:46.434096 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:14:46.555263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:47.070616 run create_hlr_db(pid=25923): Launched 13:14:47.209869 bus /sierra_2: Setting Powered False 13:14:48.269738 run create_hlr_db(pid=25923): Terminated: ok {rc=0} 13:14:48.712120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25925): Launched 13:14:49.035472 run osmo-hlr_10.42.42.2(pid=25926): Launched 13:14:49.158599 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:49.718497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25928): Launched 13:14:50.041862 run osmo-stp_10.42.42.5(pid=25929): Launched 13:14:50.165429 run osmo-msc_10.42.42.6: Starting osmo-msc 13:14:50.750294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25931): Launched 13:14:51.073298 run osmo-msc_10.42.42.6(pid=25932): Launched 13:14:51.253626 run osmo-stp_10.42.42.5(pid=25929): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25929)] 13:14:51.391189 run osmo-stp_10.42.42.5(pid=25929): stdout: | (launched: 2022-12-14_13:14:49.983442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:51.528770 run osmo-stp_10.42.42.5(pid=25929): stderr: | 20221214131450175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131450176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131450176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131450176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131450177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131450177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131450177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:51.665632 run osmo-stp_10.42.42.5(pid=25929): stdout: | (launched: 2022-12-14_13:14:49.983442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:14:51.795722 run osmo-stp_10.42.42.5(pid=25929): stderr: | 20221214131450175 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131450176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131450176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131450176 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131450177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131450177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131450177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:14:51.951297 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25929): Process ended prematurely: osmo-stp_10.42.42.5(pid=25929) [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25929)] [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:14:51.960919 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:14:51.988490 run osmo-hlr_10.42.42.2(pid=25926): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25926)] 13:14:52.038860 run osmo-hlr_10.42.42.2(pid=25926): stdout: | (launched: 2022-12-14_13:14:48.976813) 13:14:52.090580 run osmo-hlr_10.42.42.2(pid=25926): stderr: | 20221214131449178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131449178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131449178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131449178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131449178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131449178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131449190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131449198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131449199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131449199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:14:52.163404 run osmo-msc_10.42.42.6(pid=25932): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25932)] 13:14:52.213481 run osmo-msc_10.42.42.6(pid=25932): stdout: | (launched: 2022-12-14_13:14:51.014499) 13:14:52.265196 run osmo-msc_10.42.42.6(pid=25932): stderr: | 20221214131451336 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131451336 DLGLOBAL DEBUG validating counter group 0x7ff7b8fd4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131451336 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131451336 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131451336 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131451336 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131451338 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131451338 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131451338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131451339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:14:52.317155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25925): Terminating (SIGTERM) 13:14:52.359282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25928): Terminating (SIGTERM) 13:14:52.401081 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25931): Terminating (SIGTERM) 13:14:52.444075 --- ParallelTerminationStrategy: PID 25925 died... 13:14:52.464385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25925): Terminated: ok {rc=0} 13:14:52.510846 --- ParallelTerminationStrategy: PID 25928 died... 13:14:52.530478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25928): Terminated: ok {rc=0} 13:14:52.576783 --- ParallelTerminationStrategy: PID 25931 died... 13:14:52.596939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25931): Terminated: ok {rc=0} 13:14:52.685515 bus /sierra_3: Setting Powered False 13:14:53.782825 bus /sierra_3: Setting Powered False 13:14:54.898697 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:14:56.043328 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:56.055271 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:14:56.107684 tst mo_mt_call_osmux.py: using LAC 41145 13:14:56.228472 tst mo_mt_call_osmux.py: using RAC 90 13:14:56.346427 tst mo_mt_call_osmux.py: using CellId 41145 13:14:56.464190 tst mo_mt_call_osmux.py: using BVCI 41146 13:14:56.575026 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:56.586295 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:56.597385 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:56.608345 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:56.619407 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:14:56.630464 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:14:56.745956 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:14:56.866231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:14:57.334032 run create_hlr_db(pid=25935): Launched 13:14:57.457498 bus /sierra_2: Setting Powered False 13:14:58.517614 run create_hlr_db(pid=25935): Terminated: ok {rc=0} 13:14:58.959462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25937): Launched 13:14:59.281743 run osmo-hlr_10.42.42.2(pid=25938): Launched 13:14:59.405288 run osmo-stp_10.42.42.5: Starting osmo-stp 13:14:59.963703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25940): Launched 13:15:00.286464 run osmo-stp_10.42.42.5(pid=25941): Launched 13:15:00.409428 run osmo-msc_10.42.42.6: Starting osmo-msc 13:15:01.014843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25943): Launched 13:15:01.352451 run osmo-msc_10.42.42.6(pid=25946): Launched 13:15:01.771997 run osmo-stp_10.42.42.5(pid=25941): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25941)] 13:15:02.166986 run osmo-stp_10.42.42.5(pid=25941): stdout: | (launched: 2022-12-14_13:15:00.227694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:02.319056 run osmo-stp_10.42.42.5(pid=25941): stderr: | 20221214131500419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131500419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131500420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131500420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131500421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131500421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131500421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:02.449323 run osmo-stp_10.42.42.5(pid=25941): stdout: | (launched: 2022-12-14_13:15:00.227694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:02.572036 run osmo-stp_10.42.42.5(pid=25941): stderr: | 20221214131500419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131500419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131500420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131500420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131500421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131500421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131500421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:02.716671 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=25941): Process ended prematurely: osmo-stp_10.42.42.5(pid=25941) [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25941)] [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:15:02.725752 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 13:15:02.751983 run osmo-hlr_10.42.42.2(pid=25938): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25938)] 13:15:02.800688 run osmo-hlr_10.42.42.2(pid=25938): stdout: | (launched: 2022-12-14_13:14:59.223661) 13:15:02.850869 run osmo-hlr_10.42.42.2(pid=25938): stderr: | 20221214131459423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131459423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131459423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131459423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131459423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131459423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131459435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131459443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131459443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131459444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:02.920839 run osmo-msc_10.42.42.6(pid=25946): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25946)] 13:15:02.968362 run osmo-msc_10.42.42.6(pid=25946): stdout: | (launched: 2022-12-14_13:15:01.288018) 13:15:03.017926 run osmo-msc_10.42.42.6(pid=25946): stderr: | 20221214131501920 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131501922 DLGLOBAL DEBUG validating counter group 0x7f5fa03e9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131501922 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131501923 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131501924 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131501925 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131501931 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131501933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131501934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131501935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:15:03.067730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25937): Terminating (SIGTERM) 13:15:03.107701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25940): Terminating (SIGTERM) 13:15:03.147488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25943): Terminating (SIGTERM) 13:15:03.187440 --- ParallelTerminationStrategy: PID 25937 died... 13:15:03.207047 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25937): Terminated: ok {rc=0} 13:15:03.251506 --- ParallelTerminationStrategy: PID 25940 died... 13:15:03.270301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25940): Terminated: ok {rc=0} 13:15:03.314619 --- ParallelTerminationStrategy: PID 25943 died... 13:15:03.333770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25943): Terminated: ok {rc=0} 13:15:03.419993 bus /sierra_3: Setting Powered False 13:15:04.519147 bus /sierra_3: Setting Powered False 13:15:05.634132 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 emergency:trx-b200 --------------------------------------------------------------------- 13:15:06.886385 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:15:06.890494 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 13:15:06.922797 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 13:15:06.949158 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 13:15:07.030410 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 13:15:07.062474 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 13:15:07.088445 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 13:15:07.672878 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2405 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 13:15:07.677803 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:07.688149 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 13:15:07.736418 tst emergency_mo_mt_call.py: using LAC 41146 13:15:07.851429 tst emergency_mo_mt_call.py: using RAC 91 13:15:07.965977 tst emergency_mo_mt_call.py: using CellId 41146 13:15:08.082793 tst emergency_mo_mt_call.py: using BVCI 41147 13:15:08.191395 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:08.202084 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:08.212345 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:08.222630 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:08.232847 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:08.243225 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:15:08.357300 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:15:08.475692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:08.968447 run create_hlr_db(pid=25952): Launched 13:15:09.090551 bus /sierra_2: Setting Powered False 13:15:10.150637 run create_hlr_db(pid=25952): Terminated: ok {rc=0} 13:15:10.594059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25954): Launched 13:15:10.911539 run osmo-hlr_10.42.42.2(pid=25955): Launched 13:15:11.032783 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:11.579016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25957): Launched 13:15:11.897982 run osmo-stp_10.42.42.5(pid=25958): Launched 13:15:12.033629 tst emergency_mo_mt_call.py: using MSISDN 8704 13:15:12.203689 run osmo-msc_10.42.42.6: Starting osmo-msc 13:15:12.776483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25960): Launched 13:15:13.094615 run osmo-msc_10.42.42.6(pid=25961): Launched 13:15:13.271605 run osmo-stp_10.42.42.5(pid=25958): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25958)] 13:15:13.407676 run osmo-stp_10.42.42.5(pid=25958): stdout: | (launched: 2022-12-14_13:15:11.839216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:13.543506 run osmo-stp_10.42.42.5(pid=25958): stderr: | 20221214131512034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131512034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131512034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131512034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131512035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131512035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131512035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:13.678492 run osmo-stp_10.42.42.5(pid=25958): stdout: | (launched: 2022-12-14_13:15:11.839216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:13.805920 run osmo-stp_10.42.42.5(pid=25958): stderr: | 20221214131512034 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131512034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131512034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131512034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131512035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131512035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131512035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:13.957960 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=25958): Process ended prematurely: osmo-stp_10.42.42.5(pid=25958) [trial-2405↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25958)] [trial-2405↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 13:15:13.966924 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 13:15:13.994097 run osmo-hlr_10.42.42.2(pid=25955): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25955)] 13:15:14.044446 run osmo-hlr_10.42.42.2(pid=25955): stdout: | (launched: 2022-12-14_13:15:10.853795) 13:15:14.096276 run osmo-hlr_10.42.42.2(pid=25955): stderr: | 20221214131511052 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131511052 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131511052 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131511052 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131511052 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131511052 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131511064 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131511072 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131511072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131511072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:14.168808 run osmo-msc_10.42.42.6(pid=25961): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25961)] 13:15:14.218499 run osmo-msc_10.42.42.6(pid=25961): stdout: | (launched: 2022-12-14_13:15:13.036530) 13:15:14.269856 run osmo-msc_10.42.42.6(pid=25961): stderr: | 20221214131513357 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131513357 DLGLOBAL DEBUG validating counter group 0x7ff1e3eb7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131513357 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131513357 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131513357 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131513357 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131513359 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131513360 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131513360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131513360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:15:14.322162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25954): Terminating (SIGTERM) 13:15:14.364227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25957): Terminating (SIGTERM) 13:15:14.406668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25960): Terminating (SIGTERM) 13:15:14.449069 --- ParallelTerminationStrategy: PID 25954 died... 13:15:14.469282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25954): Terminated: ok {rc=0} 13:15:14.515623 --- ParallelTerminationStrategy: PID 25957 died... 13:15:14.535239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25957): Terminated: ok {rc=0} 13:15:14.581353 --- ParallelTerminationStrategy: PID 25960 died... 13:15:14.601161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25960): Terminated: ok {rc=0} 13:15:14.688667 bus /sierra_3: Setting Powered False 13:15:15.785714 bus /sierra_3: Setting Powered False 13:15:16.917675 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 13:15:18.002480 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:18.013786 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 13:15:18.064816 tst emergency_preemptive_call.py: using LAC 41147 13:15:18.186310 tst emergency_preemptive_call.py: using RAC 92 13:15:18.301443 tst emergency_preemptive_call.py: using CellId 41147 13:15:18.426228 tst emergency_preemptive_call.py: using BVCI 41148 13:15:18.541730 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:18.552791 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:18.563727 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:18.574601 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:18.586422 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 13:15:18.598180 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:15:18.718785 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:15:18.837856 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:15:18.953841 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 13:15:19.072703 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:19.567597 run create_hlr_db(pid=25963): Launched 13:15:19.689954 bus /sierra_2: Setting Powered False 13:15:20.753296 run create_hlr_db(pid=25963): Terminated: ok {rc=0} 13:15:21.179282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25965): Launched 13:15:21.476628 run osmo-hlr_10.42.42.2(pid=25966): Launched 13:15:21.591347 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:22.102976 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25968): Launched 13:15:22.399068 run osmo-stp_10.42.42.5(pid=25969): Launched 13:15:22.522481 tst emergency_preemptive_call.py: using MSISDN 8705 13:15:22.675060 run osmo-msc_10.42.42.6: Starting osmo-msc 13:15:23.206283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25971): Launched 13:15:23.502179 run osmo-msc_10.42.42.6(pid=25972): Launched 13:15:23.668522 run osmo-stp_10.42.42.5(pid=25969): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25969)] 13:15:23.794145 run osmo-stp_10.42.42.5(pid=25969): stdout: | (launched: 2022-12-14_13:15:22.344618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:23.919220 run osmo-stp_10.42.42.5(pid=25969): stderr: | 20221214131522515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131522515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131522515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131522516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131522516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131522516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131522516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:24.042885 run osmo-stp_10.42.42.5(pid=25969): stdout: | (launched: 2022-12-14_13:15:22.344618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:24.161520 run osmo-stp_10.42.42.5(pid=25969): stderr: | 20221214131522515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131522515 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131522515 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131522516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131522516 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131522516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131522516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:24.302566 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=25969): Process ended prematurely: osmo-stp_10.42.42.5(pid=25969) [trial-2405↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25969)] [trial-2405↪emergency:trx-b200↪emergency_preemptive_call.py:32] 13:15:24.310975 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 13:15:24.337051 run osmo-hlr_10.42.42.2(pid=25966): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25966)] 13:15:24.385590 run osmo-hlr_10.42.42.2(pid=25966): stdout: | (launched: 2022-12-14_13:15:21.422422) 13:15:24.435777 run osmo-hlr_10.42.42.2(pid=25966): stderr: | 20221214131521597 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131521597 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131521597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131521597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131521597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131521597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131521609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131521619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131521619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131521619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:24.505655 run osmo-msc_10.42.42.6(pid=25972): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=25972)] 13:15:24.553566 run osmo-msc_10.42.42.6(pid=25972): stdout: | (launched: 2022-12-14_13:15:23.447676) 13:15:24.603287 run osmo-msc_10.42.42.6(pid=25972): stderr: | 20221214131523718 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214131523718 DLGLOBAL DEBUG validating counter group 0x7f75decc5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214131523718 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214131523718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214131523718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214131523718 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214131523720 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214131523720 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214131523721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214131523721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:15:24.653100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25965): Terminating (SIGTERM) 13:15:24.692775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25968): Terminating (SIGTERM) 13:15:24.732485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25971): Terminating (SIGTERM) 13:15:24.772633 --- ParallelTerminationStrategy: PID 25965 died... 13:15:24.791923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25965): Terminated: ok {rc=0} 13:15:24.836387 --- ParallelTerminationStrategy: PID 25968 died... 13:15:24.855373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25968): Terminated: ok {rc=0} 13:15:24.899554 --- ParallelTerminationStrategy: PID 25971 died... 13:15:24.918529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=25971): Terminated: ok {rc=0} 13:15:25.002333 bus /sierra_9: Setting Powered False 13:15:26.101328 bus /sierra_9: Setting Powered False 13:15:27.219878 bus /sierra_8: Setting Powered False 13:15:28.319093 bus /sierra_8: Setting Powered False 13:15:29.433187 bus /sierra_3: Setting Powered False 13:15:30.531138 bus /sierra_3: Setting Powered False 13:15:31.649885 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-b200 --------------------------------------------------------------------- 13:15:32.934389 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:15:32.939168 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 13:15:32.972439 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 13:15:33.012319 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 13:15:33.099887 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 13:15:33.133453 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 13:15:33.172232 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 13:15:33.764086 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 13:15:33.817631 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:33.828434 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:15:33.882884 tst cs_paging_gprs_active.py: using LAC 41148 13:15:34.008655 tst cs_paging_gprs_active.py: using RAC 93 13:15:34.133369 tst cs_paging_gprs_active.py: using CellId 41148 13:15:34.258325 tst cs_paging_gprs_active.py: using BVCI 41149 13:15:34.377671 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:34.388498 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:34.399236 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:34.409994 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:34.420817 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:34.431740 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:34.442825 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:34.453814 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:34.464908 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:15:34.583155 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:15:34.702543 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:15:34.923281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:35.250306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25977): Launched 13:15:35.532871 run iperf3-srv_10.42.42.10(pid=25978): Launched 13:15:35.655279 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:15:35.875335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:36.201909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25979): Launched 13:15:36.483755 run iperf3-srv_10.42.42.10(pid=25980): Launched 13:15:36.605724 tst cs_paging_gprs_active.py:38: start network... 13:15:36.826108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:37.329494 run create_hlr_db(pid=25981): Launched 13:15:37.453920 bus /sierra_2: Setting Powered False 13:15:38.514215 run create_hlr_db(pid=25981): Terminated: ok {rc=0} 13:15:38.946250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25984): Launched 13:15:39.248401 run osmo-hlr_10.42.42.2(pid=25985): Launched 13:15:39.364168 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:39.899735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25987): Launched 13:15:40.225737 run osmo-stp_10.42.42.5(pid=25988): Launched 13:15:40.349497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:40.910385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25990): Launched 13:15:41.034889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:41.309591 run patchelf(pid=25991): Launched 13:15:41.490279 run osmo-stp_10.42.42.5(pid=25988): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25988)] 13:15:41.628186 run osmo-stp_10.42.42.5(pid=25988): stdout: | (launched: 2022-12-14_13:15:40.166898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:41.768083 run osmo-stp_10.42.42.5(pid=25988): stderr: | 20221214131540359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131540359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131540360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131540360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131540360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131540361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131540361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:41.911262 run osmo-stp_10.42.42.5(pid=25988): stdout: | (launched: 2022-12-14_13:15:40.166898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:42.040878 run osmo-stp_10.42.42.5(pid=25988): stderr: | 20221214131540359 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131540359 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131540360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131540360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131540360 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131540361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131540361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:42.189580 run patchelf(pid=25991): Terminating (SIGINT) 13:15:42.360884 run patchelf(pid=25991): Terminated: ok {rc=0} 13:15:42.483946 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=25988): Process ended prematurely: osmo-stp_10.42.42.5(pid=25988) [trial-2405↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25988)] [trial-2405↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 13:15:42.493755 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:15:42.521447 run osmo-hlr_10.42.42.2(pid=25985): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25985)] 13:15:42.569690 run osmo-hlr_10.42.42.2(pid=25985): stdout: | (launched: 2022-12-14_13:15:39.193160) 13:15:42.619860 run osmo-hlr_10.42.42.2(pid=25985): stderr: | 20221214131539369 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131539369 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131539369 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131539369 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131539369 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131539370 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131539381 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131539390 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131539390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131539390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:42.670143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25977): Terminating (SIGTERM) 13:15:42.710447 run iperf3-srv_10.42.42.10(pid=25978): Terminating (SIGTERM) 13:15:42.750641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25979): Terminating (SIGTERM) 13:15:42.790760 run iperf3-srv_10.42.42.10(pid=25980): Terminating (SIGTERM) 13:15:42.830605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25984): Terminating (SIGTERM) 13:15:42.870649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25987): Terminating (SIGTERM) 13:15:42.910918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25990): Terminating (SIGTERM) 13:15:42.951477 --- ParallelTerminationStrategy: PID 25977 died... 13:15:42.971051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25977): Terminated: ok {rc=0} 13:15:43.015970 --- ParallelTerminationStrategy: PID 25978 died... 13:15:43.035088 run iperf3-srv_10.42.42.10(pid=25978): Terminated {rc=256} 13:15:43.079529 --- ParallelTerminationStrategy: PID 25979 died... 13:15:43.098483 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25979): Terminated: ok {rc=0} 13:15:43.142746 --- ParallelTerminationStrategy: PID 25980 died... 13:15:43.161635 run iperf3-srv_10.42.42.10(pid=25980): Terminated {rc=256} 13:15:43.206160 --- ParallelTerminationStrategy: PID 25984 died... 13:15:43.225260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25984): Terminated: ok {rc=0} 13:15:43.269635 --- ParallelTerminationStrategy: PID 25987 died... 13:15:43.288685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25987): Terminated: ok {rc=0} 13:15:43.333145 --- ParallelTerminationStrategy: PID 25990 died... 13:15:43.351987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=25990): Terminated: ok {rc=0} 13:15:43.438532 bus /gobi_0: Setting Powered False 13:15:44.537815 bus /gobi_0: Setting Powered False 13:15:45.651811 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200 iperf3.py ---------------------------------------------- 13:15:46.806052 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:46.818649 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:15:46.875188 tst iperf3.py: using LAC 41149 13:15:47.006742 tst iperf3.py: using RAC 94 13:15:47.141026 tst iperf3.py: using CellId 41149 13:15:47.267096 tst iperf3.py: using BVCI 41150 13:15:47.379129 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:47.389876 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:47.400288 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:47.410695 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:47.421425 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:47.431673 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:47.442561 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:47.453196 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:47.463446 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:15:47.583022 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:15:47.803648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:48.129381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25992): Launched 13:15:48.410639 run iperf3-srv_10.42.42.10(pid=25993): Launched 13:15:48.532134 tst iperf3.py:8: start network... 13:15:48.752087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:15:49.252015 run create_hlr_db(pid=25994): Launched 13:15:49.375689 bus /gobi_6: Setting Powered False 13:15:50.439110 run create_hlr_db(pid=25994): Terminated: ok {rc=0} 13:15:50.872226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25996): Launched 13:15:51.174362 run osmo-hlr_10.42.42.2(pid=25997): Launched 13:15:51.289736 run osmo-stp_10.42.42.5: Starting osmo-stp 13:15:51.827989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25999): Launched 13:15:52.144266 run osmo-stp_10.42.42.5(pid=26000): Launched 13:15:52.268816 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:15:52.829400 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26002): Launched 13:15:52.953243 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:15:53.226219 run patchelf(pid=26003): Launched 13:15:53.405405 run osmo-stp_10.42.42.5(pid=26000): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26000)] 13:15:53.542483 run osmo-stp_10.42.42.5(pid=26000): stdout: | (launched: 2022-12-14_13:15:52.085460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:53.681440 run osmo-stp_10.42.42.5(pid=26000): stderr: | 20221214131552276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131552277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131552277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131552277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131552278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131552278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131552278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:53.820341 run osmo-stp_10.42.42.5(pid=26000): stdout: | (launched: 2022-12-14_13:15:52.085460) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:15:53.953146 run osmo-stp_10.42.42.5(pid=26000): stderr: | 20221214131552276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131552277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131552277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131552277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131552278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131552278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131552278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:15:54.110457 run patchelf(pid=26003): Terminating (SIGINT) 13:15:54.291699 run patchelf(pid=26003): Terminated: ok {rc=0} 13:15:54.422495 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26000): Process ended prematurely: osmo-stp_10.42.42.5(pid=26000) [trial-2405↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26000)] [trial-2405↪gprs:trx-b200↪iperf3.py:8] 13:15:54.432394 tst iperf3.py:8: Test FAILED (7.7 sec) 13:15:54.460818 run osmo-hlr_10.42.42.2(pid=25997): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=25997)] 13:15:54.510868 run osmo-hlr_10.42.42.2(pid=25997): stdout: | (launched: 2022-12-14_13:15:51.119064) 13:15:54.562124 run osmo-hlr_10.42.42.2(pid=25997): stderr: | 20221214131551297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131551297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131551297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131551297 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131551297 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131551297 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131551309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131551319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131551319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131551319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:15:54.613782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25992): Terminating (SIGTERM) 13:15:54.655804 run iperf3-srv_10.42.42.10(pid=25993): Terminating (SIGTERM) 13:15:54.698396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25996): Terminating (SIGTERM) 13:15:54.740266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25999): Terminating (SIGTERM) 13:15:54.782468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26002): Terminating (SIGTERM) 13:15:54.824443 --- ParallelTerminationStrategy: PID 25992 died... 13:15:54.844780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=25992): Terminated: ok {rc=0} 13:15:54.891203 --- ParallelTerminationStrategy: PID 25993 died... 13:15:54.910815 run iperf3-srv_10.42.42.10(pid=25993): Terminated {rc=256} 13:15:54.956820 --- ParallelTerminationStrategy: PID 25996 died... 13:15:54.977054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=25996): Terminated: ok {rc=0} 13:15:55.023162 --- ParallelTerminationStrategy: PID 25999 died... 13:15:55.042989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=25999): Terminated: ok {rc=0} 13:15:55.089505 --- ParallelTerminationStrategy: PID 26002 died... 13:15:55.109447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26002): Terminated: ok {rc=0} 13:15:55.198085 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 13:15:56.348040 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:56.359831 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:15:56.409112 tst iperf3m4.py: using LAC 41150 13:15:56.535390 tst iperf3m4.py: using RAC 95 13:15:56.662543 tst iperf3m4.py: using CellId 41150 13:15:56.791885 tst iperf3m4.py: using BVCI 41151 13:15:56.909481 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:56.920554 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:56.931382 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:56.942236 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:56.953718 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:56.965212 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:56.976935 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:56.988534 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:15:57.000386 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:15:57.118955 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:15:57.241170 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:15:57.356937 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:15:57.471852 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:15:57.676166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:57.980055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26004): Launched 13:15:58.243664 run iperf3-srv_10.42.42.10(pid=26005): Launched 13:15:58.356865 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:15:58.558940 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:58.863226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26006): Launched 13:15:59.126010 run iperf3-srv_10.42.42.10(pid=26007): Launched 13:15:59.238890 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:15:59.440826 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:15:59.743245 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26008): Launched 13:16:00.005484 run iperf3-srv_10.42.42.10(pid=26009): Launched 13:16:00.118676 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:16:00.320537 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:00.623630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26010): Launched 13:16:00.911597 run iperf3-srv_10.42.42.10(pid=26011): Launched 13:16:01.051928 tst iperf3m4.py:8: start network... 13:16:01.277805 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:01.800323 run create_hlr_db(pid=26012): Launched 13:16:01.953097 bus /gobi_6: Setting Powered False 13:16:03.013561 run create_hlr_db(pid=26012): Terminated: ok {rc=0} 13:16:03.456260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26014): Launched 13:16:03.781558 run osmo-hlr_10.42.42.2(pid=26015): Launched 13:16:03.905199 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:04.463429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26017): Launched 13:16:04.789481 run osmo-stp_10.42.42.5(pid=26018): Launched 13:16:04.913319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:05.471736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26020): Launched 13:16:05.595558 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:05.869387 run patchelf(pid=26021): Launched 13:16:06.049383 run osmo-stp_10.42.42.5(pid=26018): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26018)] 13:16:06.186885 run osmo-stp_10.42.42.5(pid=26018): stdout: | (launched: 2022-12-14_13:16:04.730124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:06.325936 run osmo-stp_10.42.42.5(pid=26018): stderr: | 20221214131604923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131604923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131604924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131604924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131604925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131604925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131604925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:06.465321 run osmo-stp_10.42.42.5(pid=26018): stdout: | (launched: 2022-12-14_13:16:04.730124) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:06.598754 run osmo-stp_10.42.42.5(pid=26018): stderr: | 20221214131604923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131604923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131604924 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131604924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131604925 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131604925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131604925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:06.757600 run patchelf(pid=26021): Terminating (SIGINT) 13:16:06.940001 run patchelf(pid=26021): Terminated: ok {rc=0} 13:16:07.070979 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26018): Process ended prematurely: osmo-stp_10.42.42.5(pid=26018) [trial-2405↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26018)] [trial-2405↪gprs:trx-b200↪iperf3m4.py:8] 13:16:07.081241 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:16:07.109964 run osmo-hlr_10.42.42.2(pid=26015): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26015)] 13:16:07.161186 run osmo-hlr_10.42.42.2(pid=26015): stdout: | (launched: 2022-12-14_13:16:03.722983) 13:16:07.213110 run osmo-hlr_10.42.42.2(pid=26015): stderr: | 20221214131603922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131603922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131603922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131603922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131603922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131603922 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131603941 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131603951 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131603951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131603951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:07.265357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26004): Terminating (SIGTERM) 13:16:07.307134 run iperf3-srv_10.42.42.10(pid=26005): Terminating (SIGTERM) 13:16:07.350499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26006): Terminating (SIGTERM) 13:16:07.392779 run iperf3-srv_10.42.42.10(pid=26007): Terminating (SIGTERM) 13:16:07.434790 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26008): Terminating (SIGTERM) 13:16:07.476782 run iperf3-srv_10.42.42.10(pid=26009): Terminating (SIGTERM) 13:16:07.518665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26010): Terminating (SIGTERM) 13:16:07.560738 run iperf3-srv_10.42.42.10(pid=26011): Terminating (SIGTERM) 13:16:07.602522 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26014): Terminating (SIGTERM) 13:16:07.644564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26017): Terminating (SIGTERM) 13:16:07.686897 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26020): Terminating (SIGTERM) 13:16:07.729246 --- ParallelTerminationStrategy: PID 26004 died... 13:16:07.749687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26004): Terminated: ok {rc=0} 13:16:07.796407 --- ParallelTerminationStrategy: PID 26005 died... 13:16:07.816245 run iperf3-srv_10.42.42.10(pid=26005): Terminated {rc=256} 13:16:07.862631 --- ParallelTerminationStrategy: PID 26006 died... 13:16:07.882436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26006): Terminated: ok {rc=0} 13:16:07.928900 --- ParallelTerminationStrategy: PID 26007 died... 13:16:07.949215 run iperf3-srv_10.42.42.10(pid=26007): Terminated {rc=256} 13:16:07.995487 --- ParallelTerminationStrategy: PID 26008 died... 13:16:08.015269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26008): Terminated: ok {rc=0} 13:16:08.061736 --- ParallelTerminationStrategy: PID 26009 died... 13:16:08.081572 run iperf3-srv_10.42.42.10(pid=26009): Terminated {rc=256} 13:16:08.127854 --- ParallelTerminationStrategy: PID 26010 died... 13:16:08.147694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26010): Terminated: ok {rc=0} 13:16:08.194152 --- ParallelTerminationStrategy: PID 26011 died... 13:16:08.213951 run iperf3-srv_10.42.42.10(pid=26011): Terminated {rc=256} 13:16:08.260348 --- ParallelTerminationStrategy: PID 26014 died... 13:16:08.280319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26014): Terminated: ok {rc=0} 13:16:08.326481 --- ParallelTerminationStrategy: PID 26017 died... 13:16:08.346572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26017): Terminated: ok {rc=0} 13:16:08.392933 --- ParallelTerminationStrategy: PID 26020 died... 13:16:08.413231 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26020): Terminated: ok {rc=0} 13:16:08.501027 bus /gobi_4: Setting Powered False 13:16:09.600181 bus /gobi_4: Setting Powered False 13:16:10.716925 bus /gobi_1: Setting Powered False 13:16:11.815479 bus /gobi_1: Setting Powered False 13:16:12.931373 bus /gobi_0: Setting Powered False 13:16:14.029424 bus /gobi_0: Setting Powered False 13:16:15.147824 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200 ping.py ---------------------------------------------- 13:16:16.252573 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:16.265208 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:16:16.321284 tst ping.py: using LAC 41151 13:16:16.439491 tst ping.py: using RAC 96 13:16:16.566923 tst ping.py: using CellId 41151 13:16:16.729062 tst ping.py: using BVCI 41152 13:16:16.883630 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:16.898348 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:16.912851 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:16.930366 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:16.946560 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:16.962530 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:16.979387 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:16.995612 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:16:17.129341 tst ping.py:19: start network... 13:16:17.354629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:17.815395 run create_hlr_db(pid=26022): Launched 13:16:17.938353 bus /gobi_6: Setting Powered False 13:16:18.998162 run create_hlr_db(pid=26022): Terminated: ok {rc=0} 13:16:19.412598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26024): Launched 13:16:19.709612 run osmo-hlr_10.42.42.2(pid=26025): Launched 13:16:19.822121 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:20.334622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26027): Launched 13:16:20.632136 run osmo-stp_10.42.42.5(pid=26028): Launched 13:16:20.744818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:21.257589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26030): Launched 13:16:21.370864 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:21.621350 run patchelf(pid=26031): Launched 13:16:21.786643 run osmo-stp_10.42.42.5(pid=26028): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26028)] 13:16:21.912544 run osmo-stp_10.42.42.5(pid=26028): stdout: | (launched: 2022-12-14_13:16:20.577208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:22.040025 run osmo-stp_10.42.42.5(pid=26028): stderr: | 20221214131620748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131620749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131620750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131620750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131620751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131620751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131620751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:22.167840 run osmo-stp_10.42.42.5(pid=26028): stdout: | (launched: 2022-12-14_13:16:20.577208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:22.290196 run osmo-stp_10.42.42.5(pid=26028): stderr: | 20221214131620748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131620749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131620750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131620750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131620751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131620751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131620751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:22.435024 run patchelf(pid=26031): Terminating (SIGINT) 13:16:22.602026 run patchelf(pid=26031): Terminated: ok {rc=0} 13:16:22.722161 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26028): Process ended prematurely: osmo-stp_10.42.42.5(pid=26028) [trial-2405↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26028)] [trial-2405↪gprs:trx-b200↪ping.py:22] 13:16:22.730828 tst ping.py:22: Test FAILED (6.5 sec) 13:16:22.757525 run osmo-hlr_10.42.42.2(pid=26025): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26025)] 13:16:22.805524 run osmo-hlr_10.42.42.2(pid=26025): stdout: | (launched: 2022-12-14_13:16:19.654751) 13:16:22.854749 run osmo-hlr_10.42.42.2(pid=26025): stderr: | 20221214131619829 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131619829 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131619829 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131619829 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131619829 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131619829 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131619863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131619873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131619873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131619874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:22.904709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26024): Terminating (SIGTERM) 13:16:22.944822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26027): Terminating (SIGTERM) 13:16:22.985294 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26030): Terminating (SIGTERM) 13:16:23.025711 --- ParallelTerminationStrategy: PID 26024 died... 13:16:23.044782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26024): Terminated: ok {rc=0} 13:16:23.088824 --- ParallelTerminationStrategy: PID 26027 died... 13:16:23.107918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26027): Terminated: ok {rc=0} 13:16:23.151911 --- ParallelTerminationStrategy: PID 26030 died... 13:16:23.170491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26030): Terminated: ok {rc=0} 13:16:23.256367 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 13:16:24.344827 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:24.356292 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 13:16:24.406168 tst ping_idle_ping.py: using LAC 41152 13:16:24.534344 tst ping_idle_ping.py: using RAC 97 13:16:24.661736 tst ping_idle_ping.py: using CellId 41152 13:16:24.790459 tst ping_idle_ping.py: using BVCI 41153 13:16:24.908496 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:24.919805 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:24.931047 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:24.942509 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:24.954049 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:24.965535 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:24.977120 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 13:16:24.988492 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 13:16:25.102262 tst ping_idle_ping.py:24: start network... 13:16:25.301499 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:25.765485 run create_hlr_db(pid=26032): Launched 13:16:25.888553 bus /gobi_6: Setting Powered False 13:16:26.948805 run create_hlr_db(pid=26032): Terminated: ok {rc=0} 13:16:27.366630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26034): Launched 13:16:27.664765 run osmo-hlr_10.42.42.2(pid=26035): Launched 13:16:27.778812 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:28.288294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26037): Launched 13:16:28.585407 run osmo-stp_10.42.42.5(pid=26038): Launched 13:16:28.699100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:29.213467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26040): Launched 13:16:29.326968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:29.578165 run patchelf(pid=26041): Launched 13:16:29.742704 run osmo-stp_10.42.42.5(pid=26038): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26038)] 13:16:29.868296 run osmo-stp_10.42.42.5(pid=26038): stdout: | (launched: 2022-12-14_13:16:28.530712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:29.995333 run osmo-stp_10.42.42.5(pid=26038): stderr: | 20221214131628700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131628701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131628701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131628701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131628703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131628704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131628704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:30.122709 run osmo-stp_10.42.42.5(pid=26038): stdout: | (launched: 2022-12-14_13:16:28.530712) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:30.244465 run osmo-stp_10.42.42.5(pid=26038): stderr: | 20221214131628700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131628701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131628701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131628701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131628703 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131628704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131628704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:30.389141 run patchelf(pid=26041): Terminating (SIGINT) 13:16:30.555266 run patchelf(pid=26041): Terminated: ok {rc=0} 13:16:30.675621 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26038): Process ended prematurely: osmo-stp_10.42.42.5(pid=26038) [trial-2405↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26038)] [trial-2405↪gprs:trx-b200↪ping_idle_ping.py:27] 13:16:30.684529 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:16:30.711147 run osmo-hlr_10.42.42.2(pid=26035): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26035)] 13:16:30.758258 run osmo-hlr_10.42.42.2(pid=26035): stdout: | (launched: 2022-12-14_13:16:27.609662) 13:16:30.807457 run osmo-hlr_10.42.42.2(pid=26035): stderr: | 20221214131627788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131627789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131627789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131627789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131627789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131627789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131627801 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131627810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131627810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131627810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:30.872604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26034): Terminating (SIGTERM) 13:16:30.919256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26037): Terminating (SIGTERM) 13:16:30.960489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26040): Terminating (SIGTERM) 13:16:31.003016 --- ParallelTerminationStrategy: PID 26034 died... 13:16:31.023981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26034): Terminated: ok {rc=0} 13:16:31.068780 --- ParallelTerminationStrategy: PID 26037 died... 13:16:31.087918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26037): Terminated: ok {rc=0} 13:16:31.132331 --- ParallelTerminationStrategy: PID 26040 died... 13:16:31.151551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26040): Terminated: ok {rc=0} 13:16:31.235977 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 13:16:32.544792 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:16:32.550468 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:16:32.583570 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:16:32.623051 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:16:32.710888 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:16:32.743909 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:16:32.782794 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:16:33.377967 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:16:33.430695 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:33.441910 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:16:33.494631 tst cs_paging_gprs_active.py: using LAC 41153 13:16:33.624785 tst cs_paging_gprs_active.py: using RAC 98 13:16:33.752270 tst cs_paging_gprs_active.py: using CellId 41153 13:16:33.877463 tst cs_paging_gprs_active.py: using BVCI 41154 13:16:33.997626 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:34.008781 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:34.019793 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:34.030758 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:34.042005 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:34.053397 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:34.064748 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:34.076116 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:34.087660 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:34.206724 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:34.323837 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:16:34.527744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:34.831745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26045): Launched 13:16:35.095705 run iperf3-srv_10.42.42.10(pid=26046): Launched 13:16:35.208615 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:16:35.411018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:35.714651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26047): Launched 13:16:35.976916 run iperf3-srv_10.42.42.10(pid=26048): Launched 13:16:36.089953 tst cs_paging_gprs_active.py:38: start network... 13:16:36.292613 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:36.760094 run create_hlr_db(pid=26049): Launched 13:16:36.883773 bus /gobi_6: Setting Powered False 13:16:37.945127 run create_hlr_db(pid=26049): Terminated: ok {rc=0} 13:16:38.387829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26051): Launched 13:16:38.712300 run osmo-hlr_10.42.42.2(pid=26052): Launched 13:16:38.837211 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:39.397995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26054): Launched 13:16:39.721719 run osmo-stp_10.42.42.5(pid=26055): Launched 13:16:39.845589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:40.405347 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26057): Launched 13:16:40.530102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:40.805742 run patchelf(pid=26058): Launched 13:16:40.986296 run osmo-stp_10.42.42.5(pid=26055): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26055)] 13:16:41.123919 run osmo-stp_10.42.42.5(pid=26055): stdout: | (launched: 2022-12-14_13:16:39.662543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:41.263510 run osmo-stp_10.42.42.5(pid=26055): stderr: | 20221214131639857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131639857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131639857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131639857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131639858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131639858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131639858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:41.403092 run osmo-stp_10.42.42.5(pid=26055): stdout: | (launched: 2022-12-14_13:16:39.662543) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:41.536457 run osmo-stp_10.42.42.5(pid=26055): stderr: | 20221214131639857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131639857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131639857 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131639857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131639858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131639858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131639858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:41.695256 run patchelf(pid=26058): Terminating (SIGINT) 13:16:41.877444 run patchelf(pid=26058): Terminated: ok {rc=0} 13:16:42.008793 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26055): Process ended prematurely: osmo-stp_10.42.42.5(pid=26055) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26055)] [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:16:42.019002 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:16:42.047163 run osmo-hlr_10.42.42.2(pid=26052): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26052)] 13:16:42.097596 run osmo-hlr_10.42.42.2(pid=26052): stdout: | (launched: 2022-12-14_13:16:38.653250) 13:16:42.149753 run osmo-hlr_10.42.42.2(pid=26052): stderr: | 20221214131638851 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131638851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131638851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131638851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131638851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131638852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131638864 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131638874 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131638874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131638874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:42.201890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26045): Terminating (SIGTERM) 13:16:42.243388 run iperf3-srv_10.42.42.10(pid=26046): Terminating (SIGTERM) 13:16:42.284903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26047): Terminating (SIGTERM) 13:16:42.326697 run iperf3-srv_10.42.42.10(pid=26048): Terminating (SIGTERM) 13:16:42.368195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26051): Terminating (SIGTERM) 13:16:42.409812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26054): Terminating (SIGTERM) 13:16:42.451356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26057): Terminating (SIGTERM) 13:16:42.493129 --- ParallelTerminationStrategy: PID 26045 died... 13:16:42.513256 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26045): Terminated: ok {rc=0} 13:16:42.559385 --- ParallelTerminationStrategy: PID 26046 died... 13:16:42.578916 run iperf3-srv_10.42.42.10(pid=26046): Terminated {rc=256} 13:16:42.624780 --- ParallelTerminationStrategy: PID 26047 died... 13:16:42.644811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26047): Terminated: ok {rc=0} 13:16:42.691239 --- ParallelTerminationStrategy: PID 26048 died... 13:16:42.710839 run iperf3-srv_10.42.42.10(pid=26048): Terminated {rc=256} 13:16:42.756675 --- ParallelTerminationStrategy: PID 26051 died... 13:16:42.776349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26051): Terminated: ok {rc=0} 13:16:42.822301 --- ParallelTerminationStrategy: PID 26054 died... 13:16:42.842040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26054): Terminated: ok {rc=0} 13:16:42.888111 --- ParallelTerminationStrategy: PID 26057 died... 13:16:42.907889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26057): Terminated: ok {rc=0} 13:16:42.994392 bus /gobi_0: Setting Powered False 13:16:44.091981 bus /gobi_0: Setting Powered False 13:16:45.208002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:16:46.358101 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:46.370896 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:16:46.428035 tst iperf3.py: using LAC 41154 13:16:46.578291 tst iperf3.py: using RAC 99 13:16:46.742676 tst iperf3.py: using CellId 41154 13:16:46.871712 tst iperf3.py: using BVCI 41155 13:16:47.031546 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:47.047795 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:47.063706 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:47.080398 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:47.096158 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:47.111242 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:47.127152 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:47.143067 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:47.158693 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:47.283021 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:16:47.490422 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:47.795383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Launched 13:16:48.059411 run iperf3-srv_10.42.42.10(pid=26060): Launched 13:16:48.173175 tst iperf3.py:8: start network... 13:16:48.376118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:16:48.843101 run create_hlr_db(pid=26061): Launched 13:16:48.965759 bus /gobi_6: Setting Powered False 13:16:50.025789 run create_hlr_db(pid=26061): Terminated: ok {rc=0} 13:16:50.467457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26063): Launched 13:16:50.791603 run osmo-hlr_10.42.42.2(pid=26064): Launched 13:16:50.915410 run osmo-stp_10.42.42.5: Starting osmo-stp 13:16:51.473104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26066): Launched 13:16:51.796202 run osmo-stp_10.42.42.5(pid=26067): Launched 13:16:51.919515 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:16:52.476742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26069): Launched 13:16:52.600472 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:16:52.873804 run patchelf(pid=26070): Launched 13:16:53.053735 run osmo-stp_10.42.42.5(pid=26067): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26067)] 13:16:53.190985 run osmo-stp_10.42.42.5(pid=26067): stdout: | (launched: 2022-12-14_13:16:51.737710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:53.329915 run osmo-stp_10.42.42.5(pid=26067): stderr: | 20221214131651931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131651931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131651932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131651932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131651932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131651933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131651933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:53.468880 run osmo-stp_10.42.42.5(pid=26067): stdout: | (launched: 2022-12-14_13:16:51.737710) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:16:53.601540 run osmo-stp_10.42.42.5(pid=26067): stderr: | 20221214131651931 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131651931 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131651932 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131651932 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131651932 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131651933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131651933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:16:53.760086 run patchelf(pid=26070): Terminating (SIGINT) 13:16:53.941610 run patchelf(pid=26070): Terminated: ok {rc=0} 13:16:54.072543 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26067): Process ended prematurely: osmo-stp_10.42.42.5(pid=26067) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26067)] [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 13:16:54.082675 tst iperf3.py:8: Test FAILED (7.8 sec) 13:16:54.110782 run osmo-hlr_10.42.42.2(pid=26064): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26064)] 13:16:54.161050 run osmo-hlr_10.42.42.2(pid=26064): stdout: | (launched: 2022-12-14_13:16:50.733079) 13:16:54.212896 run osmo-hlr_10.42.42.2(pid=26064): stderr: | 20221214131650929 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131650929 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131650929 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131650929 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131650929 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131650930 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131650945 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131650955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131650956 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131650956 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:16:54.265166 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Terminating (SIGTERM) 13:16:54.306560 run iperf3-srv_10.42.42.10(pid=26060): Terminating (SIGTERM) 13:16:54.348741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26063): Terminating (SIGTERM) 13:16:54.390524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26066): Terminating (SIGTERM) 13:16:54.432459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26069): Terminating (SIGTERM) 13:16:54.474734 --- ParallelTerminationStrategy: PID 26059 died... 13:16:54.495307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26059): Terminated: ok {rc=0} 13:16:54.541889 --- ParallelTerminationStrategy: PID 26060 died... 13:16:54.561431 run iperf3-srv_10.42.42.10(pid=26060): Terminated {rc=256} 13:16:54.607705 --- ParallelTerminationStrategy: PID 26063 died... 13:16:54.627413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26063): Terminated: ok {rc=0} 13:16:54.673612 --- ParallelTerminationStrategy: PID 26066 died... 13:16:54.693185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26066): Terminated: ok {rc=0} 13:16:54.739383 --- ParallelTerminationStrategy: PID 26069 died... 13:16:54.759168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26069): Terminated: ok {rc=0} 13:16:54.847641 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:16:55.998065 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:56.009776 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:16:56.065419 tst iperf3m4.py: using LAC 41155 13:16:56.192059 tst iperf3m4.py: using RAC 100 13:16:56.316763 tst iperf3m4.py: using CellId 41155 13:16:56.442239 tst iperf3m4.py: using BVCI 41156 13:16:56.559647 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:56.570885 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:56.581858 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:56.592652 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:56.604292 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:56.616022 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:56.627866 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:56.639510 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:16:56.651489 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:56.772912 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:56.891422 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:57.010268 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:16:57.125776 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:16:57.330555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:57.634485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26071): Launched 13:16:57.898152 run iperf3-srv_10.42.42.10(pid=26072): Launched 13:16:58.011150 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:16:58.213122 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:58.515155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26073): Launched 13:16:58.778417 run iperf3-srv_10.42.42.10(pid=26074): Launched 13:16:58.891350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:16:59.094583 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:16:59.398717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26075): Launched 13:16:59.661877 run iperf3-srv_10.42.42.10(pid=26076): Launched 13:16:59.774792 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:16:59.976637 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:00.279612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26077): Launched 13:17:00.541825 run iperf3-srv_10.42.42.10(pid=26078): Launched 13:17:00.654753 tst iperf3m4.py:8: start network... 13:17:00.857401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:01.349328 run create_hlr_db(pid=26079): Launched 13:17:01.536476 bus /gobi_6: Setting Powered False 13:17:02.595812 run create_hlr_db(pid=26079): Terminated: ok {rc=0} 13:17:03.022815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26084): Launched 13:17:03.325998 run osmo-hlr_10.42.42.2(pid=26085): Launched 13:17:03.440860 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:03.966527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26087): Launched 13:17:04.291588 run osmo-stp_10.42.42.5(pid=26088): Launched 13:17:04.415426 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:04.974729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26090): Launched 13:17:05.098194 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:05.371550 run patchelf(pid=26091): Launched 13:17:05.551202 run osmo-stp_10.42.42.5(pid=26088): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26088)] 13:17:05.688496 run osmo-stp_10.42.42.5(pid=26088): stdout: | (launched: 2022-12-14_13:17:04.232787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:05.827272 run osmo-stp_10.42.42.5(pid=26088): stderr: | 20221214131704423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131704423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131704423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131704424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131704424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131704424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131704424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:05.966228 run osmo-stp_10.42.42.5(pid=26088): stdout: | (launched: 2022-12-14_13:17:04.232787) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:06.099102 run osmo-stp_10.42.42.5(pid=26088): stderr: | 20221214131704423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131704423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131704423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131704424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131704424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131704424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131704424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:06.256317 run patchelf(pid=26091): Terminating (SIGINT) 13:17:06.437589 run patchelf(pid=26091): Terminated: ok {rc=0} 13:17:06.568630 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26088): Process ended prematurely: osmo-stp_10.42.42.5(pid=26088) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26088)] [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 13:17:06.578796 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:17:06.607431 run osmo-hlr_10.42.42.2(pid=26085): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26085)] 13:17:06.658034 run osmo-hlr_10.42.42.2(pid=26085): stdout: | (launched: 2022-12-14_13:17:03.270499) 13:17:06.710202 run osmo-hlr_10.42.42.2(pid=26085): stderr: | 20221214131703451 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131703451 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131703451 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131703451 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131703451 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131703451 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131703463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131703474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131703474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131703475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:06.762925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26071): Terminating (SIGTERM) 13:17:06.804748 run iperf3-srv_10.42.42.10(pid=26072): Terminating (SIGTERM) 13:17:06.847252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26073): Terminating (SIGTERM) 13:17:06.889645 run iperf3-srv_10.42.42.10(pid=26074): Terminating (SIGTERM) 13:17:06.932219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26075): Terminating (SIGTERM) 13:17:06.974626 run iperf3-srv_10.42.42.10(pid=26076): Terminating (SIGTERM) 13:17:07.016531 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26077): Terminating (SIGTERM) 13:17:07.058729 run iperf3-srv_10.42.42.10(pid=26078): Terminating (SIGTERM) 13:17:07.100715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26084): Terminating (SIGTERM) 13:17:07.143265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26087): Terminating (SIGTERM) 13:17:07.185321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26090): Terminating (SIGTERM) 13:17:07.227906 --- ParallelTerminationStrategy: PID 26071 died... 13:17:07.248321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26071): Terminated: ok {rc=0} 13:17:07.295190 --- ParallelTerminationStrategy: PID 26072 died... 13:17:07.315029 run iperf3-srv_10.42.42.10(pid=26072): Terminated {rc=256} 13:17:07.361496 --- ParallelTerminationStrategy: PID 26073 died... 13:17:07.381366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26073): Terminated: ok {rc=0} 13:17:07.427803 --- ParallelTerminationStrategy: PID 26074 died... 13:17:07.447632 run iperf3-srv_10.42.42.10(pid=26074): Terminated {rc=256} 13:17:07.494035 --- ParallelTerminationStrategy: PID 26075 died... 13:17:07.513794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26075): Terminated: ok {rc=0} 13:17:07.560186 --- ParallelTerminationStrategy: PID 26076 died... 13:17:07.579947 run iperf3-srv_10.42.42.10(pid=26076): Terminated {rc=256} 13:17:07.626499 --- ParallelTerminationStrategy: PID 26077 died... 13:17:07.646247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26077): Terminated: ok {rc=0} 13:17:07.692685 --- ParallelTerminationStrategy: PID 26078 died... 13:17:07.712471 run iperf3-srv_10.42.42.10(pid=26078): Terminated {rc=256} 13:17:07.758584 --- ParallelTerminationStrategy: PID 26084 died... 13:17:07.778366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26084): Terminated: ok {rc=0} 13:17:07.824433 --- ParallelTerminationStrategy: PID 26087 died... 13:17:07.844296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26087): Terminated: ok {rc=0} 13:17:07.890472 --- ParallelTerminationStrategy: PID 26090 died... 13:17:07.910229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26090): Terminated: ok {rc=0} 13:17:07.997390 bus /gobi_4: Setting Powered False 13:17:09.097181 bus /gobi_4: Setting Powered False 13:17:10.213433 bus /gobi_1: Setting Powered False 13:17:11.312047 bus /gobi_1: Setting Powered False 13:17:12.428869 bus /gobi_0: Setting Powered False 13:17:13.527195 bus /gobi_0: Setting Powered False 13:17:14.643141 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 13:17:15.745746 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:15.757762 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:17:15.810632 tst ping.py: using LAC 41156 13:17:15.951544 tst ping.py: using RAC 101 13:17:16.070172 tst ping.py: using CellId 41156 13:17:16.234782 tst ping.py: using BVCI 41157 13:17:16.357666 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:16.370570 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:16.383036 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:16.395899 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:16.410713 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:16.426816 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:16.440347 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:16.453841 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:17:16.585822 tst ping.py:19: start network... 13:17:16.809425 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:17.313386 run create_hlr_db(pid=26092): Launched 13:17:17.436811 bus /gobi_6: Setting Powered False 13:17:18.500510 run create_hlr_db(pid=26092): Terminated: ok {rc=0} 13:17:18.929481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26094): Launched 13:17:19.227672 run osmo-hlr_10.42.42.2(pid=26095): Launched 13:17:19.340566 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:19.854600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26097): Launched 13:17:20.151785 run osmo-stp_10.42.42.5(pid=26098): Launched 13:17:20.264095 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:20.777822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26100): Launched 13:17:20.891038 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:21.141474 run patchelf(pid=26101): Launched 13:17:21.306335 run osmo-stp_10.42.42.5(pid=26098): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26098)] 13:17:21.432221 run osmo-stp_10.42.42.5(pid=26098): stdout: | (launched: 2022-12-14_13:17:20.096887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:21.559523 run osmo-stp_10.42.42.5(pid=26098): stderr: | 20221214131720268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131720268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131720269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131720269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131720269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131720269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131720270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:21.686358 run osmo-stp_10.42.42.5(pid=26098): stdout: | (launched: 2022-12-14_13:17:20.096887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:21.807996 run osmo-stp_10.42.42.5(pid=26098): stderr: | 20221214131720268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131720268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131720269 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131720269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131720269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131720269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131720270 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:21.952246 run patchelf(pid=26101): Terminating (SIGINT) 13:17:22.118316 run patchelf(pid=26101): Terminated: ok {rc=0} 13:17:22.238263 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26098): Process ended prematurely: osmo-stp_10.42.42.5(pid=26098) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26098)] [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 13:17:22.247091 tst ping.py:22: Test FAILED (6.5 sec) 13:17:22.273619 run osmo-hlr_10.42.42.2(pid=26095): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26095)] 13:17:22.320850 run osmo-hlr_10.42.42.2(pid=26095): stdout: | (launched: 2022-12-14_13:17:19.172734) 13:17:22.369692 run osmo-hlr_10.42.42.2(pid=26095): stderr: | 20221214131719350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131719350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131719351 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131719351 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131719351 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131719351 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131719363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131719373 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131719373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131719373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:22.418996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26094): Terminating (SIGTERM) 13:17:22.458927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26097): Terminating (SIGTERM) 13:17:22.498537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26100): Terminating (SIGTERM) 13:17:22.538635 --- ParallelTerminationStrategy: PID 26094 died... 13:17:22.558006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26094): Terminated: ok {rc=0} 13:17:22.602312 --- ParallelTerminationStrategy: PID 26097 died... 13:17:22.621152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26097): Terminated: ok {rc=0} 13:17:22.665150 --- ParallelTerminationStrategy: PID 26100 died... 13:17:22.683850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26100): Terminated: ok {rc=0} 13:17:22.768826 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:17:23.855163 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:23.866663 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:17:23.917152 tst ping_idle_ping.py: using LAC 41157 13:17:24.035486 tst ping_idle_ping.py: using RAC 102 13:17:24.151955 tst ping_idle_ping.py: using CellId 41157 13:17:24.269500 tst ping_idle_ping.py: using BVCI 41158 13:17:24.387603 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:24.398941 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:24.410046 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:24.420916 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:24.432233 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:24.443489 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:24.454956 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:17:24.466207 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:17:24.580445 tst ping_idle_ping.py:24: start network... 13:17:24.779829 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:25.241242 run create_hlr_db(pid=26102): Launched 13:17:25.363773 bus /gobi_6: Setting Powered False 13:17:26.423166 run create_hlr_db(pid=26102): Terminated: ok {rc=0} 13:17:26.858370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26104): Launched 13:17:27.177396 run osmo-hlr_10.42.42.2(pid=26105): Launched 13:17:27.299746 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:27.851483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26107): Launched 13:17:28.171342 run osmo-stp_10.42.42.5(pid=26108): Launched 13:17:28.294292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:28.847625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26110): Launched 13:17:28.970398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:29.240126 run patchelf(pid=26111): Launched 13:17:29.417071 run osmo-stp_10.42.42.5(pid=26108): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26108)] 13:17:29.552417 run osmo-stp_10.42.42.5(pid=26108): stdout: | (launched: 2022-12-14_13:17:28.113106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:29.689535 run osmo-stp_10.42.42.5(pid=26108): stderr: | 20221214131728303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131728303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131728304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131728304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131728306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131728306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131728307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:29.826647 run osmo-stp_10.42.42.5(pid=26108): stdout: | (launched: 2022-12-14_13:17:28.113106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:29.957470 run osmo-stp_10.42.42.5(pid=26108): stderr: | 20221214131728303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131728303 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131728304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131728304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131728306 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131728306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131728307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:30.112918 run patchelf(pid=26111): Terminating (SIGINT) 13:17:30.291898 run patchelf(pid=26111): Terminated: ok {rc=0} 13:17:30.421300 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26108): Process ended prematurely: osmo-stp_10.42.42.5(pid=26108) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26108)] [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 13:17:30.430836 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:17:30.458854 run osmo-hlr_10.42.42.2(pid=26105): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26105)] 13:17:30.509401 run osmo-hlr_10.42.42.2(pid=26105): stdout: | (launched: 2022-12-14_13:17:27.119079) 13:17:30.561220 run osmo-hlr_10.42.42.2(pid=26105): stderr: | 20221214131727317 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131727317 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131727317 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131727317 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131727317 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131727317 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131727333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131727343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131727343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131727343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:30.613598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26104): Terminating (SIGTERM) 13:17:30.655340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26107): Terminating (SIGTERM) 13:17:30.697539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26110): Terminating (SIGTERM) 13:17:30.740113 --- ParallelTerminationStrategy: PID 26104 died... 13:17:30.760532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26104): Terminated: ok {rc=0} 13:17:30.807191 --- ParallelTerminationStrategy: PID 26107 died... 13:17:30.827409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26107): Terminated: ok {rc=0} 13:17:30.883664 --- ParallelTerminationStrategy: PID 26110 died... 13:17:30.910745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26110): Terminated: ok {rc=0} 13:17:31.004172 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:17:32.356525 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:17:32.363399 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:17:32.397489 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:17:32.437372 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:17:32.526254 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:17:32.560522 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:17:32.599085 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:17:33.192122 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:17:33.245374 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:33.255979 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:17:33.325407 tst cs_paging_gprs_active.py: using LAC 41158 13:17:33.444732 tst cs_paging_gprs_active.py: using RAC 103 13:17:33.565715 tst cs_paging_gprs_active.py: using CellId 41158 13:17:33.684453 tst cs_paging_gprs_active.py: using BVCI 41159 13:17:33.794496 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:33.805253 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:33.815685 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:33.826179 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:33.836502 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:33.848126 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:33.859424 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:33.870385 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:33.881491 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:33.999672 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:34.115112 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:17:34.336299 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:34.663312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26119): Launched 13:17:34.944726 run iperf3-srv_10.42.42.10(pid=26120): Launched 13:17:35.066302 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:17:35.285512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:35.610996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26121): Launched 13:17:35.893089 run iperf3-srv_10.42.42.10(pid=26122): Launched 13:17:36.014207 tst cs_paging_gprs_active.py:38: start network... 13:17:36.233644 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:36.735655 run create_hlr_db(pid=26123): Launched 13:17:36.860071 bus /gobi_6: Setting Powered False 13:17:37.924325 run create_hlr_db(pid=26123): Terminated: ok {rc=0} 13:17:38.356788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26125): Launched 13:17:38.659316 run osmo-hlr_10.42.42.2(pid=26126): Launched 13:17:38.775819 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:39.297767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26128): Launched 13:17:39.600487 run osmo-stp_10.42.42.5(pid=26129): Launched 13:17:39.716461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:40.239449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26131): Launched 13:17:40.354423 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:40.609415 run patchelf(pid=26132): Launched 13:17:40.777641 run osmo-stp_10.42.42.5(pid=26129): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26129)] 13:17:40.905377 run osmo-stp_10.42.42.5(pid=26129): stdout: | (launched: 2022-12-14_13:17:39.545291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:41.034799 run osmo-stp_10.42.42.5(pid=26129): stderr: | 20221214131739717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131739717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131739717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131739718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131739718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131739718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131739718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:41.164255 run osmo-stp_10.42.42.5(pid=26129): stdout: | (launched: 2022-12-14_13:17:39.545291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:41.287993 run osmo-stp_10.42.42.5(pid=26129): stderr: | 20221214131739717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131739717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131739717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131739718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131739718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131739718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131739718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:41.434692 run patchelf(pid=26132): Terminating (SIGINT) 13:17:41.604911 run patchelf(pid=26132): Terminated: ok {rc=0} 13:17:41.727426 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26129): Process ended prematurely: osmo-stp_10.42.42.5(pid=26129) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26129)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:17:41.736755 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:17:41.763431 run osmo-hlr_10.42.42.2(pid=26126): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26126)] 13:17:41.810696 run osmo-hlr_10.42.42.2(pid=26126): stdout: | (launched: 2022-12-14_13:17:38.603907) 13:17:41.859697 run osmo-hlr_10.42.42.2(pid=26126): stderr: | 20221214131738781 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131738781 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131738781 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131738781 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131738781 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131738781 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131738793 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131738803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131738803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131738803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:41.909175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26119): Terminating (SIGTERM) 13:17:41.948710 run iperf3-srv_10.42.42.10(pid=26120): Terminating (SIGTERM) 13:17:41.987744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26121): Terminating (SIGTERM) 13:17:42.027323 run iperf3-srv_10.42.42.10(pid=26122): Terminating (SIGTERM) 13:17:42.066333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26125): Terminating (SIGTERM) 13:17:42.105407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26128): Terminating (SIGTERM) 13:17:42.144420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26131): Terminating (SIGTERM) 13:17:42.183766 --- ParallelTerminationStrategy: PID 26119 died... 13:17:42.202451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26119): Terminated: ok {rc=0} 13:17:42.245728 --- ParallelTerminationStrategy: PID 26120 died... 13:17:42.263779 run iperf3-srv_10.42.42.10(pid=26120): Terminated {rc=256} 13:17:42.306817 --- ParallelTerminationStrategy: PID 26121 died... 13:17:42.325249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26121): Terminated: ok {rc=0} 13:17:42.368581 --- ParallelTerminationStrategy: PID 26122 died... 13:17:42.386948 run iperf3-srv_10.42.42.10(pid=26122): Terminated {rc=256} 13:17:42.430093 --- ParallelTerminationStrategy: PID 26125 died... 13:17:42.448378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26125): Terminated: ok {rc=0} 13:17:42.491435 --- ParallelTerminationStrategy: PID 26128 died... 13:17:42.509794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26128): Terminated: ok {rc=0} 13:17:42.552915 --- ParallelTerminationStrategy: PID 26131 died... 13:17:42.571688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26131): Terminated: ok {rc=0} 13:17:42.653716 bus /gobi_0: Setting Powered False 13:17:43.751045 bus /gobi_0: Setting Powered False 13:17:44.868255 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:17:46.032399 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:46.044264 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:17:46.116624 tst iperf3.py: using LAC 41159 13:17:46.271898 tst iperf3.py: using RAC 104 13:17:46.396057 tst iperf3.py: using CellId 41159 13:17:46.550953 tst iperf3.py: using BVCI 41160 13:17:46.712409 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:46.725905 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:46.737995 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:46.749479 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:46.761833 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:46.773231 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:46.784655 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:46.795943 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:46.807563 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:46.924157 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:17:47.134100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:47.440489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26133): Launched 13:17:47.704570 run iperf3-srv_10.42.42.10(pid=26134): Launched 13:17:47.817415 tst iperf3.py:8: start network... 13:17:48.019605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:17:48.485764 run create_hlr_db(pid=26135): Launched 13:17:48.610368 bus /gobi_6: Setting Powered False 13:17:49.670674 run create_hlr_db(pid=26135): Terminated: ok {rc=0} 13:17:50.092064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26137): Launched 13:17:50.394573 run osmo-hlr_10.42.42.2(pid=26138): Launched 13:17:50.508476 run osmo-stp_10.42.42.5: Starting osmo-stp 13:17:51.032212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26140): Launched 13:17:51.334213 run osmo-stp_10.42.42.5(pid=26141): Launched 13:17:51.449083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:17:51.970658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26143): Launched 13:17:52.085506 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:17:52.339722 run patchelf(pid=26144): Launched 13:17:52.507589 run osmo-stp_10.42.42.5(pid=26141): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26141)] 13:17:52.635309 run osmo-stp_10.42.42.5(pid=26141): stdout: | (launched: 2022-12-14_13:17:51.278999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:52.764683 run osmo-stp_10.42.42.5(pid=26141): stderr: | 20221214131751448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131751448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131751448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131751449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131751451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131751451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131751451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:52.894043 run osmo-stp_10.42.42.5(pid=26141): stdout: | (launched: 2022-12-14_13:17:51.278999) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:17:53.017953 run osmo-stp_10.42.42.5(pid=26141): stderr: | 20221214131751448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131751448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131751448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131751449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131751451 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131751451 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131751451 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:17:53.164770 run patchelf(pid=26144): Terminating (SIGINT) 13:17:53.335058 run patchelf(pid=26144): Terminated: ok {rc=0} 13:17:53.457320 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26141): Process ended prematurely: osmo-stp_10.42.42.5(pid=26141) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26141)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 13:17:53.466563 tst iperf3.py:8: Test FAILED (7.5 sec) 13:17:53.493426 run osmo-hlr_10.42.42.2(pid=26138): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26138)] 13:17:53.541295 run osmo-hlr_10.42.42.2(pid=26138): stdout: | (launched: 2022-12-14_13:17:50.339203) 13:17:53.590822 run osmo-hlr_10.42.42.2(pid=26138): stderr: | 20221214131750514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131750514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131750514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131750514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131750514 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131750514 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131750526 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131750535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131750535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131750535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:17:53.641534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26133): Terminating (SIGTERM) 13:17:53.681311 run iperf3-srv_10.42.42.10(pid=26134): Terminating (SIGTERM) 13:17:53.720834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26137): Terminating (SIGTERM) 13:17:53.760489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26140): Terminating (SIGTERM) 13:17:53.800105 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26143): Terminating (SIGTERM) 13:17:53.840106 --- ParallelTerminationStrategy: PID 26133 died... 13:17:53.859190 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26133): Terminated: ok {rc=0} 13:17:53.903351 --- ParallelTerminationStrategy: PID 26134 died... 13:17:53.921800 run iperf3-srv_10.42.42.10(pid=26134): Terminated {rc=256} 13:17:53.965568 --- ParallelTerminationStrategy: PID 26137 died... 13:17:53.984063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26137): Terminated: ok {rc=0} 13:17:54.027707 --- ParallelTerminationStrategy: PID 26140 died... 13:17:54.046348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26140): Terminated: ok {rc=0} 13:17:54.090048 --- ParallelTerminationStrategy: PID 26143 died... 13:17:54.108469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26143): Terminated: ok {rc=0} 13:17:54.192214 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:17:55.341996 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:55.354091 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:17:55.424594 tst iperf3m4.py: using LAC 41160 13:17:55.550662 tst iperf3m4.py: using RAC 105 13:17:55.677401 tst iperf3m4.py: using CellId 41160 13:17:55.804410 tst iperf3m4.py: using BVCI 41161 13:17:55.923349 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:55.934607 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:55.945686 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:55.956684 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:55.967931 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:55.979218 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:55.990747 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:56.002116 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:17:56.013737 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:56.133978 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:56.253179 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:56.367559 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:17:56.488002 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:17:56.709146 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:57.035666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26145): Launched 13:17:57.318042 run iperf3-srv_10.42.42.10(pid=26147): Launched 13:17:57.439654 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:17:57.659544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:57.985643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26148): Launched 13:17:58.266901 run iperf3-srv_10.42.42.10(pid=26149): Launched 13:17:58.388785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:17:58.607983 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:58.933700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26150): Launched 13:17:59.214628 run iperf3-srv_10.42.42.10(pid=26151): Launched 13:17:59.336161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:17:59.555358 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:17:59.881250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26152): Launched 13:18:00.163045 run iperf3-srv_10.42.42.10(pid=26153): Launched 13:18:00.284808 tst iperf3m4.py:8: start network... 13:18:00.504217 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:01.052084 run create_hlr_db(pid=26154): Launched 13:18:01.208542 bus /gobi_6: Setting Powered False 13:18:02.270981 run create_hlr_db(pid=26154): Terminated: ok {rc=0} 13:18:02.753255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26156): Launched 13:18:03.055405 run osmo-hlr_10.42.42.2(pid=26157): Launched 13:18:03.170060 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:03.706923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26159): Launched 13:18:04.008928 run osmo-stp_10.42.42.5(pid=26160): Launched 13:18:04.123688 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:04.644379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26162): Launched 13:18:04.759762 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:05.014685 run patchelf(pid=26163): Launched 13:18:05.182363 run osmo-stp_10.42.42.5(pid=26160): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26160)] 13:18:05.309883 run osmo-stp_10.42.42.5(pid=26160): stdout: | (launched: 2022-12-14_13:18:03.953328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:05.439007 run osmo-stp_10.42.42.5(pid=26160): stderr: | 20221214131804125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131804125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131804125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131804126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131804126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131804126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131804126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:05.568383 run osmo-stp_10.42.42.5(pid=26160): stdout: | (launched: 2022-12-14_13:18:03.953328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:05.692494 run osmo-stp_10.42.42.5(pid=26160): stderr: | 20221214131804125 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131804125 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131804125 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131804126 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131804126 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131804126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131804126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:05.839879 run patchelf(pid=26163): Terminating (SIGINT) 13:18:06.009591 run patchelf(pid=26163): Terminated: ok {rc=0} 13:18:06.131918 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26160): Process ended prematurely: osmo-stp_10.42.42.5(pid=26160) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26160)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:18:06.141309 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:18:06.168439 run osmo-hlr_10.42.42.2(pid=26157): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26157)] 13:18:06.215651 run osmo-hlr_10.42.42.2(pid=26157): stdout: | (launched: 2022-12-14_13:18:02.999768) 13:18:06.264652 run osmo-hlr_10.42.42.2(pid=26157): stderr: | 20221214131803178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131803178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131803178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131803178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131803178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131803179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131803190 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131803201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131803201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131803201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:06.313973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26145): Terminating (SIGTERM) 13:18:06.353599 run iperf3-srv_10.42.42.10(pid=26147): Terminating (SIGTERM) 13:18:06.393194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26148): Terminating (SIGTERM) 13:18:06.432769 run iperf3-srv_10.42.42.10(pid=26149): Terminating (SIGTERM) 13:18:06.472239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26150): Terminating (SIGTERM) 13:18:06.511898 run iperf3-srv_10.42.42.10(pid=26151): Terminating (SIGTERM) 13:18:06.551328 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26152): Terminating (SIGTERM) 13:18:06.590965 run iperf3-srv_10.42.42.10(pid=26153): Terminating (SIGTERM) 13:18:06.630445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26156): Terminating (SIGTERM) 13:18:06.669974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26159): Terminating (SIGTERM) 13:18:06.709478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26162): Terminating (SIGTERM) 13:18:06.749298 --- ParallelTerminationStrategy: PID 26145 died... 13:18:06.768444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26145): Terminated: ok {rc=0} 13:18:06.812201 --- ParallelTerminationStrategy: PID 26147 died... 13:18:06.830705 run iperf3-srv_10.42.42.10(pid=26147): Terminated {rc=256} 13:18:06.874350 --- ParallelTerminationStrategy: PID 26148 died... 13:18:06.893011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26148): Terminated: ok {rc=0} 13:18:06.936627 --- ParallelTerminationStrategy: PID 26149 died... 13:18:06.955197 run iperf3-srv_10.42.42.10(pid=26149): Terminated {rc=256} 13:18:06.998713 --- ParallelTerminationStrategy: PID 26150 died... 13:18:07.017138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26150): Terminated: ok {rc=0} 13:18:07.060741 --- ParallelTerminationStrategy: PID 26151 died... 13:18:07.079149 run iperf3-srv_10.42.42.10(pid=26151): Terminated {rc=256} 13:18:07.122730 --- ParallelTerminationStrategy: PID 26152 died... 13:18:07.141311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26152): Terminated: ok {rc=0} 13:18:07.184875 --- ParallelTerminationStrategy: PID 26153 died... 13:18:07.203798 run iperf3-srv_10.42.42.10(pid=26153): Terminated {rc=256} 13:18:07.247199 --- ParallelTerminationStrategy: PID 26156 died... 13:18:07.265805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26156): Terminated: ok {rc=0} 13:18:07.309519 --- ParallelTerminationStrategy: PID 26159 died... 13:18:07.328205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26159): Terminated: ok {rc=0} 13:18:07.372016 --- ParallelTerminationStrategy: PID 26162 died... 13:18:07.390632 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26162): Terminated: ok {rc=0} 13:18:07.476080 bus /gobi_4: Setting Powered False 13:18:08.576799 bus /gobi_4: Setting Powered False 13:18:09.693684 bus /gobi_1: Setting Powered False 13:18:10.789031 bus /gobi_1: Setting Powered False 13:18:11.903803 bus /gobi_0: Setting Powered False 13:18:13.002688 bus /gobi_0: Setting Powered False 13:18:14.118491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:18:15.220496 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:15.231819 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:18:15.300896 tst ping.py: using LAC 41161 13:18:15.421410 tst ping.py: using RAC 106 13:18:15.537120 tst ping.py: using CellId 41161 13:18:15.651760 tst ping.py: using BVCI 41162 13:18:15.759347 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:15.770258 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:15.780852 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:15.791879 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:15.802552 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:15.813772 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:15.824477 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:15.847234 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:18:15.981012 tst ping.py:19: start network... 13:18:16.212209 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:16.726087 run create_hlr_db(pid=26164): Launched 13:18:16.888675 bus /gobi_6: Setting Powered False 13:18:17.952158 run create_hlr_db(pid=26164): Terminated: ok {rc=0} 13:18:18.396445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26166): Launched 13:18:18.715584 run osmo-hlr_10.42.42.2(pid=26167): Launched 13:18:18.837932 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:19.388332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26169): Launched 13:18:19.705992 run osmo-stp_10.42.42.5(pid=26170): Launched 13:18:19.827901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:20.378158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26172): Launched 13:18:20.499966 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:20.769944 run patchelf(pid=26173): Launched 13:18:20.946272 run osmo-stp_10.42.42.5(pid=26170): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26170)] 13:18:21.081165 run osmo-stp_10.42.42.5(pid=26170): stdout: | (launched: 2022-12-14_13:18:19.647952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:21.217634 run osmo-stp_10.42.42.5(pid=26170): stderr: | 20221214131819840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131819840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131819840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131819841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131819841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131819841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131819841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:21.354607 run osmo-stp_10.42.42.5(pid=26170): stdout: | (launched: 2022-12-14_13:18:19.647952) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:21.485085 run osmo-stp_10.42.42.5(pid=26170): stderr: | 20221214131819840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131819840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131819840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131819841 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131819841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131819841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131819841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:21.639609 run patchelf(pid=26173): Terminating (SIGINT) 13:18:21.818035 run patchelf(pid=26173): Terminated: ok {rc=0} 13:18:21.946939 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26170): Process ended prematurely: osmo-stp_10.42.42.5(pid=26170) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26170)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 13:18:21.956368 tst ping.py:22: Test FAILED (6.7 sec) 13:18:21.984524 run osmo-hlr_10.42.42.2(pid=26167): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26167)] 13:18:22.035149 run osmo-hlr_10.42.42.2(pid=26167): stdout: | (launched: 2022-12-14_13:18:18.657536) 13:18:22.087352 run osmo-hlr_10.42.42.2(pid=26167): stderr: | 20221214131818856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131818856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131818856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131818856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131818856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131818856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131818868 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131818876 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131818876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131818876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:22.139588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26166): Terminating (SIGTERM) 13:18:22.181884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26169): Terminating (SIGTERM) 13:18:22.224136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26172): Terminating (SIGTERM) 13:18:22.266556 --- ParallelTerminationStrategy: PID 26166 died... 13:18:22.287124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26166): Terminated: ok {rc=0} 13:18:22.334054 --- ParallelTerminationStrategy: PID 26169 died... 13:18:22.354191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26169): Terminated: ok {rc=0} 13:18:22.400741 --- ParallelTerminationStrategy: PID 26172 died... 13:18:22.420856 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26172): Terminated: ok {rc=0} 13:18:22.508677 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:18:23.596589 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:23.608586 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:18:23.679735 tst ping_idle_ping.py: using LAC 41162 13:18:23.799425 tst ping_idle_ping.py: using RAC 107 13:18:23.919257 tst ping_idle_ping.py: using CellId 41162 13:18:24.038846 tst ping_idle_ping.py: using BVCI 41163 13:18:24.156097 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:24.167639 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:24.178960 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:24.190407 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:24.202327 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:24.214373 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:24.226367 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:18:24.238364 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:18:24.355443 tst ping_idle_ping.py:24: start network... 13:18:24.572887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:25.077578 run create_hlr_db(pid=26174): Launched 13:18:25.199900 bus /gobi_6: Setting Powered False 13:18:26.262685 run create_hlr_db(pid=26174): Terminated: ok {rc=0} 13:18:26.688325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26176): Launched 13:18:26.985407 run osmo-hlr_10.42.42.2(pid=26177): Launched 13:18:27.098718 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:27.612318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26179): Launched 13:18:27.910243 run osmo-stp_10.42.42.5(pid=26180): Launched 13:18:28.023124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:28.535545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26182): Launched 13:18:28.648517 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:28.900159 run patchelf(pid=26183): Launched 13:18:29.065184 run osmo-stp_10.42.42.5(pid=26180): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26180)] 13:18:29.191200 run osmo-stp_10.42.42.5(pid=26180): stdout: | (launched: 2022-12-14_13:18:27.855360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:29.318149 run osmo-stp_10.42.42.5(pid=26180): stderr: | 20221214131828025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131828025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131828025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131828025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131828026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131828026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131828026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:29.445157 run osmo-stp_10.42.42.5(pid=26180): stdout: | (launched: 2022-12-14_13:18:27.855360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:29.567128 run osmo-stp_10.42.42.5(pid=26180): stderr: | 20221214131828025 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131828025 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131828025 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131828025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131828026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131828026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131828026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:29.711513 run patchelf(pid=26183): Terminating (SIGINT) 13:18:29.877958 run patchelf(pid=26183): Terminated: ok {rc=0} 13:18:29.998657 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26180): Process ended prematurely: osmo-stp_10.42.42.5(pid=26180) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26180)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:18:30.007408 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:18:30.033770 run osmo-hlr_10.42.42.2(pid=26177): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26177)] 13:18:30.080871 run osmo-hlr_10.42.42.2(pid=26177): stdout: | (launched: 2022-12-14_13:18:26.931006) 13:18:30.129770 run osmo-hlr_10.42.42.2(pid=26177): stderr: | 20221214131827107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131827107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131827107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131827107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131827107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131827107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131827118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131827127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131827127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131827127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:30.178752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26176): Terminating (SIGTERM) 13:18:30.217959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26179): Terminating (SIGTERM) 13:18:30.257128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26182): Terminating (SIGTERM) 13:18:30.296363 --- ParallelTerminationStrategy: PID 26176 died... 13:18:30.315179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26176): Terminated: ok {rc=0} 13:18:30.358800 --- ParallelTerminationStrategy: PID 26179 died... 13:18:30.377136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26179): Terminated: ok {rc=0} 13:18:30.420266 --- ParallelTerminationStrategy: PID 26182 died... 13:18:30.438521 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26182): Terminated: ok {rc=0} 13:18:30.523258 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:18:31.826723 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:18:31.833480 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:18:31.867623 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:18:31.906865 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:18:31.992616 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:18:32.026808 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:18:32.066636 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:18:32.657455 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:18:32.706311 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:32.717214 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:18:32.784593 tst cs_paging_gprs_active.py: using LAC 41163 13:18:32.904702 tst cs_paging_gprs_active.py: using RAC 108 13:18:33.022866 tst cs_paging_gprs_active.py: using CellId 41163 13:18:33.140408 tst cs_paging_gprs_active.py: using BVCI 41164 13:18:33.249731 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:33.260468 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:33.271026 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:33.281562 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:33.291942 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:33.303075 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:33.313832 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:33.324444 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:33.335274 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:33.450971 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:33.570833 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:18:33.791068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:34.117176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26187): Launched 13:18:34.399526 run iperf3-srv_10.42.42.10(pid=26188): Launched 13:18:34.521280 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:18:34.740917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:35.067068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26189): Launched 13:18:35.349592 run iperf3-srv_10.42.42.10(pid=26190): Launched 13:18:35.470926 tst cs_paging_gprs_active.py:38: start network... 13:18:35.690390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:36.194032 run create_hlr_db(pid=26191): Launched 13:18:36.318641 bus /gobi_6: Setting Powered False 13:18:37.382841 run create_hlr_db(pid=26191): Terminated: ok {rc=0} 13:18:37.834632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26193): Launched 13:18:38.159842 run osmo-hlr_10.42.42.2(pid=26194): Launched 13:18:38.283958 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:38.842857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26196): Launched 13:18:39.167661 run osmo-stp_10.42.42.5(pid=26197): Launched 13:18:39.291599 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:39.851659 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26200): Launched 13:18:39.975785 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:40.250205 run patchelf(pid=26201): Launched 13:18:40.430836 run osmo-stp_10.42.42.5(pid=26197): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26197)] 13:18:40.568289 run osmo-stp_10.42.42.5(pid=26197): stdout: | (launched: 2022-12-14_13:18:39.108678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:40.707610 run osmo-stp_10.42.42.5(pid=26197): stderr: | 20221214131839300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131839300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131839300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131839301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131839303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131839303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131839303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:40.847619 run osmo-stp_10.42.42.5(pid=26197): stdout: | (launched: 2022-12-14_13:18:39.108678) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:40.981040 run osmo-stp_10.42.42.5(pid=26197): stderr: | 20221214131839300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131839300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131839300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131839301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131839303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131839303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131839303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:41.139203 run patchelf(pid=26201): Terminating (SIGINT) 13:18:41.320683 run patchelf(pid=26201): Terminated: ok {rc=0} 13:18:41.452223 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26197): Process ended prematurely: osmo-stp_10.42.42.5(pid=26197) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26197)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:18:41.462426 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:18:41.490580 run osmo-hlr_10.42.42.2(pid=26194): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26194)] 13:18:41.541184 run osmo-hlr_10.42.42.2(pid=26194): stdout: | (launched: 2022-12-14_13:18:38.101025) 13:18:41.593185 run osmo-hlr_10.42.42.2(pid=26194): stderr: | 20221214131838297 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131838297 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131838297 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131838298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131838298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131838298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131838311 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131838319 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131838319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131838319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:41.645670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26187): Terminating (SIGTERM) 13:18:41.687248 run iperf3-srv_10.42.42.10(pid=26188): Terminating (SIGTERM) 13:18:41.729884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26189): Terminating (SIGTERM) 13:18:41.771778 run iperf3-srv_10.42.42.10(pid=26190): Terminating (SIGTERM) 13:18:41.814368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26193): Terminating (SIGTERM) 13:18:41.856532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26196): Terminating (SIGTERM) 13:18:41.898841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26200): Terminating (SIGTERM) 13:18:41.940677 --- ParallelTerminationStrategy: PID 26187 died... 13:18:41.960835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26187): Terminated: ok {rc=0} 13:18:42.007108 --- ParallelTerminationStrategy: PID 26188 died... 13:18:42.026696 run iperf3-srv_10.42.42.10(pid=26188): Terminated {rc=256} 13:18:42.072466 --- ParallelTerminationStrategy: PID 26189 died... 13:18:42.092005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26189): Terminated: ok {rc=0} 13:18:42.137592 --- ParallelTerminationStrategy: PID 26190 died... 13:18:42.157126 run iperf3-srv_10.42.42.10(pid=26190): Terminated {rc=256} 13:18:42.202592 --- ParallelTerminationStrategy: PID 26193 died... 13:18:42.222143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26193): Terminated: ok {rc=0} 13:18:42.267818 --- ParallelTerminationStrategy: PID 26196 died... 13:18:42.287426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26196): Terminated: ok {rc=0} 13:18:42.333287 --- ParallelTerminationStrategy: PID 26200 died... 13:18:42.352855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26200): Terminated: ok {rc=0} 13:18:42.439920 bus /gobi_0: Setting Powered False 13:18:43.538182 bus /gobi_0: Setting Powered False 13:18:44.653174 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:18:45.801669 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:45.813465 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:18:45.910275 tst iperf3.py: using LAC 41164 13:18:46.042228 tst iperf3.py: using RAC 109 13:18:46.170977 tst iperf3.py: using CellId 41164 13:18:46.329413 tst iperf3.py: using BVCI 41165 13:18:46.444396 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:46.456102 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:46.467536 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:46.479040 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:46.490729 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:46.503674 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:46.515436 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:46.527070 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:46.538880 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:46.677652 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:18:46.889173 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:47.211313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26203): Launched 13:18:47.480426 run iperf3-srv_10.42.42.10(pid=26204): Launched 13:18:47.594862 tst iperf3.py:8: start network... 13:18:47.797654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:18:48.265203 run create_hlr_db(pid=26206): Launched 13:18:48.389392 bus /gobi_6: Setting Powered False 13:18:49.449176 run create_hlr_db(pid=26206): Terminated: ok {rc=0} 13:18:49.868855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26208): Launched 13:18:50.170694 run osmo-hlr_10.42.42.2(pid=26209): Launched 13:18:50.284566 run osmo-stp_10.42.42.5: Starting osmo-stp 13:18:50.803944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26211): Launched 13:18:51.106108 run osmo-stp_10.42.42.5(pid=26212): Launched 13:18:51.220663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:18:51.739529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26214): Launched 13:18:51.854766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:18:52.110026 run patchelf(pid=26215): Launched 13:18:52.278060 run osmo-stp_10.42.42.5(pid=26212): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26212)] 13:18:52.405715 run osmo-stp_10.42.42.5(pid=26212): stdout: | (launched: 2022-12-14_13:18:51.050739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:52.534708 run osmo-stp_10.42.42.5(pid=26212): stderr: | 20221214131851220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131851220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131851220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131851221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131851221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131851221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131851221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:52.664279 run osmo-stp_10.42.42.5(pid=26212): stdout: | (launched: 2022-12-14_13:18:51.050739) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:18:52.787972 run osmo-stp_10.42.42.5(pid=26212): stderr: | 20221214131851220 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131851220 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131851220 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131851221 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131851221 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131851221 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131851221 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:18:52.934837 run patchelf(pid=26215): Terminating (SIGINT) 13:18:53.103831 run patchelf(pid=26215): Terminated: ok {rc=0} 13:18:53.225784 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26212): Process ended prematurely: osmo-stp_10.42.42.5(pid=26212) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26212)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 13:18:53.235055 tst iperf3.py:8: Test FAILED (7.5 sec) 13:18:53.261903 run osmo-hlr_10.42.42.2(pid=26209): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26209)] 13:18:53.309673 run osmo-hlr_10.42.42.2(pid=26209): stdout: | (launched: 2022-12-14_13:18:50.115967) 13:18:53.358788 run osmo-hlr_10.42.42.2(pid=26209): stderr: | 20221214131850290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131850290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131850290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131850290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131850290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131850290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131850306 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131850317 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131850317 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131850317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:18:53.408492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26203): Terminating (SIGTERM) 13:18:53.448227 run iperf3-srv_10.42.42.10(pid=26204): Terminating (SIGTERM) 13:18:53.488028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26208): Terminating (SIGTERM) 13:18:53.528047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26211): Terminating (SIGTERM) 13:18:53.568003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26214): Terminating (SIGTERM) 13:18:53.607943 --- ParallelTerminationStrategy: PID 26203 died... 13:18:53.627257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26203): Terminated: ok {rc=0} 13:18:53.671458 --- ParallelTerminationStrategy: PID 26204 died... 13:18:53.690227 run iperf3-srv_10.42.42.10(pid=26204): Terminated {rc=256} 13:18:53.734398 --- ParallelTerminationStrategy: PID 26208 died... 13:18:53.753261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26208): Terminated: ok {rc=0} 13:18:53.797162 --- ParallelTerminationStrategy: PID 26211 died... 13:18:53.815900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26211): Terminated: ok {rc=0} 13:18:53.859659 --- ParallelTerminationStrategy: PID 26214 died... 13:18:53.878427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26214): Terminated: ok {rc=0} 13:18:53.961655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:18:55.110416 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:55.122276 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:18:55.194599 tst iperf3m4.py: using LAC 41165 13:18:55.322996 tst iperf3m4.py: using RAC 110 13:18:55.449905 tst iperf3m4.py: using CellId 41165 13:18:55.577612 tst iperf3m4.py: using BVCI 41166 13:18:55.687742 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:55.698770 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:55.709966 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:55.720693 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:55.731704 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:55.742741 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:55.753960 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:55.764673 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:18:55.775848 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:55.896493 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:56.014896 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:56.134993 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:18:56.251301 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:18:56.455211 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:56.758538 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26216): Launched 13:18:57.023137 run iperf3-srv_10.42.42.10(pid=26217): Launched 13:18:57.136502 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:18:57.338765 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:57.640671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26218): Launched 13:18:57.904157 run iperf3-srv_10.42.42.10(pid=26219): Launched 13:18:58.016733 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:18:58.219770 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:58.521390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26220): Launched 13:18:58.783702 run iperf3-srv_10.42.42.10(pid=26221): Launched 13:18:58.896772 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:18:59.098821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:18:59.401417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26222): Launched 13:18:59.663687 run iperf3-srv_10.42.42.10(pid=26223): Launched 13:18:59.776580 tst iperf3m4.py:8: start network... 13:18:59.978041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:00.445081 run create_hlr_db(pid=26224): Launched 13:19:00.568676 bus /gobi_6: Setting Powered False 13:19:01.638672 run create_hlr_db(pid=26224): Terminated: ok {rc=0} 13:19:02.115440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26245): Launched 13:19:02.429366 run osmo-hlr_10.42.42.2(pid=26246): Launched 13:19:02.543985 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:03.062568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26248): Launched 13:19:03.362905 run osmo-stp_10.42.42.5(pid=26250): Launched 13:19:03.477035 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:03.996299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26252): Launched 13:19:04.111726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:04.366906 run patchelf(pid=26253): Launched 13:19:04.534186 run osmo-stp_10.42.42.5(pid=26250): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26250)] 13:19:04.661855 run osmo-stp_10.42.42.5(pid=26250): stdout: | (launched: 2022-12-14_13:19:03.307699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:04.790885 run osmo-stp_10.42.42.5(pid=26250): stderr: | 20221214131903478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131903479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131903479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131903479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131903480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131903480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131903480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:04.920418 run osmo-stp_10.42.42.5(pid=26250): stdout: | (launched: 2022-12-14_13:19:03.307699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:05.044355 run osmo-stp_10.42.42.5(pid=26250): stderr: | 20221214131903478 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131903479 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131903479 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131903479 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131903480 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131903480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131903480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:05.191621 run patchelf(pid=26253): Terminating (SIGINT) 13:19:05.360746 run patchelf(pid=26253): Terminated: ok {rc=0} 13:19:05.482879 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26250): Process ended prematurely: osmo-stp_10.42.42.5(pid=26250) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26250)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:19:05.492206 tst iperf3m4.py:8: Test FAILED (10.4 sec) 13:19:05.519256 run osmo-hlr_10.42.42.2(pid=26246): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26246)] 13:19:05.566433 run osmo-hlr_10.42.42.2(pid=26246): stdout: | (launched: 2022-12-14_13:19:02.374361) 13:19:05.615089 run osmo-hlr_10.42.42.2(pid=26246): stderr: | 20221214131902554 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131902554 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131902554 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131902554 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131902554 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131902554 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131902566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131902575 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131902575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131902575 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:05.664909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26216): Terminating (SIGTERM) 13:19:05.704653 run iperf3-srv_10.42.42.10(pid=26217): Terminating (SIGTERM) 13:19:05.744427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26218): Terminating (SIGTERM) 13:19:05.784258 run iperf3-srv_10.42.42.10(pid=26219): Terminating (SIGTERM) 13:19:05.823976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26220): Terminating (SIGTERM) 13:19:05.863506 run iperf3-srv_10.42.42.10(pid=26221): Terminating (SIGTERM) 13:19:05.902904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26222): Terminating (SIGTERM) 13:19:05.942419 run iperf3-srv_10.42.42.10(pid=26223): Terminating (SIGTERM) 13:19:05.981808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26245): Terminating (SIGTERM) 13:19:06.021469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26248): Terminating (SIGTERM) 13:19:06.060999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26252): Terminating (SIGTERM) 13:19:06.100809 --- ParallelTerminationStrategy: PID 26216 died... 13:19:06.120209 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26216): Terminated: ok {rc=0} 13:19:06.164287 --- ParallelTerminationStrategy: PID 26217 died... 13:19:06.183103 run iperf3-srv_10.42.42.10(pid=26217): Terminated {rc=256} 13:19:06.227452 --- ParallelTerminationStrategy: PID 26218 died... 13:19:06.246229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26218): Terminated: ok {rc=0} 13:19:06.290111 --- ParallelTerminationStrategy: PID 26219 died... 13:19:06.308805 run iperf3-srv_10.42.42.10(pid=26219): Terminated {rc=256} 13:19:06.352406 --- ParallelTerminationStrategy: PID 26220 died... 13:19:06.371200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26220): Terminated: ok {rc=0} 13:19:06.415024 --- ParallelTerminationStrategy: PID 26221 died... 13:19:06.433691 run iperf3-srv_10.42.42.10(pid=26221): Terminated {rc=256} 13:19:06.477241 --- ParallelTerminationStrategy: PID 26222 died... 13:19:06.496056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26222): Terminated: ok {rc=0} 13:19:06.539911 --- ParallelTerminationStrategy: PID 26223 died... 13:19:06.558567 run iperf3-srv_10.42.42.10(pid=26223): Terminated {rc=256} 13:19:06.602110 --- ParallelTerminationStrategy: PID 26245 died... 13:19:06.620906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26245): Terminated: ok {rc=0} 13:19:06.664790 --- ParallelTerminationStrategy: PID 26248 died... 13:19:06.683965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26248): Terminated: ok {rc=0} 13:19:06.727723 --- ParallelTerminationStrategy: PID 26252 died... 13:19:06.746454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26252): Terminated: ok {rc=0} 13:19:06.831623 bus /gobi_4: Setting Powered False 13:19:07.932751 bus /gobi_4: Setting Powered False 13:19:09.050406 bus /gobi_1: Setting Powered False 13:19:10.147555 bus /gobi_1: Setting Powered False 13:19:11.261842 bus /gobi_0: Setting Powered False 13:19:12.360470 bus /gobi_0: Setting Powered False 13:19:13.476520 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:19:14.577744 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:14.590011 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:19:14.662294 tst ping.py: using LAC 41166 13:19:14.789171 tst ping.py: using RAC 111 13:19:14.915325 tst ping.py: using CellId 41166 13:19:15.041301 tst ping.py: using BVCI 41167 13:19:15.157284 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:15.168610 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:15.179829 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:15.190988 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:15.202451 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:15.213921 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:15.225449 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:15.236754 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:19:15.351689 tst ping.py:19: start network... 13:19:15.551261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:16.044338 run create_hlr_db(pid=26254): Launched 13:19:16.201233 bus /gobi_6: Setting Powered False 13:19:17.262864 run create_hlr_db(pid=26254): Terminated: ok {rc=0} 13:19:17.711223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26256): Launched 13:19:18.031147 run osmo-hlr_10.42.42.2(pid=26257): Launched 13:19:18.153481 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:18.712436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26259): Launched 13:19:19.032306 run osmo-stp_10.42.42.5(pid=26260): Launched 13:19:19.154693 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:19.705903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26262): Launched 13:19:19.828905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:20.098589 run patchelf(pid=26263): Launched 13:19:20.276702 run osmo-stp_10.42.42.5(pid=26260): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26260)] 13:19:20.412443 run osmo-stp_10.42.42.5(pid=26260): stdout: | (launched: 2022-12-14_13:19:18.974182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:20.549542 run osmo-stp_10.42.42.5(pid=26260): stderr: | 20221214131919168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131919168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131919168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131919169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131919169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131919169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131919169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:20.686696 run osmo-stp_10.42.42.5(pid=26260): stdout: | (launched: 2022-12-14_13:19:18.974182) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:20.818865 run osmo-stp_10.42.42.5(pid=26260): stderr: | 20221214131919168 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131919168 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131919168 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131919169 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131919169 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131919169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131919169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:20.974700 run patchelf(pid=26263): Terminating (SIGINT) 13:19:21.152715 run patchelf(pid=26263): Terminated: ok {rc=0} 13:19:21.281122 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26260): Process ended prematurely: osmo-stp_10.42.42.5(pid=26260) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26260)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 13:19:21.290554 tst ping.py:22: Test FAILED (6.7 sec) 13:19:21.318490 run osmo-hlr_10.42.42.2(pid=26257): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26257)] 13:19:21.369216 run osmo-hlr_10.42.42.2(pid=26257): stdout: | (launched: 2022-12-14_13:19:17.973004) 13:19:21.421422 run osmo-hlr_10.42.42.2(pid=26257): stderr: | 20221214131918170 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131918170 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131918170 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131918170 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131918170 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131918170 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131918183 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131918192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131918192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131918192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:21.473909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26256): Terminating (SIGTERM) 13:19:21.516328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26259): Terminating (SIGTERM) 13:19:21.558997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26262): Terminating (SIGTERM) 13:19:21.601496 --- ParallelTerminationStrategy: PID 26256 died... 13:19:21.621847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26256): Terminated: ok {rc=0} 13:19:21.668243 --- ParallelTerminationStrategy: PID 26259 died... 13:19:21.688044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26259): Terminated: ok {rc=0} 13:19:21.734740 --- ParallelTerminationStrategy: PID 26262 died... 13:19:21.754841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26262): Terminated: ok {rc=0} 13:19:21.843116 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:19:22.928864 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:22.940837 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:19:23.012036 tst ping_idle_ping.py: using LAC 41167 13:19:23.132076 tst ping_idle_ping.py: using RAC 112 13:19:23.249053 tst ping_idle_ping.py: using CellId 41167 13:19:23.366290 tst ping_idle_ping.py: using BVCI 41168 13:19:23.477015 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:23.487829 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:23.498461 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:23.509117 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:23.519586 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:23.530777 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:23.541844 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:19:23.552501 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:19:23.670064 tst ping_idle_ping.py:24: start network... 13:19:23.886732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:24.385328 run create_hlr_db(pid=26265): Launched 13:19:24.509056 bus /gobi_6: Setting Powered False 13:19:25.572638 run create_hlr_db(pid=26265): Terminated: ok {rc=0} 13:19:26.018048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26267): Launched 13:19:26.338489 run osmo-hlr_10.42.42.2(pid=26268): Launched 13:19:26.460514 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:27.011741 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26270): Launched 13:19:27.333246 run osmo-stp_10.42.42.5(pid=26271): Launched 13:19:27.455493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:28.007947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26273): Launched 13:19:28.130118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:28.399716 run patchelf(pid=26274): Launched 13:19:28.577394 run osmo-stp_10.42.42.5(pid=26271): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26271)] 13:19:28.713198 run osmo-stp_10.42.42.5(pid=26271): stdout: | (launched: 2022-12-14_13:19:27.274799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:28.850661 run osmo-stp_10.42.42.5(pid=26271): stderr: | 20221214131927468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131927468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131927468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131927469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131927469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131927469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131927469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:28.987883 run osmo-stp_10.42.42.5(pid=26271): stdout: | (launched: 2022-12-14_13:19:27.274799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:29.119427 run osmo-stp_10.42.42.5(pid=26271): stderr: | 20221214131927468 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131927468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131927468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131927469 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131927469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131927469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131927469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:29.275320 run patchelf(pid=26274): Terminating (SIGINT) 13:19:29.453761 run patchelf(pid=26274): Terminated: ok {rc=0} 13:19:29.582450 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26271): Process ended prematurely: osmo-stp_10.42.42.5(pid=26271) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26271)] [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:19:29.591773 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:19:29.619716 run osmo-hlr_10.42.42.2(pid=26268): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26268)] 13:19:29.669885 run osmo-hlr_10.42.42.2(pid=26268): stdout: | (launched: 2022-12-14_13:19:26.280316) 13:19:29.721454 run osmo-hlr_10.42.42.2(pid=26268): stderr: | 20221214131926479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131926479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131926479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131926479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131926479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131926479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131926490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131926500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131926500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131926500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:29.773698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26267): Terminating (SIGTERM) 13:19:29.815776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26270): Terminating (SIGTERM) 13:19:29.857552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26273): Terminating (SIGTERM) 13:19:29.899929 --- ParallelTerminationStrategy: PID 26267 died... 13:19:29.920168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26267): Terminated: ok {rc=0} 13:19:29.966547 --- ParallelTerminationStrategy: PID 26270 died... 13:19:29.986435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26270): Terminated: ok {rc=0} 13:19:30.032739 --- ParallelTerminationStrategy: PID 26273 died... 13:19:30.052553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26273): Terminated: ok {rc=0} 13:19:30.140729 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:19:31.449048 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:19:31.460371 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:19:31.502723 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:19:31.555178 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:19:31.666903 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:19:31.709586 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:19:31.752655 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:19:32.348399 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:19:32.401574 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:32.413226 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:19:32.468846 tst cs_paging_gprs_active.py: using LAC 41168 13:19:32.596672 tst cs_paging_gprs_active.py: using RAC 113 13:19:32.722870 tst cs_paging_gprs_active.py: using CellId 41168 13:19:32.849093 tst cs_paging_gprs_active.py: using BVCI 41169 13:19:32.967430 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:32.979193 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:32.990619 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:33.002149 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:33.013847 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:33.025549 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:33.037573 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:33.049385 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:33.061519 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:19:33.179809 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:19:33.296277 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:19:33.501089 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:33.807477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26278): Launched 13:19:34.071465 run iperf3-srv_10.42.42.10(pid=26279): Launched 13:19:34.185150 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:19:34.388652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:34.694433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26280): Launched 13:19:34.959564 run iperf3-srv_10.42.42.10(pid=26281): Launched 13:19:35.073576 tst cs_paging_gprs_active.py:38: start network... 13:19:35.277170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:35.746839 run create_hlr_db(pid=26282): Launched 13:19:35.871282 bus /gobi_6: Setting Powered False 13:19:36.931721 run create_hlr_db(pid=26282): Terminated: ok {rc=0} 13:19:37.376048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26284): Launched 13:19:37.701560 run osmo-hlr_10.42.42.2(pid=26285): Launched 13:19:37.826063 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:38.384740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26287): Launched 13:19:38.709206 run osmo-stp_10.42.42.5(pid=26288): Launched 13:19:38.833520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:39.394614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26290): Launched 13:19:39.519357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:39.794023 run patchelf(pid=26291): Launched 13:19:39.975268 run osmo-stp_10.42.42.5(pid=26288): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26288)] 13:19:40.113482 run osmo-stp_10.42.42.5(pid=26288): stdout: | (launched: 2022-12-14_13:19:38.650405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:40.252521 run osmo-stp_10.42.42.5(pid=26288): stderr: | 20221214131938845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131938845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131938845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131938846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131938846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131938846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131938846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:40.391945 run osmo-stp_10.42.42.5(pid=26288): stdout: | (launched: 2022-12-14_13:19:38.650405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:40.526421 run osmo-stp_10.42.42.5(pid=26288): stderr: | 20221214131938845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131938845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131938845 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131938846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131938846 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131938846 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131938846 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:40.684840 run patchelf(pid=26291): Terminating (SIGINT) 13:19:40.866861 run patchelf(pid=26291): Terminated: ok {rc=0} 13:19:40.997810 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26288): Process ended prematurely: osmo-stp_10.42.42.5(pid=26288) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26288)] [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:19:41.007945 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:19:41.036425 run osmo-hlr_10.42.42.2(pid=26285): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26285)] 13:19:41.087161 run osmo-hlr_10.42.42.2(pid=26285): stdout: | (launched: 2022-12-14_13:19:37.642932) 13:19:41.139347 run osmo-hlr_10.42.42.2(pid=26285): stderr: | 20221214131937844 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131937844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131937844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131937845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131937845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131937845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131937857 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131937865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131937865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131937865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:41.192258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26278): Terminating (SIGTERM) 13:19:41.234081 run iperf3-srv_10.42.42.10(pid=26279): Terminating (SIGTERM) 13:19:41.276775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26280): Terminating (SIGTERM) 13:19:41.319025 run iperf3-srv_10.42.42.10(pid=26281): Terminating (SIGTERM) 13:19:41.361474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26284): Terminating (SIGTERM) 13:19:41.403635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26287): Terminating (SIGTERM) 13:19:41.446100 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26290): Terminating (SIGTERM) 13:19:41.488423 --- ParallelTerminationStrategy: PID 26278 died... 13:19:41.508837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26278): Terminated: ok {rc=0} 13:19:41.555857 --- ParallelTerminationStrategy: PID 26279 died... 13:19:41.575799 run iperf3-srv_10.42.42.10(pid=26279): Terminated {rc=256} 13:19:41.622370 --- ParallelTerminationStrategy: PID 26280 died... 13:19:41.642450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26280): Terminated: ok {rc=0} 13:19:41.688866 --- ParallelTerminationStrategy: PID 26281 died... 13:19:41.709369 run iperf3-srv_10.42.42.10(pid=26281): Terminated {rc=256} 13:19:41.756027 --- ParallelTerminationStrategy: PID 26284 died... 13:19:41.776043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26284): Terminated: ok {rc=0} 13:19:41.822526 --- ParallelTerminationStrategy: PID 26287 died... 13:19:41.842400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26287): Terminated: ok {rc=0} 13:19:41.888875 --- ParallelTerminationStrategy: PID 26290 died... 13:19:41.909310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26290): Terminated: ok {rc=0} 13:19:41.997287 bus /gobi_0: Setting Powered False 13:19:43.096226 bus /gobi_0: Setting Powered False 13:19:44.211322 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:19:45.362402 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:45.374933 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:19:45.431089 tst iperf3.py: using LAC 41169 13:19:45.559312 tst iperf3.py: using RAC 114 13:19:45.686523 tst iperf3.py: using CellId 41169 13:19:45.815483 tst iperf3.py: using BVCI 41170 13:19:45.937085 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:45.950056 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:45.962673 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:45.975061 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:45.988250 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:46.001864 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:46.015368 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:46.028522 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:46.041967 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:19:46.164662 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:19:46.390302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:46.714324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26292): Launched 13:19:47.008553 run iperf3-srv_10.42.42.10(pid=26293): Launched 13:19:47.143141 tst iperf3.py:8: start network... 13:19:47.351013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:19:47.821173 run create_hlr_db(pid=26294): Launched 13:19:47.945263 bus /gobi_6: Setting Powered False 13:19:49.005665 run create_hlr_db(pid=26294): Terminated: ok {rc=0} 13:19:49.448743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26296): Launched 13:19:49.773860 run osmo-hlr_10.42.42.2(pid=26297): Launched 13:19:49.898418 run osmo-stp_10.42.42.5: Starting osmo-stp 13:19:50.459007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26299): Launched 13:19:50.784733 run osmo-stp_10.42.42.5(pid=26300): Launched 13:19:50.909400 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:19:51.469790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26302): Launched 13:19:51.595067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:19:51.870632 run patchelf(pid=26303): Launched 13:19:52.051451 run osmo-stp_10.42.42.5(pid=26300): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26300)] 13:19:52.189153 run osmo-stp_10.42.42.5(pid=26300): stdout: | (launched: 2022-12-14_13:19:50.725607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:52.328239 run osmo-stp_10.42.42.5(pid=26300): stderr: | 20221214131950918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131950918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131950919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131950919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131950920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131950920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131950920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:52.467704 run osmo-stp_10.42.42.5(pid=26300): stdout: | (launched: 2022-12-14_13:19:50.725607) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:19:52.601609 run osmo-stp_10.42.42.5(pid=26300): stderr: | 20221214131950918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214131950918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214131950919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214131950919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214131950920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214131950920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214131950920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:19:52.760765 run patchelf(pid=26303): Terminating (SIGINT) 13:19:52.943404 run patchelf(pid=26303): Terminated: ok {rc=0} 13:19:53.075353 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26300): Process ended prematurely: osmo-stp_10.42.42.5(pid=26300) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26300)] [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:19:53.085504 tst iperf3.py:8: Test FAILED (7.8 sec) 13:19:53.114215 run osmo-hlr_10.42.42.2(pid=26297): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26297)] 13:19:53.166579 run osmo-hlr_10.42.42.2(pid=26297): stdout: | (launched: 2022-12-14_13:19:49.714755) 13:19:53.218763 run osmo-hlr_10.42.42.2(pid=26297): stderr: | 20221214131949913 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214131949913 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214131949913 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214131949913 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214131949913 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214131949913 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214131949926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214131949934 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214131949934 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214131949934 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:19:53.272099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26292): Terminating (SIGTERM) 13:19:53.314197 run iperf3-srv_10.42.42.10(pid=26293): Terminating (SIGTERM) 13:19:53.356425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26296): Terminating (SIGTERM) 13:19:53.399071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26299): Terminating (SIGTERM) 13:19:53.441512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26302): Terminating (SIGTERM) 13:19:53.484511 --- ParallelTerminationStrategy: PID 26292 died... 13:19:53.505307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26292): Terminated: ok {rc=0} 13:19:53.552161 --- ParallelTerminationStrategy: PID 26293 died... 13:19:53.572091 run iperf3-srv_10.42.42.10(pid=26293): Terminated {rc=256} 13:19:53.618872 --- ParallelTerminationStrategy: PID 26296 died... 13:19:53.639000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26296): Terminated: ok {rc=0} 13:19:53.685297 --- ParallelTerminationStrategy: PID 26299 died... 13:19:53.704879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26299): Terminated: ok {rc=0} 13:19:53.751543 --- ParallelTerminationStrategy: PID 26302 died... 13:19:53.771643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26302): Terminated: ok {rc=0} 13:19:53.860075 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:19:55.009907 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:55.022401 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:19:55.076078 tst iperf3m4.py: using LAC 41170 13:19:55.204035 tst iperf3m4.py: using RAC 115 13:19:55.330370 tst iperf3m4.py: using CellId 41170 13:19:55.456674 tst iperf3m4.py: using BVCI 41171 13:19:55.574561 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:55.586344 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:55.597869 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:55.609383 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:55.621149 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:55.632895 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:55.644756 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:55.656370 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:19:55.668404 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:19:55.785356 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:19:55.907540 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:19:56.024037 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:19:56.144893 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:19:56.366916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:56.694655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26304): Launched 13:19:56.977965 run iperf3-srv_10.42.42.10(pid=26305): Launched 13:19:57.099641 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:19:57.320024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:57.646364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26306): Launched 13:19:57.929436 run iperf3-srv_10.42.42.10(pid=26308): Launched 13:19:58.051170 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:19:58.271057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:58.597363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26309): Launched 13:19:58.880448 run iperf3-srv_10.42.42.10(pid=26310): Launched 13:19:59.001897 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:19:59.220590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:19:59.545662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26311): Launched 13:19:59.828201 run iperf3-srv_10.42.42.10(pid=26312): Launched 13:19:59.949445 tst iperf3m4.py:8: start network... 13:20:00.168577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:00.671299 run create_hlr_db(pid=26313): Launched 13:20:00.794760 bus /gobi_6: Setting Powered False 13:20:01.869192 run create_hlr_db(pid=26313): Terminated: ok {rc=0} 13:20:02.339596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26318): Launched 13:20:02.673096 run osmo-hlr_10.42.42.2(pid=26319): Launched 13:20:02.798296 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:03.362963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26321): Launched 13:20:03.687522 run osmo-stp_10.42.42.5(pid=26322): Launched 13:20:03.811715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:04.371101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26324): Launched 13:20:04.495482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:04.769137 run patchelf(pid=26325): Launched 13:20:04.949403 run osmo-stp_10.42.42.5(pid=26322): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26322)] 13:20:05.086649 run osmo-stp_10.42.42.5(pid=26322): stdout: | (launched: 2022-12-14_13:20:03.628804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:05.225490 run osmo-stp_10.42.42.5(pid=26322): stderr: | 20221214132003820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132003820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132003821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132003821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132003822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132003822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132003822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:05.364221 run osmo-stp_10.42.42.5(pid=26322): stdout: | (launched: 2022-12-14_13:20:03.628804) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:05.497284 run osmo-stp_10.42.42.5(pid=26322): stderr: | 20221214132003820 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132003820 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132003821 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132003821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132003822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132003822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132003822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:05.655383 run patchelf(pid=26325): Terminating (SIGINT) 13:20:05.837620 run patchelf(pid=26325): Terminated: ok {rc=0} 13:20:05.968713 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26322): Process ended prematurely: osmo-stp_10.42.42.5(pid=26322) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26322)] [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:20:05.979039 tst iperf3m4.py:8: Test FAILED (11.0 sec) 13:20:06.007387 run osmo-hlr_10.42.42.2(pid=26319): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26319)] 13:20:06.057874 run osmo-hlr_10.42.42.2(pid=26319): stdout: | (launched: 2022-12-14_13:20:02.613586) 13:20:06.109883 run osmo-hlr_10.42.42.2(pid=26319): stderr: | 20221214132002813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132002813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132002813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132002813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132002813 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132002813 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132002826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132002834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132002834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132002834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:06.161788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26304): Terminating (SIGTERM) 13:20:06.203520 run iperf3-srv_10.42.42.10(pid=26305): Terminating (SIGTERM) 13:20:06.245379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26306): Terminating (SIGTERM) 13:20:06.287317 run iperf3-srv_10.42.42.10(pid=26308): Terminating (SIGTERM) 13:20:06.329301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26309): Terminating (SIGTERM) 13:20:06.370796 run iperf3-srv_10.42.42.10(pid=26310): Terminating (SIGTERM) 13:20:06.412641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26311): Terminating (SIGTERM) 13:20:06.454174 run iperf3-srv_10.42.42.10(pid=26312): Terminating (SIGTERM) 13:20:06.495438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26318): Terminating (SIGTERM) 13:20:06.537498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26321): Terminating (SIGTERM) 13:20:06.579494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26324): Terminating (SIGTERM) 13:20:06.621746 --- ParallelTerminationStrategy: PID 26304 died... 13:20:06.641902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26304): Terminated: ok {rc=0} 13:20:06.688275 --- ParallelTerminationStrategy: PID 26305 died... 13:20:06.708115 run iperf3-srv_10.42.42.10(pid=26305): Terminated {rc=256} 13:20:06.754130 --- ParallelTerminationStrategy: PID 26306 died... 13:20:06.774156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26306): Terminated: ok {rc=0} 13:20:06.820386 --- ParallelTerminationStrategy: PID 26308 died... 13:20:06.840146 run iperf3-srv_10.42.42.10(pid=26308): Terminated {rc=256} 13:20:06.886138 --- ParallelTerminationStrategy: PID 26309 died... 13:20:06.905887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26309): Terminated: ok {rc=0} 13:20:06.951863 --- ParallelTerminationStrategy: PID 26310 died... 13:20:06.971526 run iperf3-srv_10.42.42.10(pid=26310): Terminated {rc=256} 13:20:07.017466 --- ParallelTerminationStrategy: PID 26311 died... 13:20:07.037206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26311): Terminated: ok {rc=0} 13:20:07.083248 --- ParallelTerminationStrategy: PID 26312 died... 13:20:07.102918 run iperf3-srv_10.42.42.10(pid=26312): Terminated {rc=256} 13:20:07.149035 --- ParallelTerminationStrategy: PID 26318 died... 13:20:07.169185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26318): Terminated: ok {rc=0} 13:20:07.215161 --- ParallelTerminationStrategy: PID 26321 died... 13:20:07.235049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26321): Terminated: ok {rc=0} 13:20:07.281217 --- ParallelTerminationStrategy: PID 26324 died... 13:20:07.300795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26324): Terminated: ok {rc=0} 13:20:07.387520 bus /gobi_4: Setting Powered False 13:20:08.485457 bus /gobi_4: Setting Powered False 13:20:09.600293 bus /gobi_1: Setting Powered False 13:20:10.698650 bus /gobi_1: Setting Powered False 13:20:11.810464 bus /gobi_0: Setting Powered False 13:20:12.906698 bus /gobi_0: Setting Powered False 13:20:14.022372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:20:15.123986 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:15.136287 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:20:15.190969 tst ping.py: using LAC 41171 13:20:15.316681 tst ping.py: using RAC 116 13:20:15.441384 tst ping.py: using CellId 41171 13:20:15.567537 tst ping.py: using BVCI 41172 13:20:15.684888 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:15.696648 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:15.708200 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:15.719604 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:15.731243 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:15.743040 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:15.754924 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:15.766588 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:20:15.898311 tst ping.py:19: start network... 13:20:16.119036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:16.629014 run create_hlr_db(pid=26326): Launched 13:20:16.791914 bus /gobi_6: Setting Powered False 13:20:17.854550 run create_hlr_db(pid=26326): Terminated: ok {rc=0} 13:20:18.299087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26328): Launched 13:20:18.619158 run osmo-hlr_10.42.42.2(pid=26329): Launched 13:20:18.742521 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:19.297005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26331): Launched 13:20:19.616902 run osmo-stp_10.42.42.5(pid=26332): Launched 13:20:19.739379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:20.292501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26334): Launched 13:20:20.415117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:20.685897 run patchelf(pid=26335): Launched 13:20:20.863100 run osmo-stp_10.42.42.5(pid=26332): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26332)] 13:20:20.998325 run osmo-stp_10.42.42.5(pid=26332): stdout: | (launched: 2022-12-14_13:20:19.558567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:21.135265 run osmo-stp_10.42.42.5(pid=26332): stderr: | 20221214132019752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132019752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132019753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132019753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132019754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132019754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132019754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:21.272293 run osmo-stp_10.42.42.5(pid=26332): stdout: | (launched: 2022-12-14_13:20:19.558567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:21.403753 run osmo-stp_10.42.42.5(pid=26332): stderr: | 20221214132019752 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132019752 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132019753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132019753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132019754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132019754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132019754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:21.559619 run patchelf(pid=26335): Terminating (SIGINT) 13:20:21.738372 run patchelf(pid=26335): Terminated: ok {rc=0} 13:20:21.867728 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26332): Process ended prematurely: osmo-stp_10.42.42.5(pid=26332) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26332)] [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:20:21.877280 tst ping.py:22: Test FAILED (6.7 sec) 13:20:21.905482 run osmo-hlr_10.42.42.2(pid=26329): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26329)] 13:20:21.956058 run osmo-hlr_10.42.42.2(pid=26329): stdout: | (launched: 2022-12-14_13:20:18.561179) 13:20:22.007963 run osmo-hlr_10.42.42.2(pid=26329): stderr: | 20221214132018759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132018759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132018759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132018759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132018759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132018759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132018770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132018778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132018778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132018778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:22.060617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26328): Terminating (SIGTERM) 13:20:22.102362 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26331): Terminating (SIGTERM) 13:20:22.144584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26334): Terminating (SIGTERM) 13:20:22.186802 --- ParallelTerminationStrategy: PID 26328 died... 13:20:22.207148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26328): Terminated: ok {rc=0} 13:20:22.253646 --- ParallelTerminationStrategy: PID 26331 died... 13:20:22.273511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26331): Terminated: ok {rc=0} 13:20:22.320290 --- ParallelTerminationStrategy: PID 26334 died... 13:20:22.340334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26334): Terminated: ok {rc=0} 13:20:22.428353 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:20:23.515397 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:23.527482 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:20:23.595538 tst ping_idle_ping.py: using LAC 41172 13:20:23.717427 tst ping_idle_ping.py: using RAC 117 13:20:23.841795 tst ping_idle_ping.py: using CellId 41172 13:20:23.961597 tst ping_idle_ping.py: using BVCI 41173 13:20:24.069544 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:24.080612 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:24.091610 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:24.102528 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:24.113486 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:24.124228 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:24.135799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:20:24.146878 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:20:24.266658 tst ping_idle_ping.py:24: start network... 13:20:24.483825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:24.983345 run create_hlr_db(pid=26336): Launched 13:20:25.106193 bus /gobi_6: Setting Powered False 13:20:26.170018 run create_hlr_db(pid=26336): Terminated: ok {rc=0} 13:20:26.597168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26338): Launched 13:20:26.897616 run osmo-hlr_10.42.42.2(pid=26339): Launched 13:20:27.010930 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:27.523673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26341): Launched 13:20:27.821939 run osmo-stp_10.42.42.5(pid=26342): Launched 13:20:27.934972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:28.448202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26344): Launched 13:20:28.562090 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:28.813436 run patchelf(pid=26345): Launched 13:20:28.980698 run osmo-stp_10.42.42.5(pid=26342): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26342)] 13:20:29.107013 run osmo-stp_10.42.42.5(pid=26342): stdout: | (launched: 2022-12-14_13:20:27.766973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:29.234429 run osmo-stp_10.42.42.5(pid=26342): stderr: | 20221214132027937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132027937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132027937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132027938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132027940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132027940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132027940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:29.362171 run osmo-stp_10.42.42.5(pid=26342): stdout: | (launched: 2022-12-14_13:20:27.766973) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:29.484834 run osmo-stp_10.42.42.5(pid=26342): stderr: | 20221214132027937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132027937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132027937 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132027938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132027940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132027940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132027940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:29.629532 run patchelf(pid=26345): Terminating (SIGINT) 13:20:29.796387 run patchelf(pid=26345): Terminated: ok {rc=0} 13:20:29.916660 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26342): Process ended prematurely: osmo-stp_10.42.42.5(pid=26342) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26342)] [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:20:29.925651 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:20:29.952129 run osmo-hlr_10.42.42.2(pid=26339): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26339)] 13:20:29.999541 run osmo-hlr_10.42.42.2(pid=26339): stdout: | (launched: 2022-12-14_13:20:26.842567) 13:20:30.048876 run osmo-hlr_10.42.42.2(pid=26339): stderr: | 20221214132027020 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132027020 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132027020 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132027020 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132027020 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132027020 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132027032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132027041 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132027041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132027041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:30.098626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26338): Terminating (SIGTERM) 13:20:30.138079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26341): Terminating (SIGTERM) 13:20:30.177765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26344): Terminating (SIGTERM) 13:20:30.217773 --- ParallelTerminationStrategy: PID 26338 died... 13:20:30.236908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26338): Terminated: ok {rc=0} 13:20:30.280897 --- ParallelTerminationStrategy: PID 26341 died... 13:20:30.299742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26341): Terminated: ok {rc=0} 13:20:30.343559 --- ParallelTerminationStrategy: PID 26344 died... 13:20:30.362240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26344): Terminated: ok {rc=0} 13:20:30.445277 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:20:31.792186 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:31.800323 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:20:31.834771 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:20:31.870510 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:20:31.927592 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:20:31.980922 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:20:32.035156 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:20:32.551630 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:20:32.557735 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:20:32.570169 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:20:32.643784 tst switch_tch_pdch.py: using LAC 41173 13:20:32.762488 tst switch_tch_pdch.py: using RAC 118 13:20:32.879017 tst switch_tch_pdch.py: using CellId 41173 13:20:32.997762 tst switch_tch_pdch.py: using BVCI 41174 13:20:33.117015 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:20:33.129269 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:20:33.141342 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:20:33.153550 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:20:33.165937 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:20:33.177680 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:20:33.189863 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:20:33.201793 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:20:33.322806 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:20:33.439271 tst switch_tch_pdch.py:51: start network... 13:20:33.639056 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:34.102041 run create_hlr_db(pid=26349): Launched 13:20:34.222952 bus /gobi_6: Setting Powered False 13:20:35.282388 run create_hlr_db(pid=26349): Terminated: ok {rc=0} 13:20:35.718758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26351): Launched 13:20:36.040309 run osmo-hlr_10.42.42.2(pid=26352): Launched 13:20:36.162847 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:36.712713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26354): Launched 13:20:37.032355 run osmo-stp_10.42.42.5(pid=26355): Launched 13:20:37.154590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:37.706813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26357): Launched 13:20:37.829321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:38.098941 run patchelf(pid=26358): Launched 13:20:38.276489 run osmo-stp_10.42.42.5(pid=26355): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26355)] 13:20:38.411605 run osmo-stp_10.42.42.5(pid=26355): stdout: | (launched: 2022-12-14_13:20:36.974148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:38.548838 run osmo-stp_10.42.42.5(pid=26355): stderr: | 20221214132037171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132037171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132037171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132037171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132037172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132037172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132037172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:38.685826 run osmo-stp_10.42.42.5(pid=26355): stdout: | (launched: 2022-12-14_13:20:36.974148) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:38.817621 run osmo-stp_10.42.42.5(pid=26355): stderr: | 20221214132037171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132037171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132037171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132037171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132037172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132037172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132037172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:38.973891 run patchelf(pid=26358): Terminating (SIGINT) 13:20:39.152530 run patchelf(pid=26358): Terminated: ok {rc=0} 13:20:39.281314 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26355): Process ended prematurely: osmo-stp_10.42.42.5(pid=26355) [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26355)] [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:20:39.290802 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 13:20:39.318982 run osmo-hlr_10.42.42.2(pid=26352): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26352)] 13:20:39.369910 run osmo-hlr_10.42.42.2(pid=26352): stdout: | (launched: 2022-12-14_13:20:35.981828) 13:20:39.422225 run osmo-hlr_10.42.42.2(pid=26352): stderr: | 20221214132036179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132036179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132036179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132036179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132036179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132036179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132036195 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132036205 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132036205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132036205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:39.474354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26351): Terminating (SIGTERM) 13:20:39.516838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26354): Terminating (SIGTERM) 13:20:39.559481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26357): Terminating (SIGTERM) 13:20:39.601896 --- ParallelTerminationStrategy: PID 26351 died... 13:20:39.622429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26351): Terminated: ok {rc=0} 13:20:39.669198 --- ParallelTerminationStrategy: PID 26354 died... 13:20:39.689081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26354): Terminated: ok {rc=0} 13:20:39.735627 --- ParallelTerminationStrategy: PID 26357 died... 13:20:39.755551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26357): Terminated: ok {rc=0} 13:20:39.844434 bus /gobi_0: Setting Powered False 13:20:40.943771 bus /gobi_0: Setting Powered False 13:20:42.060110 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:20:43.314144 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:43.319702 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:20:43.352096 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:20:43.386358 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:20:43.437395 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:20:43.469927 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:20:43.503815 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:20:44.058903 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:20:44.064063 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:20:44.075109 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:20:44.142519 tst switch_tch_pdch.py: using LAC 41174 13:20:44.258261 tst switch_tch_pdch.py: using RAC 119 13:20:44.376844 tst switch_tch_pdch.py: using CellId 41174 13:20:44.492582 tst switch_tch_pdch.py: using BVCI 41175 13:20:44.609664 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:20:44.621165 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:20:44.632357 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:20:44.643482 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:20:44.655068 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:20:44.666694 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:20:44.678339 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:20:44.689761 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:20:44.807466 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:20:44.921499 tst switch_tch_pdch.py:51: start network... 13:20:45.121394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:20:45.556493 run create_hlr_db(pid=26363): Launched 13:20:45.683046 bus /gobi_6: Setting Powered False 13:20:46.742291 run create_hlr_db(pid=26363): Terminated: ok {rc=0} 13:20:47.157863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26365): Launched 13:20:47.458502 run osmo-hlr_10.42.42.2(pid=26366): Launched 13:20:47.572912 run osmo-stp_10.42.42.5: Starting osmo-stp 13:20:48.058926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26368): Launched 13:20:48.355379 run osmo-stp_10.42.42.5(pid=26369): Launched 13:20:48.468421 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:20:48.955313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26371): Launched 13:20:49.069380 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:20:49.319377 run patchelf(pid=26372): Launched 13:20:49.484444 run osmo-stp_10.42.42.5(pid=26369): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26369)] 13:20:49.609763 run osmo-stp_10.42.42.5(pid=26369): stdout: | (launched: 2022-12-14_13:20:48.300652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:49.736751 run osmo-stp_10.42.42.5(pid=26369): stderr: | 20221214132048470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132048470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132048470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132048471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132048471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132048471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132048471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:49.864436 run osmo-stp_10.42.42.5(pid=26369): stdout: | (launched: 2022-12-14_13:20:48.300652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:20:49.985922 run osmo-stp_10.42.42.5(pid=26369): stderr: | 20221214132048470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132048470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132048470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132048471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132048471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132048471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132048471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:20:50.130255 run patchelf(pid=26372): Terminating (SIGINT) 13:20:50.295813 run patchelf(pid=26372): Terminated: ok {rc=0} 13:20:50.415472 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=26369): Process ended prematurely: osmo-stp_10.42.42.5(pid=26369) [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26369)] [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:20:50.424191 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:20:50.450544 run osmo-hlr_10.42.42.2(pid=26366): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26366)] 13:20:50.498548 run osmo-hlr_10.42.42.2(pid=26366): stdout: | (launched: 2022-12-14_13:20:47.403521) 13:20:50.547951 run osmo-hlr_10.42.42.2(pid=26366): stderr: | 20221214132047580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132047580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132047580 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132047580 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132047580 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132047580 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132047593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132047601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132047602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132047602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:20:50.598276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26365): Terminating (SIGTERM) 13:20:50.637934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26368): Terminating (SIGTERM) 13:20:50.677499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26371): Terminating (SIGTERM) 13:20:50.717251 --- ParallelTerminationStrategy: PID 26365 died... 13:20:50.736340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26365): Terminated: ok {rc=0} 13:20:50.779891 --- ParallelTerminationStrategy: PID 26368 died... 13:20:50.798500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26368): Terminated: ok {rc=0} 13:20:50.842181 --- ParallelTerminationStrategy: PID 26371 died... 13:20:50.860731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26371): Terminated: ok {rc=0} 13:20:50.944080 bus /gobi_0: Setting Powered False 13:20:52.041941 bus /gobi_0: Setting Powered False 13:20:53.154327 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 13:20:54.411040 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:20:54.415294 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:20:54.449361 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 13:20:54.457222 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 13:20:54.510620 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:20:54.545724 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 13:20:54.552712 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 13:20:55.090709 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 13:20:55.096489 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 13:20:55.108587 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:20:55.157692 tst mo_mt_sms.py: using LAC 41175 13:20:55.275327 tst mo_mt_sms.py: using RAC 120 13:20:55.393457 tst mo_mt_sms.py: using CellId 41175 13:20:55.525446 tst mo_mt_sms.py: using BVCI 41176 13:20:55.642677 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:20:55.757059 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:20:55.869278 tst mo_mt_sms.py:9: start nitb and bts... 13:20:56.069577 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:20:56.677868 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26379): Launched 13:20:56.975196 run osmo-nitb_10.42.42.2(pid=26380): Launched 13:20:57.140835 run osmo-nitb_10.42.42.2(pid=26380): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26380)] 13:20:57.274206 run osmo-nitb_10.42.42.2(pid=26380): stdout: | (launched: 2022-12-14_13:20:56.919934) 13:20:57.408719 run osmo-nitb_10.42.42.2(pid=26380): stderr: | (launched: 2022-12-14_13:20:56.964265) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:20:57.543617 run osmo-nitb_10.42.42.2(pid=26380): stdout: | (launched: 2022-12-14_13:20:56.919934) 13:20:57.672880 run osmo-nitb_10.42.42.2(pid=26380): stderr: | (launched: 2022-12-14_13:20:56.964265) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26380): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26380) [trial-2405↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26380)] 13:20:58.088339 tst osmo-nitb_10.42.42.2(pid=26380): stdout: | (launched: 2022-12-14_13:20:56.919934) 13:20:58.208148 tst osmo-nitb_10.42.42.2(pid=26380): stderr: | (launched: 2022-12-14_13:20:56.964265) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:20:58.349357 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=26380): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26380) [trial-2405↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26380)] [trial-2405↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 13:20:58.357549 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:20:58.363990 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26379): Terminating (SIGTERM) 13:20:58.572140 --- ParallelTerminationStrategy: PID 26379 died... 13:20:58.590945 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26379): Terminated: ok {rc=0} 13:20:58.676113 bus /sierra_3: Setting Powered False 13:20:59.775432 bus /sierra_3: Setting Powered False 13:21:00.922122 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 sms:trx-sysmocell5000 --------------------------------------------------------------------- 13:21:02.154386 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:02.158970 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:21:02.197781 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:21:02.227234 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 13:21:02.281630 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:21:02.317191 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:21:02.346081 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 13:21:02.892730 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 13:21:02.899354 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:02.910311 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:21:02.960702 tst mo_mt_sms.py: using LAC 41176 13:21:03.078658 tst mo_mt_sms.py: using RAC 121 13:21:03.196321 tst mo_mt_sms.py: using CellId 41176 13:21:03.321493 tst mo_mt_sms.py: using BVCI 41177 13:21:03.439202 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:03.450483 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:03.461478 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:03.472428 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:03.483611 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:03.494832 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:21:03.611837 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 13:21:03.727624 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:04.190409 run create_hlr_db(pid=26384): Launched 13:21:04.312654 bus /sierra_2: Setting Powered False 13:21:05.372388 run create_hlr_db(pid=26384): Terminated: ok {rc=0} 13:21:05.807562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26386): Launched 13:21:06.126762 run osmo-hlr_10.42.42.2(pid=26387): Launched 13:21:06.248359 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:06.797939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26389): Launched 13:21:07.096071 run osmo-stp_10.42.42.5(pid=26390): Launched 13:21:07.210395 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:07.746457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26392): Launched 13:21:08.043282 run osmo-msc_10.42.42.6(pid=26393): Launched 13:21:08.208642 run osmo-stp_10.42.42.5(pid=26390): ERR: Terminated: ERROR {rc=1} [trial-2405↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26390)] 13:21:08.333868 run osmo-stp_10.42.42.5(pid=26390): stdout: | (launched: 2022-12-14_13:21:07.041469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:08.459198 run osmo-stp_10.42.42.5(pid=26390): stderr: | 20221214132107212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132107212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132107212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132107212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132107213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132107213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132107213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:08.582316 run osmo-stp_10.42.42.5(pid=26390): stdout: | (launched: 2022-12-14_13:21:07.041469) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:08.700192 run osmo-stp_10.42.42.5(pid=26390): stderr: | 20221214132107212 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132107212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132107212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132107212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132107213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132107213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132107213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:08.841535 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=26390): Process ended prematurely: osmo-stp_10.42.42.5(pid=26390) [trial-2405↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26390)] [trial-2405↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 13:21:08.849553 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 13:21:08.875084 run osmo-hlr_10.42.42.2(pid=26387): ERR: Terminated: ERROR {rc=237} [trial-2405↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26387)] 13:21:08.922386 run osmo-hlr_10.42.42.2(pid=26387): stdout: | (launched: 2022-12-14_13:21:06.068645) 13:21:08.971142 run osmo-hlr_10.42.42.2(pid=26387): stderr: | 20221214132106267 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132106267 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132106267 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132106267 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132106267 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132106267 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132106280 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132106288 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132106288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132106288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:09.039204 run osmo-msc_10.42.42.6(pid=26393): ERR: Terminated: ERROR {rc=2} [trial-2405↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26393)] 13:21:09.086234 run osmo-msc_10.42.42.6(pid=26393): stdout: | (launched: 2022-12-14_13:21:07.988275) 13:21:09.134859 run osmo-msc_10.42.42.6(pid=26393): stderr: | 20221214132108260 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132108260 DLGLOBAL DEBUG validating counter group 0x7fec1df49c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132108261 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132108261 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132108261 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132108261 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132108263 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132108263 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132108263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132108263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:09.184626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26386): Terminating (SIGTERM) 13:21:09.223865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26389): Terminating (SIGTERM) 13:21:09.262913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26392): Terminating (SIGTERM) 13:21:09.302159 --- ParallelTerminationStrategy: PID 26386 died... 13:21:09.320997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26386): Terminated: ok {rc=0} 13:21:09.364663 --- ParallelTerminationStrategy: PID 26389 died... 13:21:09.383427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26389): Terminated: ok {rc=0} 13:21:09.426970 --- ParallelTerminationStrategy: PID 26392 died... 13:21:09.445417 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26392): Terminated: ok {rc=0} 13:21:09.528291 bus /sierra_3: Setting Powered False 13:21:10.625506 bus /sierra_3: Setting Powered False 13:21:11.742435 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 13:21:12.971217 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:12.975203 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:21:13.008292 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 13:21:13.014976 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 13:21:13.049809 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:21:13.082589 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 13:21:13.089169 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 13:21:13.609038 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 13:21:13.613822 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 13:21:13.624399 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:21:13.671706 tst assert_extension.py: using LAC 41177 13:21:13.788173 tst assert_extension.py: using RAC 122 13:21:13.904686 tst assert_extension.py: using CellId 41177 13:21:14.021088 tst assert_extension.py: using BVCI 41178 13:21:14.128089 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 13:21:14.245886 tst assert_extension.py:10: start nitb and bts... 13:21:14.462651 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:21:15.115937 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26398): Launched 13:21:15.436420 run osmo-nitb_10.42.42.2(pid=26399): Launched 13:21:15.613560 run osmo-nitb_10.42.42.2(pid=26399): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26399)] 13:21:15.756570 run osmo-nitb_10.42.42.2(pid=26399): stdout: | (launched: 2022-12-14_13:21:15.378328) 13:21:15.904265 run osmo-nitb_10.42.42.2(pid=26399): stderr: | (launched: 2022-12-14_13:21:15.426047) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:21:16.051805 run osmo-nitb_10.42.42.2(pid=26399): stdout: | (launched: 2022-12-14_13:21:15.378328) 13:21:16.193978 run osmo-nitb_10.42.42.2(pid=26399): stderr: | (launched: 2022-12-14_13:21:15.426047) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=26399): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26399) [trial-2405↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26399)] 13:21:16.557013 tst osmo-nitb_10.42.42.2(pid=26399): stdout: | (launched: 2022-12-14_13:21:15.378328) 13:21:16.716016 tst osmo-nitb_10.42.42.2(pid=26399): stderr: | (launched: 2022-12-14_13:21:15.426047) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:21:16.908575 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=26399): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26399) [trial-2405↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26399)] [trial-2405↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 13:21:16.918398 tst assert_extension.py:12: Test FAILED (3.3 sec) 13:21:16.926008 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26398): Terminating (SIGTERM) 13:21:17.139316 --- ParallelTerminationStrategy: PID 26398 died... 13:21:17.159621 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=26398): Terminated: ok {rc=0} 13:21:17.255354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 13:21:18.436770 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:18.441158 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:21:18.474630 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:21:18.502032 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 13:21:18.535652 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:21:18.569049 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:21:18.595617 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 13:21:19.128508 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 13:21:19.133722 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:19.144406 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:21:19.191402 tst assert_extension.py: using LAC 41178 13:21:19.307288 tst assert_extension.py: using RAC 123 13:21:19.422161 tst assert_extension.py: using CellId 41178 13:21:19.537143 tst assert_extension.py: using BVCI 41179 13:21:19.644705 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:19.655720 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:19.666567 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:19.677246 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:19.688119 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:21:19.698969 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 13:21:19.816582 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:20.313497 run create_hlr_db(pid=26403): Launched 13:21:20.436864 bus /sierra_2: Setting Powered False 13:21:21.500671 run create_hlr_db(pid=26403): Terminated: ok {rc=0} 13:21:21.929150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26405): Launched 13:21:22.227240 run osmo-hlr_10.42.42.2(pid=26406): Launched 13:21:22.339927 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:22.955099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26408): Launched 13:21:23.247168 run osmo-stp_10.42.42.5(pid=26409): Launched 13:21:23.358973 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:23.886742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26411): Launched 13:21:24.178786 run osmo-msc_10.42.42.6(pid=26412): Launched 13:21:24.341626 run osmo-stp_10.42.42.5(pid=26409): ERR: Terminated: ERROR {rc=1} [trial-2405↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26409)] 13:21:24.465480 run osmo-stp_10.42.42.5(pid=26409): stdout: | (launched: 2022-12-14_13:21:23.193727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:24.589655 run osmo-stp_10.42.42.5(pid=26409): stderr: | 20221214132123364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132123364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132123364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132123365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132123365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132123365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132123366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:24.711609 run osmo-stp_10.42.42.5(pid=26409): stdout: | (launched: 2022-12-14_13:21:23.193727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:24.828247 run osmo-stp_10.42.42.5(pid=26409): stderr: | 20221214132123364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132123364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132123364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132123365 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132123365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132123365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132123366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:24.967722 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=26409): Process ended prematurely: osmo-stp_10.42.42.5(pid=26409) [trial-2405↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26409)] [trial-2405↪ussd:trx-sysmocell5000↪assert_extension.py:17] 13:21:24.975907 tst assert_extension.py:17: Test FAILED (5.8 sec) 13:21:25.001795 run osmo-hlr_10.42.42.2(pid=26406): ERR: Terminated: ERROR {rc=237} [trial-2405↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26406)] 13:21:25.049477 run osmo-hlr_10.42.42.2(pid=26406): stdout: | (launched: 2022-12-14_13:21:22.172452) 13:21:25.098787 run osmo-hlr_10.42.42.2(pid=26406): stderr: | 20221214132122348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132122348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132122348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132122348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132122348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132122349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132122361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132122369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132122369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132122369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:25.167327 run osmo-msc_10.42.42.6(pid=26412): ERR: Terminated: ERROR {rc=2} [trial-2405↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26412)] 13:21:25.214944 run osmo-msc_10.42.42.6(pid=26412): stdout: | (launched: 2022-12-14_13:21:24.124607) 13:21:25.264010 run osmo-msc_10.42.42.6(pid=26412): stderr: | 20221214132124397 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132124397 DLGLOBAL DEBUG validating counter group 0x7fb9fa764c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132124397 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132124397 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132124397 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132124398 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132124399 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132124400 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132124400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132124400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:25.314381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26405): Terminating (SIGTERM) 13:21:25.354202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26408): Terminating (SIGTERM) 13:21:25.393848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26411): Terminating (SIGTERM) 13:21:25.433790 --- ParallelTerminationStrategy: PID 26405 died... 13:21:25.452683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26405): Terminated: ok {rc=0} 13:21:25.496468 --- ParallelTerminationStrategy: PID 26408 died... 13:21:25.514961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26408): Terminated: ok {rc=0} 13:21:25.558512 --- ParallelTerminationStrategy: PID 26411 died... 13:21:25.576876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26411): Terminated: ok {rc=0} 13:21:25.659831 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:21:26.870914 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:26.877868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:21:26.912740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:21:26.940193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:21:26.994731 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:21:27.028638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:21:27.054612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:21:27.606715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:21:27.660019 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:27.671715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:21:27.741943 tst mo_mt_call.py: using LAC 41179 13:21:27.866717 tst mo_mt_call.py: using RAC 124 13:21:27.992526 tst mo_mt_call.py: using CellId 41179 13:21:28.118233 tst mo_mt_call.py: using BVCI 41180 13:21:28.235514 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:28.247063 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:28.258410 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:28.269843 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:28.281574 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:28.293209 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:21:28.410935 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:21:28.525145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:28.986832 run create_hlr_db(pid=26417): Launched 13:21:29.109415 bus /sierra_2: Setting Powered False 13:21:30.169122 run create_hlr_db(pid=26417): Terminated: ok {rc=0} 13:21:30.587054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26419): Launched 13:21:30.901813 run osmo-hlr_10.42.42.2(pid=26420): Launched 13:21:31.079301 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:31.851808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26422): Launched 13:21:32.172061 run osmo-stp_10.42.42.5(pid=26423): Launched 13:21:32.379950 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:32.922724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26425): Launched 13:21:33.221567 run osmo-msc_10.42.42.6(pid=26426): Launched 13:21:33.390099 run osmo-stp_10.42.42.5(pid=26423): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26423)] 13:21:33.516394 run osmo-stp_10.42.42.5(pid=26423): stdout: | (launched: 2022-12-14_13:21:32.109852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:33.643325 run osmo-stp_10.42.42.5(pid=26423): stderr: | 20221214132132372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132132372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132132372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132132373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132132373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132132373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132132373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:33.767880 run osmo-stp_10.42.42.5(pid=26423): stdout: | (launched: 2022-12-14_13:21:32.109852) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:33.887032 run osmo-stp_10.42.42.5(pid=26423): stderr: | 20221214132132372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132132372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132132372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132132373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132132373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132132373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132132373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:34.029790 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26423): Process ended prematurely: osmo-stp_10.42.42.5(pid=26423) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26423)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:21:34.038633 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:21:34.064790 run osmo-hlr_10.42.42.2(pid=26420): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26420)] 13:21:34.112681 run osmo-hlr_10.42.42.2(pid=26420): stdout: | (launched: 2022-12-14_13:21:30.834088) 13:21:34.162246 run osmo-hlr_10.42.42.2(pid=26420): stderr: | 20221214132131187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132131187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132131187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132131187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132131187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132131187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132131213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132131240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132131240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132131240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:34.230994 run osmo-msc_10.42.42.6(pid=26426): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26426)] 13:21:34.278195 run osmo-msc_10.42.42.6(pid=26426): stdout: | (launched: 2022-12-14_13:21:33.166660) 13:21:34.327181 run osmo-msc_10.42.42.6(pid=26426): stderr: | 20221214132133437 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132133437 DLGLOBAL DEBUG validating counter group 0x7fa027e0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132133437 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132133437 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132133437 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132133438 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132133439 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132133440 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132133440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132133440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:34.377241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26419): Terminating (SIGTERM) 13:21:34.416747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26422): Terminating (SIGTERM) 13:21:34.457127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26425): Terminating (SIGTERM) 13:21:34.497217 --- ParallelTerminationStrategy: PID 26419 died... 13:21:34.516803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26419): Terminated: ok {rc=0} 13:21:34.560878 --- ParallelTerminationStrategy: PID 26422 died... 13:21:34.579473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26422): Terminated: ok {rc=0} 13:21:34.623292 --- ParallelTerminationStrategy: PID 26425 died... 13:21:34.641756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26425): Terminated: ok {rc=0} 13:21:34.725339 bus /sierra_3: Setting Powered False 13:21:35.823855 bus /sierra_3: Setting Powered False 13:21:36.943299 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:21:38.089834 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:38.101735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:21:38.174910 tst mo_mt_call_osmux.py: using LAC 41180 13:21:38.299680 tst mo_mt_call_osmux.py: using RAC 125 13:21:38.424860 tst mo_mt_call_osmux.py: using CellId 41180 13:21:38.550402 tst mo_mt_call_osmux.py: using BVCI 41181 13:21:38.666777 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:38.678388 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:38.689909 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:38.701295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:38.713042 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:21:38.724719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:21:38.840893 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:21:38.959360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:39.457219 run create_hlr_db(pid=26428): Launched 13:21:39.579655 bus /sierra_2: Setting Powered False 13:21:40.642470 run create_hlr_db(pid=26428): Terminated: ok {rc=0} 13:21:41.071465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26430): Launched 13:21:41.371051 run osmo-hlr_10.42.42.2(pid=26431): Launched 13:21:41.485281 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:41.999770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26433): Launched 13:21:42.298672 run osmo-stp_10.42.42.5(pid=26434): Launched 13:21:42.411710 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:42.950768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26436): Launched 13:21:43.248442 run osmo-msc_10.42.42.6(pid=26437): Launched 13:21:43.415815 run osmo-stp_10.42.42.5(pid=26434): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26434)] 13:21:43.542447 run osmo-stp_10.42.42.5(pid=26434): stdout: | (launched: 2022-12-14_13:21:42.243897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:43.668607 run osmo-stp_10.42.42.5(pid=26434): stderr: | 20221214132142413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132142414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132142414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132142414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132142415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132142415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132142415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:43.792399 run osmo-stp_10.42.42.5(pid=26434): stdout: | (launched: 2022-12-14_13:21:42.243897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:43.911312 run osmo-stp_10.42.42.5(pid=26434): stderr: | 20221214132142413 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132142414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132142414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132142414 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132142415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132142415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132142415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:44.053830 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26434): Process ended prematurely: osmo-stp_10.42.42.5(pid=26434) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26434)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:21:44.062507 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:21:44.088326 run osmo-hlr_10.42.42.2(pid=26431): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26431)] 13:21:44.136227 run osmo-hlr_10.42.42.2(pid=26431): stdout: | (launched: 2022-12-14_13:21:41.316289) 13:21:44.185492 run osmo-hlr_10.42.42.2(pid=26431): stderr: | 20221214132141490 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132141491 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132141491 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132141491 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132141491 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132141491 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132141502 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132141511 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132141511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132141511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:44.253567 run osmo-msc_10.42.42.6(pid=26437): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26437)] 13:21:44.300588 run osmo-msc_10.42.42.6(pid=26437): stdout: | (launched: 2022-12-14_13:21:43.193666) 13:21:44.349267 run osmo-msc_10.42.42.6(pid=26437): stderr: | 20221214132143468 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132143468 DLGLOBAL DEBUG validating counter group 0x7ffad6219c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132143468 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132143468 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132143468 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132143469 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132143470 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132143471 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132143471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132143471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:44.398196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26430): Terminating (SIGTERM) 13:21:44.437195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26433): Terminating (SIGTERM) 13:21:44.476221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26436): Terminating (SIGTERM) 13:21:44.515325 --- ParallelTerminationStrategy: PID 26430 died... 13:21:44.534245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26430): Terminated: ok {rc=0} 13:21:44.577998 --- ParallelTerminationStrategy: PID 26433 died... 13:21:44.596263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26433): Terminated: ok {rc=0} 13:21:44.639828 --- ParallelTerminationStrategy: PID 26436 died... 13:21:44.658304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26436): Terminated: ok {rc=0} 13:21:44.741120 bus /sierra_3: Setting Powered False 13:21:45.848565 bus /sierra_3: Setting Powered False 13:21:46.972151 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:21:48.228127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:21:48.234801 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:21:48.267562 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:21:48.293702 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:21:48.346357 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:21:48.382042 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:21:48.409933 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:21:48.955029 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:21:49.002919 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:49.014029 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:21:49.082443 tst mo_mt_call.py: using LAC 41181 13:21:49.199487 tst mo_mt_call.py: using RAC 126 13:21:49.316578 tst mo_mt_call.py: using CellId 41181 13:21:49.434972 tst mo_mt_call.py: using BVCI 41182 13:21:49.545676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:49.556673 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:49.567655 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:49.578565 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:49.589524 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:49.600310 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:21:49.713028 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:21:49.833833 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:21:50.333561 run create_hlr_db(pid=26442): Launched 13:21:50.455902 bus /sierra_2: Setting Powered False 13:21:51.520358 run create_hlr_db(pid=26442): Terminated: ok {rc=0} 13:21:51.968670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26444): Launched 13:21:52.289638 run osmo-hlr_10.42.42.2(pid=26445): Launched 13:21:52.413325 run osmo-stp_10.42.42.5: Starting osmo-stp 13:21:52.968589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26447): Launched 13:21:53.289039 run osmo-stp_10.42.42.5(pid=26448): Launched 13:21:53.411596 run osmo-msc_10.42.42.6: Starting osmo-msc 13:21:53.997166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26450): Launched 13:21:54.317230 run osmo-msc_10.42.42.6(pid=26451): Launched 13:21:54.496790 run osmo-stp_10.42.42.5(pid=26448): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26448)] 13:21:54.633016 run osmo-stp_10.42.42.5(pid=26448): stdout: | (launched: 2022-12-14_13:21:53.230977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:54.769678 run osmo-stp_10.42.42.5(pid=26448): stderr: | 20221214132153422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132153422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132153422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132153422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132153423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132153423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132153423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:54.905875 run osmo-stp_10.42.42.5(pid=26448): stdout: | (launched: 2022-12-14_13:21:53.230977) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:21:55.034787 run osmo-stp_10.42.42.5(pid=26448): stderr: | 20221214132153422 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132153422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132153422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132153422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132153423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132153423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132153423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:21:55.188885 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26448): Process ended prematurely: osmo-stp_10.42.42.5(pid=26448) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26448)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:21:55.198487 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:21:55.226256 run osmo-hlr_10.42.42.2(pid=26445): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26445)] 13:21:55.276736 run osmo-hlr_10.42.42.2(pid=26445): stdout: | (launched: 2022-12-14_13:21:52.231374) 13:21:55.328906 run osmo-hlr_10.42.42.2(pid=26445): stderr: | 20221214132152429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132152429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132152429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132152429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132152429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132152429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132152441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132152449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132152450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132152450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:21:55.401600 run osmo-msc_10.42.42.6(pid=26451): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26451)] 13:21:55.451433 run osmo-msc_10.42.42.6(pid=26451): stdout: | (launched: 2022-12-14_13:21:54.259194) 13:21:55.503091 run osmo-msc_10.42.42.6(pid=26451): stderr: | 20221214132154580 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132154580 DLGLOBAL DEBUG validating counter group 0x7f2dc2de8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132154581 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132154581 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132154581 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132154581 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132154583 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132154583 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132154583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132154583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:21:55.555715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26444): Terminating (SIGTERM) 13:21:55.597440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26447): Terminating (SIGTERM) 13:21:55.639283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26450): Terminating (SIGTERM) 13:21:55.681779 --- ParallelTerminationStrategy: PID 26444 died... 13:21:55.702171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26444): Terminated: ok {rc=0} 13:21:55.748424 --- ParallelTerminationStrategy: PID 26447 died... 13:21:55.768342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26447): Terminated: ok {rc=0} 13:21:55.814425 --- ParallelTerminationStrategy: PID 26450 died... 13:21:55.834590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26450): Terminated: ok {rc=0} 13:21:55.921794 bus /sierra_3: Setting Powered False 13:21:57.020128 bus /sierra_3: Setting Powered False 13:21:58.136009 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:21:59.279073 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:59.290772 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:21:59.360170 tst mo_mt_call_osmux.py: using LAC 41182 13:21:59.479069 tst mo_mt_call_osmux.py: using RAC 127 13:21:59.596528 tst mo_mt_call_osmux.py: using CellId 41182 13:21:59.718483 tst mo_mt_call_osmux.py: using BVCI 41183 13:21:59.827951 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:59.839127 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:59.850125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:59.860925 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:59.871883 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:21:59.882916 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:22:00.003365 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:22:00.123162 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:00.621267 run create_hlr_db(pid=26453): Launched 13:22:00.743364 bus /sierra_2: Setting Powered False 13:22:01.819488 run create_hlr_db(pid=26453): Terminated: ok {rc=0} 13:22:02.317941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26455): Launched 13:22:02.638910 run osmo-hlr_10.42.42.2(pid=26456): Launched 13:22:02.761629 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:03.315125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26458): Launched 13:22:03.660590 run osmo-stp_10.42.42.5(pid=26459): Launched 13:22:03.783462 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:04.365397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26461): Launched 13:22:04.687101 run osmo-msc_10.42.42.6(pid=26462): Launched 13:22:04.865663 run osmo-stp_10.42.42.5(pid=26459): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26459)] 13:22:05.001153 run osmo-stp_10.42.42.5(pid=26459): stdout: | (launched: 2022-12-14_13:22:03.602247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:05.137136 run osmo-stp_10.42.42.5(pid=26459): stderr: | 20221214132203795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132203795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132203795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132203795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132203796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132203796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132203796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:05.272298 run osmo-stp_10.42.42.5(pid=26459): stdout: | (launched: 2022-12-14_13:22:03.602247) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:05.401213 run osmo-stp_10.42.42.5(pid=26459): stderr: | 20221214132203795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132203795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132203795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132203795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132203796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132203796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132203796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:05.555045 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26459): Process ended prematurely: osmo-stp_10.42.42.5(pid=26459) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26459)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:22:05.564600 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:22:05.592110 run osmo-hlr_10.42.42.2(pid=26456): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26456)] 13:22:05.642670 run osmo-hlr_10.42.42.2(pid=26456): stdout: | (launched: 2022-12-14_13:22:02.580848) 13:22:05.694366 run osmo-hlr_10.42.42.2(pid=26456): stderr: | 20221214132202779 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132202779 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132202779 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132202779 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132202779 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132202779 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132202791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132202800 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132202800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132202800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:05.766433 run osmo-msc_10.42.42.6(pid=26462): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26462)] 13:22:05.815972 run osmo-msc_10.42.42.6(pid=26462): stdout: | (launched: 2022-12-14_13:22:04.628700) 13:22:05.868253 run osmo-msc_10.42.42.6(pid=26462): stderr: | 20221214132204951 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132204951 DLGLOBAL DEBUG validating counter group 0x7fdb45732c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132204951 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132204951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132204951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132204952 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132204953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132204954 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132204954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132204954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:05.920058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26455): Terminating (SIGTERM) 13:22:05.961910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26458): Terminating (SIGTERM) 13:22:06.003555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26461): Terminating (SIGTERM) 13:22:06.045601 --- ParallelTerminationStrategy: PID 26455 died... 13:22:06.066061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26455): Terminated: ok {rc=0} 13:22:06.112464 --- ParallelTerminationStrategy: PID 26458 died... 13:22:06.132376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26458): Terminated: ok {rc=0} 13:22:06.178533 --- ParallelTerminationStrategy: PID 26461 died... 13:22:06.198160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26461): Terminated: ok {rc=0} 13:22:06.286022 bus /sierra_3: Setting Powered False 13:22:07.382558 bus /sierra_3: Setting Powered False 13:22:08.499976 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:22:09.754131 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:09.761654 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:22:09.794723 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:22:09.821325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:22:09.872528 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:22:09.907240 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:22:09.934727 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:22:10.482756 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:22:10.530881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:10.544295 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:22:10.615752 tst mo_mt_call.py: using LAC 41183 13:22:10.735098 tst mo_mt_call.py: using RAC 128 13:22:10.854397 tst mo_mt_call.py: using CellId 41183 13:22:10.974365 tst mo_mt_call.py: using BVCI 41184 13:22:11.084101 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:11.095497 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:11.106560 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:11.117517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:11.128437 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:11.139390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:22:11.257694 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:22:11.373497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:11.838049 run create_hlr_db(pid=26468): Launched 13:22:11.961164 bus /sierra_2: Setting Powered False 13:22:13.021759 run create_hlr_db(pid=26468): Terminated: ok {rc=0} 13:22:13.460392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26470): Launched 13:22:13.780910 run osmo-hlr_10.42.42.2(pid=26471): Launched 13:22:13.903697 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:14.458856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26473): Launched 13:22:14.778686 run osmo-stp_10.42.42.5(pid=26474): Launched 13:22:14.901828 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:15.483660 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26476): Launched 13:22:15.806479 run osmo-msc_10.42.42.6(pid=26477): Launched 13:22:16.350197 run osmo-stp_10.42.42.5(pid=26474): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26474)] 13:22:16.741784 run osmo-stp_10.42.42.5(pid=26474): stdout: | (launched: 2022-12-14_13:22:14.720696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:16.870292 run osmo-stp_10.42.42.5(pid=26474): stderr: | 20221214132214912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132214912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132214912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132214913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132214913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132214913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132214913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:16.999788 run osmo-stp_10.42.42.5(pid=26474): stdout: | (launched: 2022-12-14_13:22:14.720696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:17.121908 run osmo-stp_10.42.42.5(pid=26474): stderr: | 20221214132214912 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132214912 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132214912 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132214913 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132214913 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132214913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132214913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:17.270758 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26474): Process ended prematurely: osmo-stp_10.42.42.5(pid=26474) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26474)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:22:17.279650 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 13:22:17.306550 run osmo-hlr_10.42.42.2(pid=26471): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26471)] 13:22:17.355005 run osmo-hlr_10.42.42.2(pid=26471): stdout: | (launched: 2022-12-14_13:22:13.722841) 13:22:17.404243 run osmo-hlr_10.42.42.2(pid=26471): stderr: | 20221214132213919 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132213919 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132213919 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132213919 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132213919 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132213919 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132213933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132213941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132213941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132213941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:17.472765 run osmo-msc_10.42.42.6(pid=26477): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26477)] 13:22:17.520086 run osmo-msc_10.42.42.6(pid=26477): stdout: | (launched: 2022-12-14_13:22:15.748146) 13:22:17.569139 run osmo-msc_10.42.42.6(pid=26477): stderr: | 20221214132216253 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132216254 DLGLOBAL DEBUG validating counter group 0x7efc16f19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132216254 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132216254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132216254 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132216255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132216260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132216261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132216261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132216261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:17.618694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26470): Terminating (SIGTERM) 13:22:17.657842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26473): Terminating (SIGTERM) 13:22:17.697070 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26476): Terminating (SIGTERM) 13:22:17.737325 --- ParallelTerminationStrategy: PID 26470 died... 13:22:17.756246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26470): Terminated: ok {rc=0} 13:22:17.799983 --- ParallelTerminationStrategy: PID 26473 died... 13:22:17.818476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26473): Terminated: ok {rc=0} 13:22:17.862086 --- ParallelTerminationStrategy: PID 26476 died... 13:22:17.880538 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26476): Terminated: ok {rc=0} 13:22:17.966064 bus /sierra_3: Setting Powered False 13:22:19.064442 bus /sierra_3: Setting Powered False 13:22:20.179869 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:22:21.328228 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:21.340494 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:22:21.416177 tst mo_mt_call_osmux.py: using LAC 41184 13:22:21.541926 tst mo_mt_call_osmux.py: using RAC 129 13:22:21.668582 tst mo_mt_call_osmux.py: using CellId 41184 13:22:21.792742 tst mo_mt_call_osmux.py: using BVCI 41185 13:22:21.909612 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:21.921254 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:21.932569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:21.943964 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:21.955772 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:22:21.967447 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:22:22.083044 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:22:22.203366 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:22.702957 run create_hlr_db(pid=26479): Launched 13:22:22.825518 bus /sierra_2: Setting Powered False 13:22:23.889897 run create_hlr_db(pid=26479): Terminated: ok {rc=0} 13:22:24.340034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26481): Launched 13:22:24.662884 run osmo-hlr_10.42.42.2(pid=26482): Launched 13:22:24.785869 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:25.339590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26484): Launched 13:22:25.645045 run osmo-stp_10.42.42.5(pid=26485): Launched 13:22:25.759373 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:26.320781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26487): Launched 13:22:26.622150 run osmo-msc_10.42.42.6(pid=26488): Launched 13:22:26.795331 run osmo-stp_10.42.42.5(pid=26485): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26485)] 13:22:26.922725 run osmo-stp_10.42.42.5(pid=26485): stdout: | (launched: 2022-12-14_13:22:25.590250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:27.050337 run osmo-stp_10.42.42.5(pid=26485): stderr: | 20221214132225762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132225763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132225763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132225763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132225764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132225764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132225764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:27.176042 run osmo-stp_10.42.42.5(pid=26485): stdout: | (launched: 2022-12-14_13:22:25.590250) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:27.295747 run osmo-stp_10.42.42.5(pid=26485): stderr: | 20221214132225762 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132225763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132225763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132225763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132225764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132225764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132225764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:27.439326 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26485): Process ended prematurely: osmo-stp_10.42.42.5(pid=26485) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26485)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:22:27.448245 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:22:27.474378 run osmo-hlr_10.42.42.2(pid=26482): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26482)] 13:22:27.522542 run osmo-hlr_10.42.42.2(pid=26482): stdout: | (launched: 2022-12-14_13:22:24.604421) 13:22:27.572320 run osmo-hlr_10.42.42.2(pid=26482): stderr: | 20221214132224806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132224806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132224806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132224806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132224806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132224806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132224819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132224829 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132224829 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132224829 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:27.641246 run osmo-msc_10.42.42.6(pid=26488): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26488)] 13:22:27.688890 run osmo-msc_10.42.42.6(pid=26488): stdout: | (launched: 2022-12-14_13:22:26.567022) 13:22:27.738339 run osmo-msc_10.42.42.6(pid=26488): stderr: | 20221214132226836 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132226836 DLGLOBAL DEBUG validating counter group 0x7f92459d5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132226836 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132226836 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132226836 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132226837 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132226839 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132226839 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132226839 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132226839 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:27.788559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26481): Terminating (SIGTERM) 13:22:27.828537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26484): Terminating (SIGTERM) 13:22:27.868098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26487): Terminating (SIGTERM) 13:22:27.907911 --- ParallelTerminationStrategy: PID 26481 died... 13:22:27.927198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26481): Terminated: ok {rc=0} 13:22:27.971243 --- ParallelTerminationStrategy: PID 26484 died... 13:22:27.989934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26484): Terminated: ok {rc=0} 13:22:28.033684 --- ParallelTerminationStrategy: PID 26487 died... 13:22:28.052416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26487): Terminated: ok {rc=0} 13:22:28.138575 bus /sierra_3: Setting Powered False 13:22:29.236806 bus /sierra_3: Setting Powered False 13:22:30.350457 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:22:31.637133 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:31.645078 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:22:31.681807 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:22:31.710209 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:22:31.769864 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:22:31.821965 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:22:31.849925 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:22:32.377894 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:22:32.427011 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:32.438239 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:22:32.506907 tst mo_mt_call.py: using LAC 41185 13:22:32.625569 tst mo_mt_call.py: using RAC 130 13:22:32.741892 tst mo_mt_call.py: using CellId 41185 13:22:32.857974 tst mo_mt_call.py: using BVCI 41186 13:22:32.966719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:32.977958 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:32.988920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:32.999877 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:33.010994 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:33.021965 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:22:33.142238 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:22:33.260188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:33.757843 run create_hlr_db(pid=26493): Launched 13:22:33.881211 bus /sierra_2: Setting Powered False 13:22:34.944779 run create_hlr_db(pid=26493): Terminated: ok {rc=0} 13:22:35.374946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26495): Launched 13:22:35.674482 run osmo-hlr_10.42.42.2(pid=26496): Launched 13:22:35.787677 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:36.306801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26498): Launched 13:22:36.605758 run osmo-stp_10.42.42.5(pid=26499): Launched 13:22:36.718902 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:37.261315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26501): Launched 13:22:37.562064 run osmo-msc_10.42.42.6(pid=26502): Launched 13:22:37.728793 run osmo-stp_10.42.42.5(pid=26499): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26499)] 13:22:37.855198 run osmo-stp_10.42.42.5(pid=26499): stdout: | (launched: 2022-12-14_13:22:36.551205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:37.982981 run osmo-stp_10.42.42.5(pid=26499): stderr: | 20221214132236721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132236721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132236722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132236722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132236722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132236723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132236723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:38.107948 run osmo-stp_10.42.42.5(pid=26499): stdout: | (launched: 2022-12-14_13:22:36.551205) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:38.227177 run osmo-stp_10.42.42.5(pid=26499): stderr: | 20221214132236721 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132236721 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132236722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132236722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132236722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132236723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132236723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:38.370197 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26499): Process ended prematurely: osmo-stp_10.42.42.5(pid=26499) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26499)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:22:38.378819 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:22:38.404614 run osmo-hlr_10.42.42.2(pid=26496): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26496)] 13:22:38.451462 run osmo-hlr_10.42.42.2(pid=26496): stdout: | (launched: 2022-12-14_13:22:35.619935) 13:22:38.500358 run osmo-hlr_10.42.42.2(pid=26496): stderr: | 20221214132235797 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132235797 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132235797 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132235797 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132235797 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132235797 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132235809 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132235818 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132235818 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132235818 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:38.568605 run osmo-msc_10.42.42.6(pid=26502): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26502)] 13:22:38.615346 run osmo-msc_10.42.42.6(pid=26502): stdout: | (launched: 2022-12-14_13:22:37.506748) 13:22:38.663994 run osmo-msc_10.42.42.6(pid=26502): stderr: | 20221214132237780 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132237780 DLGLOBAL DEBUG validating counter group 0x7fbc268c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132237780 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132237780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132237780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132237780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132237782 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132237782 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132237783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132237783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:38.713073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26495): Terminating (SIGTERM) 13:22:38.751808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26498): Terminating (SIGTERM) 13:22:38.791013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26501): Terminating (SIGTERM) 13:22:38.830377 --- ParallelTerminationStrategy: PID 26495 died... 13:22:38.849153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26495): Terminated: ok {rc=0} 13:22:38.892637 --- ParallelTerminationStrategy: PID 26498 died... 13:22:38.911512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26498): Terminated: ok {rc=0} 13:22:38.955740 --- ParallelTerminationStrategy: PID 26501 died... 13:22:38.974532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26501): Terminated: ok {rc=0} 13:22:39.087590 bus /sierra_3: Setting Powered False 13:22:40.191772 bus /sierra_3: Setting Powered False 13:22:41.305480 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:22:42.450395 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:42.461973 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:22:42.531086 tst mo_mt_call_osmux.py: using LAC 41186 13:22:42.648707 tst mo_mt_call_osmux.py: using RAC 131 13:22:42.768189 tst mo_mt_call_osmux.py: using CellId 41186 13:22:42.888289 tst mo_mt_call_osmux.py: using BVCI 41187 13:22:42.998096 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:43.009531 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:43.020458 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:43.031453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:43.042472 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:22:43.053391 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:22:43.167461 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:22:43.287227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:43.786155 run create_hlr_db(pid=26505): Launched 13:22:43.909897 bus /sierra_2: Setting Powered False 13:22:44.973921 run create_hlr_db(pid=26505): Terminated: ok {rc=0} 13:22:45.423727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26507): Launched 13:22:45.745509 run osmo-hlr_10.42.42.2(pid=26508): Launched 13:22:45.886372 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:46.779638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26510): Launched 13:22:47.213968 run osmo-stp_10.42.42.5(pid=26511): Launched 13:22:47.371477 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:48.019675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26513): Launched 13:22:48.342103 run osmo-msc_10.42.42.6(pid=26514): Launched 13:22:48.520504 run osmo-stp_10.42.42.5(pid=26511): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26511)] 13:22:48.656171 run osmo-stp_10.42.42.5(pid=26511): stdout: | (launched: 2022-12-14_13:22:47.132186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:48.792654 run osmo-stp_10.42.42.5(pid=26511): stderr: | 20221214132247509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132247509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132247509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132247510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132247511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132247511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132247511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:48.928740 run osmo-stp_10.42.42.5(pid=26511): stdout: | (launched: 2022-12-14_13:22:47.132186) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:49.057154 run osmo-stp_10.42.42.5(pid=26511): stderr: | 20221214132247509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132247509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132247509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132247510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132247511 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132247511 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132247511 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:22:49.210969 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26511): Process ended prematurely: osmo-stp_10.42.42.5(pid=26511) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26511)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:22:49.220364 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 13:22:49.247873 run osmo-hlr_10.42.42.2(pid=26508): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26508)] 13:22:49.297934 run osmo-hlr_10.42.42.2(pid=26508): stdout: | (launched: 2022-12-14_13:22:45.687427) 13:22:49.349554 run osmo-hlr_10.42.42.2(pid=26508): stderr: | 20221214132245982 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132245983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132245983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132245983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132245983 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132245983 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132246008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132246025 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132246025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132246025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:22:49.421481 run osmo-msc_10.42.42.6(pid=26514): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26514)] 13:22:49.471074 run osmo-msc_10.42.42.6(pid=26514): stdout: | (launched: 2022-12-14_13:22:48.283497) 13:22:49.522409 run osmo-msc_10.42.42.6(pid=26514): stderr: | 20221214132248603 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132248603 DLGLOBAL DEBUG validating counter group 0x7f7567e5ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132248603 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132248603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132248603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132248604 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132248605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132248606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132248606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132248606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:22:49.574130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26507): Terminating (SIGTERM) 13:22:49.615877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26510): Terminating (SIGTERM) 13:22:49.657469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26513): Terminating (SIGTERM) 13:22:49.699782 --- ParallelTerminationStrategy: PID 26507 died... 13:22:49.719899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26507): Terminated: ok {rc=0} 13:22:49.766461 --- ParallelTerminationStrategy: PID 26510 died... 13:22:49.786278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26510): Terminated: ok {rc=0} 13:22:49.832143 --- ParallelTerminationStrategy: PID 26513 died... 13:22:49.852254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26513): Terminated: ok {rc=0} 13:22:49.940309 bus /sierra_3: Setting Powered False 13:22:51.039103 bus /sierra_3: Setting Powered False 13:22:52.154401 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:22:53.406368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:22:53.413273 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:22:53.447499 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:22:53.476350 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:22:53.529808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:22:53.563161 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:22:53.589507 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:22:54.142981 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:22:54.195144 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:22:54.206802 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:22:54.277813 tst mo_mt_call.py: using LAC 41187 13:22:54.398791 tst mo_mt_call.py: using RAC 132 13:22:54.521422 tst mo_mt_call.py: using CellId 41187 13:22:54.642637 tst mo_mt_call.py: using BVCI 41188 13:22:54.752655 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:22:54.763931 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:22:54.774865 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:22:54.785870 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:22:54.796781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:22:54.807715 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:22:54.921058 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:22:55.039750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:22:55.538803 run create_hlr_db(pid=26520): Launched 13:22:55.662220 bus /sierra_2: Setting Powered False 13:22:56.726693 run create_hlr_db(pid=26520): Terminated: ok {rc=0} 13:22:57.176423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26522): Launched 13:22:57.498065 run osmo-hlr_10.42.42.2(pid=26523): Launched 13:22:57.621114 run osmo-stp_10.42.42.5: Starting osmo-stp 13:22:58.175963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26525): Launched 13:22:58.497381 run osmo-stp_10.42.42.5(pid=26526): Launched 13:22:58.619650 run osmo-msc_10.42.42.6: Starting osmo-msc 13:22:59.203497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26528): Launched 13:22:59.526008 run osmo-msc_10.42.42.6(pid=26529): Launched 13:22:59.705404 run osmo-stp_10.42.42.5(pid=26526): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26526)] 13:22:59.841718 run osmo-stp_10.42.42.5(pid=26526): stdout: | (launched: 2022-12-14_13:22:58.438846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:22:59.978906 run osmo-stp_10.42.42.5(pid=26526): stderr: | 20221214132258630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132258630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132258631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132258631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132258633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132258634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132258634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:00.115226 run osmo-stp_10.42.42.5(pid=26526): stdout: | (launched: 2022-12-14_13:22:58.438846) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:00.243953 run osmo-stp_10.42.42.5(pid=26526): stderr: | 20221214132258630 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132258630 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132258631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132258631 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132258633 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132258634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132258634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:00.398192 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26526): Process ended prematurely: osmo-stp_10.42.42.5(pid=26526) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26526)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:23:00.407575 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:23:00.435219 run osmo-hlr_10.42.42.2(pid=26523): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26523)] 13:23:00.485332 run osmo-hlr_10.42.42.2(pid=26523): stdout: | (launched: 2022-12-14_13:22:57.439754) 13:23:00.537220 run osmo-hlr_10.42.42.2(pid=26523): stderr: | 20221214132257637 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132257637 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132257637 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132257637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132257637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132257637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132257649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132257657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132257657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132257657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:00.609004 run osmo-msc_10.42.42.6(pid=26529): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26529)] 13:23:00.658502 run osmo-msc_10.42.42.6(pid=26529): stdout: | (launched: 2022-12-14_13:22:59.467318) 13:23:00.709861 run osmo-msc_10.42.42.6(pid=26529): stderr: | 20221214132259787 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132259787 DLGLOBAL DEBUG validating counter group 0x7fa6d2e3ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132259788 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132259788 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132259788 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132259788 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132259790 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132259790 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132259790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132259790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:00.761668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26522): Terminating (SIGTERM) 13:23:00.803294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26525): Terminating (SIGTERM) 13:23:00.852283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26528): Terminating (SIGTERM) 13:23:00.896557 --- ParallelTerminationStrategy: PID 26522 died... 13:23:00.921876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26522): Terminated: ok {rc=0} 13:23:00.973122 --- ParallelTerminationStrategy: PID 26525 died... 13:23:00.993284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26525): Terminated: ok {rc=0} 13:23:01.042372 --- ParallelTerminationStrategy: PID 26528 died... 13:23:01.062043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26528): Terminated: ok {rc=0} 13:23:01.156607 bus /sierra_3: Setting Powered False 13:23:02.278234 bus /sierra_3: Setting Powered False 13:23:03.395174 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:23:04.540273 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:04.552325 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:23:04.622728 tst mo_mt_call_osmux.py: using LAC 41188 13:23:04.742490 tst mo_mt_call_osmux.py: using RAC 133 13:23:04.862186 tst mo_mt_call_osmux.py: using CellId 41188 13:23:04.980055 tst mo_mt_call_osmux.py: using BVCI 41189 13:23:05.090593 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:05.101900 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:05.112757 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:05.123708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:05.134754 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:23:05.145645 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:23:05.259206 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:23:05.373434 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:05.838434 run create_hlr_db(pid=26531): Launched 13:23:05.960883 bus /sierra_2: Setting Powered False 13:23:07.024666 run create_hlr_db(pid=26531): Terminated: ok {rc=0} 13:23:07.474863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26533): Launched 13:23:07.797465 run osmo-hlr_10.42.42.2(pid=26534): Launched 13:23:07.921216 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:08.481212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26536): Launched 13:23:08.804080 run osmo-stp_10.42.42.5(pid=26537): Launched 13:23:08.927207 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:09.511446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26539): Launched 13:23:09.817644 run osmo-msc_10.42.42.6(pid=26540): Launched 13:23:09.985846 run osmo-stp_10.42.42.5(pid=26537): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26537)] 13:23:10.114169 run osmo-stp_10.42.42.5(pid=26537): stdout: | (launched: 2022-12-14_13:23:08.745629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:10.242946 run osmo-stp_10.42.42.5(pid=26537): stderr: | 20221214132308940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132308940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132308940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132308941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132308941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132308941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132308941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:10.368654 run osmo-stp_10.42.42.5(pid=26537): stdout: | (launched: 2022-12-14_13:23:08.745629) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:10.488326 run osmo-stp_10.42.42.5(pid=26537): stderr: | 20221214132308940 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132308940 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132308940 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132308941 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132308941 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132308941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132308941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:10.631733 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26537): Process ended prematurely: osmo-stp_10.42.42.5(pid=26537) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26537)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:23:10.640811 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:23:10.667358 run osmo-hlr_10.42.42.2(pid=26534): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26534)] 13:23:10.715235 run osmo-hlr_10.42.42.2(pid=26534): stdout: | (launched: 2022-12-14_13:23:07.739161) 13:23:10.764790 run osmo-hlr_10.42.42.2(pid=26534): stderr: | 20221214132307936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132307936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132307936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132307936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132307936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132307937 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132307949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132307957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132307957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132307957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:10.834569 run osmo-msc_10.42.42.6(pid=26540): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26540)] 13:23:10.882633 run osmo-msc_10.42.42.6(pid=26540): stdout: | (launched: 2022-12-14_13:23:09.762531) 13:23:10.932094 run osmo-msc_10.42.42.6(pid=26540): stderr: | 20221214132310035 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132310035 DLGLOBAL DEBUG validating counter group 0x7f6c12693c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132310035 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132310035 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132310035 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132310035 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132310039 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132310040 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132310040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132310040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:10.982066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26533): Terminating (SIGTERM) 13:23:11.021806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26536): Terminating (SIGTERM) 13:23:11.061605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26539): Terminating (SIGTERM) 13:23:11.101608 --- ParallelTerminationStrategy: PID 26533 died... 13:23:11.120920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26533): Terminated: ok {rc=0} 13:23:11.165045 --- ParallelTerminationStrategy: PID 26536 died... 13:23:11.183621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26536): Terminated: ok {rc=0} 13:23:11.227510 --- ParallelTerminationStrategy: PID 26539 died... 13:23:11.246203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26539): Terminated: ok {rc=0} 13:23:11.332680 bus /sierra_3: Setting Powered False 13:23:12.431844 bus /sierra_3: Setting Powered False 13:23:13.544047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:23:14.802756 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:23:14.809692 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:23:14.843696 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:23:14.871811 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:23:14.924519 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:23:14.957704 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:23:14.984362 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:23:15.538204 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:23:15.591330 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:15.603157 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:23:15.677852 tst mo_mt_call.py: using LAC 41189 13:23:15.802918 tst mo_mt_call.py: using RAC 134 13:23:15.947312 tst mo_mt_call.py: using CellId 41189 13:23:16.067704 tst mo_mt_call.py: using BVCI 41190 13:23:16.186430 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:16.198810 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:16.210963 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:16.223047 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:16.235712 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:16.248712 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:23:16.373205 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:23:16.508048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:17.005370 run create_hlr_db(pid=26545): Launched 13:23:17.152054 bus /sierra_2: Setting Powered False 13:23:18.212868 run create_hlr_db(pid=26545): Terminated: ok {rc=0} 13:23:18.653243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26547): Launched 13:23:18.974413 run osmo-hlr_10.42.42.2(pid=26548): Launched 13:23:19.096850 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:19.650343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26550): Launched 13:23:19.971675 run osmo-stp_10.42.42.5(pid=26551): Launched 13:23:20.094549 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:20.675524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26553): Launched 13:23:20.998661 run osmo-msc_10.42.42.6(pid=26554): Launched 13:23:21.178165 run osmo-stp_10.42.42.5(pid=26551): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26551)] 13:23:21.314669 run osmo-stp_10.42.42.5(pid=26551): stdout: | (launched: 2022-12-14_13:23:19.913506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:21.451377 run osmo-stp_10.42.42.5(pid=26551): stderr: | 20221214132320105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132320105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132320106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132320106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132320108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132320109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132320109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:21.587814 run osmo-stp_10.42.42.5(pid=26551): stdout: | (launched: 2022-12-14_13:23:19.913506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:21.717032 run osmo-stp_10.42.42.5(pid=26551): stderr: | 20221214132320105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132320105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132320106 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132320106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132320108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132320109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132320109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:21.871499 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26551): Process ended prematurely: osmo-stp_10.42.42.5(pid=26551) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26551)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:23:21.881282 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:23:21.909016 run osmo-hlr_10.42.42.2(pid=26548): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26548)] 13:23:21.959679 run osmo-hlr_10.42.42.2(pid=26548): stdout: | (launched: 2022-12-14_13:23:18.916240) 13:23:22.011656 run osmo-hlr_10.42.42.2(pid=26548): stderr: | 20221214132319114 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132319114 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132319114 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132319114 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132319114 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132319114 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132319125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132319134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132319134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132319134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:22.084222 run osmo-msc_10.42.42.6(pid=26554): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26554)] 13:23:22.133988 run osmo-msc_10.42.42.6(pid=26554): stdout: | (launched: 2022-12-14_13:23:20.940475) 13:23:22.185637 run osmo-msc_10.42.42.6(pid=26554): stderr: | 20221214132321260 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132321260 DLGLOBAL DEBUG validating counter group 0x7f77bae97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132321260 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132321260 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132321261 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132321261 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132321264 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132321265 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132321265 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132321265 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:22.237945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26547): Terminating (SIGTERM) 13:23:22.279334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26550): Terminating (SIGTERM) 13:23:22.320854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26553): Terminating (SIGTERM) 13:23:22.363207 --- ParallelTerminationStrategy: PID 26547 died... 13:23:22.383363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26547): Terminated: ok {rc=0} 13:23:22.429491 --- ParallelTerminationStrategy: PID 26550 died... 13:23:22.449133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26550): Terminated: ok {rc=0} 13:23:22.495155 --- ParallelTerminationStrategy: PID 26553 died... 13:23:22.514899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26553): Terminated: ok {rc=0} 13:23:22.601307 bus /sierra_3: Setting Powered False 13:23:23.699633 bus /sierra_3: Setting Powered False 13:23:24.815631 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:23:25.963471 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:25.975816 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:23:26.048815 tst mo_mt_call_osmux.py: using LAC 41190 13:23:26.174104 tst mo_mt_call_osmux.py: using RAC 135 13:23:26.301385 tst mo_mt_call_osmux.py: using CellId 41190 13:23:26.428390 tst mo_mt_call_osmux.py: using BVCI 41191 13:23:26.544406 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:26.556050 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:26.567469 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:26.578980 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:26.590789 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:23:26.602484 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:23:26.722249 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:23:26.839189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:27.339542 run create_hlr_db(pid=26556): Launched 13:23:27.461153 bus /sierra_2: Setting Powered False 13:23:28.524605 run create_hlr_db(pid=26556): Terminated: ok {rc=0} 13:23:28.955225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26558): Launched 13:23:29.254353 run osmo-hlr_10.42.42.2(pid=26559): Launched 13:23:29.368536 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:29.883623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26561): Launched 13:23:30.182911 run osmo-stp_10.42.42.5(pid=26562): Launched 13:23:30.297134 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:30.840722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26564): Launched 13:23:31.201618 run osmo-msc_10.42.42.6(pid=26565): Launched 13:23:31.504501 run osmo-stp_10.42.42.5(pid=26562): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26562)] 13:23:31.771901 run osmo-stp_10.42.42.5(pid=26562): stdout: | (launched: 2022-12-14_13:23:30.128094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:31.910977 run osmo-stp_10.42.42.5(pid=26562): stderr: | 20221214132330300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132330300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132330300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132330300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132330303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132330303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132330303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:32.083926 run osmo-stp_10.42.42.5(pid=26562): stdout: | (launched: 2022-12-14_13:23:30.128094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:32.209603 run osmo-stp_10.42.42.5(pid=26562): stderr: | 20221214132330300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132330300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132330300 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132330300 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132330303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132330303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132330303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:32.361084 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26562): Process ended prematurely: osmo-stp_10.42.42.5(pid=26562) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26562)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:23:32.370163 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:23:32.396599 run osmo-hlr_10.42.42.2(pid=26559): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26559)] 13:23:32.444104 run osmo-hlr_10.42.42.2(pid=26559): stdout: | (launched: 2022-12-14_13:23:29.199953) 13:23:32.493409 run osmo-hlr_10.42.42.2(pid=26559): stderr: | 20221214132329376 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132329376 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132329376 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132329376 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132329376 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132329376 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132329388 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132329397 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132329397 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132329397 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:32.562148 run osmo-msc_10.42.42.6(pid=26565): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26565)] 13:23:32.609590 run osmo-msc_10.42.42.6(pid=26565): stdout: | (launched: 2022-12-14_13:23:31.130238) 13:23:32.658653 run osmo-msc_10.42.42.6(pid=26565): stderr: | 20221214132331712 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132331712 DLGLOBAL DEBUG validating counter group 0x7f4082d91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132331712 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132331712 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132331712 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132331721 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132331723 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132331723 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132331723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132331723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:32.707989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26558): Terminating (SIGTERM) 13:23:32.747408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26561): Terminating (SIGTERM) 13:23:32.786965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26564): Terminating (SIGTERM) 13:23:32.826692 --- ParallelTerminationStrategy: PID 26558 died... 13:23:32.845734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26558): Terminated: ok {rc=0} 13:23:32.889697 --- ParallelTerminationStrategy: PID 26561 died... 13:23:32.908318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26561): Terminated: ok {rc=0} 13:23:32.952132 --- ParallelTerminationStrategy: PID 26564 died... 13:23:32.970741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26564): Terminated: ok {rc=0} 13:23:33.055786 bus /sierra_3: Setting Powered False 13:23:34.154255 bus /sierra_3: Setting Powered False 13:23:35.266985 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:23:36.518820 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:23:36.525960 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:23:36.559939 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:23:36.588367 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:23:36.640434 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:23:36.673880 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:23:36.700937 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:23:37.253067 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:23:37.306612 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:37.318154 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:23:37.390186 tst mo_mt_call.py: using LAC 41191 13:23:37.517533 tst mo_mt_call.py: using RAC 136 13:23:37.643183 tst mo_mt_call.py: using CellId 41191 13:23:37.769860 tst mo_mt_call.py: using BVCI 41192 13:23:37.880668 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:37.891808 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:37.902730 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:37.913666 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:37.925273 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:37.936686 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:23:38.057344 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:23:38.172606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:38.639503 run create_hlr_db(pid=26571): Launched 13:23:38.762468 bus /sierra_2: Setting Powered False 13:23:39.822789 run create_hlr_db(pid=26571): Terminated: ok {rc=0} 13:23:40.241706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26573): Launched 13:23:40.542454 run osmo-hlr_10.42.42.2(pid=26574): Launched 13:23:40.655613 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:41.175153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26576): Launched 13:23:41.474453 run osmo-stp_10.42.42.5(pid=26577): Launched 13:23:41.588582 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:42.130580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26579): Launched 13:23:42.431707 run osmo-msc_10.42.42.6(pid=26580): Launched 13:23:42.599221 run osmo-stp_10.42.42.5(pid=26577): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26577)] 13:23:42.727103 run osmo-stp_10.42.42.5(pid=26577): stdout: | (launched: 2022-12-14_13:23:41.419391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:42.854965 run osmo-stp_10.42.42.5(pid=26577): stderr: | 20221214132341590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132341590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132341591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132341591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132341591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132341591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132341592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:42.980180 run osmo-stp_10.42.42.5(pid=26577): stdout: | (launched: 2022-12-14_13:23:41.419391) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:43.100258 run osmo-stp_10.42.42.5(pid=26577): stderr: | 20221214132341590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132341590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132341591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132341591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132341591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132341591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132341592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:43.243783 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26577): Process ended prematurely: osmo-stp_10.42.42.5(pid=26577) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26577)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:23:43.252739 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:23:43.278746 run osmo-hlr_10.42.42.2(pid=26574): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26574)] 13:23:43.326662 run osmo-hlr_10.42.42.2(pid=26574): stdout: | (launched: 2022-12-14_13:23:40.487502) 13:23:43.375964 run osmo-hlr_10.42.42.2(pid=26574): stderr: | 20221214132340662 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132340662 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132340663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132340663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132340663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132340663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132340674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132340683 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132340684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132340684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:43.450853 run osmo-msc_10.42.42.6(pid=26580): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26580)] 13:23:43.501078 run osmo-msc_10.42.42.6(pid=26580): stdout: | (launched: 2022-12-14_13:23:42.375795) 13:23:43.553075 run osmo-msc_10.42.42.6(pid=26580): stderr: | 20221214132342651 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132342651 DLGLOBAL DEBUG validating counter group 0x7f7cc8070c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132342651 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132342651 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132342651 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132342651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132342653 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132342654 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132342654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132342654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:43.605346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26573): Terminating (SIGTERM) 13:23:43.647203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26576): Terminating (SIGTERM) 13:23:43.689720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26579): Terminating (SIGTERM) 13:23:43.731991 --- ParallelTerminationStrategy: PID 26573 died... 13:23:43.752235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26573): Terminated: ok {rc=0} 13:23:43.798669 --- ParallelTerminationStrategy: PID 26576 died... 13:23:43.818377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26576): Terminated: ok {rc=0} 13:23:43.865091 --- ParallelTerminationStrategy: PID 26579 died... 13:23:43.885275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26579): Terminated: ok {rc=0} 13:23:43.973194 bus /sierra_3: Setting Powered False 13:23:45.072134 bus /sierra_3: Setting Powered False 13:23:46.187936 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:23:47.329895 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:47.341419 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:23:47.411866 tst mo_mt_call_osmux.py: using LAC 41192 13:23:47.543744 tst mo_mt_call_osmux.py: using RAC 137 13:23:47.668847 tst mo_mt_call_osmux.py: using CellId 41192 13:23:47.793663 tst mo_mt_call_osmux.py: using BVCI 41193 13:23:47.902901 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:47.914083 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:47.925197 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:47.936020 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:47.947159 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:23:47.958301 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:23:48.078024 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:23:48.196598 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:48.662563 run create_hlr_db(pid=26582): Launched 13:23:48.784502 bus /sierra_2: Setting Powered False 13:23:49.844675 run create_hlr_db(pid=26582): Terminated: ok {rc=0} 13:23:50.264348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26584): Launched 13:23:50.564678 run osmo-hlr_10.42.42.2(pid=26585): Launched 13:23:50.677958 run osmo-stp_10.42.42.5: Starting osmo-stp 13:23:51.194827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26587): Launched 13:23:51.493459 run osmo-stp_10.42.42.5(pid=26588): Launched 13:23:51.608040 run osmo-msc_10.42.42.6: Starting osmo-msc 13:23:52.149151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26590): Launched 13:23:52.450283 run osmo-msc_10.42.42.6(pid=26591): Launched 13:23:52.619287 run osmo-stp_10.42.42.5(pid=26588): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26588)] 13:23:52.745687 run osmo-stp_10.42.42.5(pid=26588): stdout: | (launched: 2022-12-14_13:23:51.438762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:52.872172 run osmo-stp_10.42.42.5(pid=26588): stderr: | 20221214132351609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132351609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132351609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132351609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132351610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132351610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132351610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:52.997353 run osmo-stp_10.42.42.5(pid=26588): stdout: | (launched: 2022-12-14_13:23:51.438762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:23:53.116566 run osmo-stp_10.42.42.5(pid=26588): stderr: | 20221214132351609 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132351609 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132351609 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132351609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132351610 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132351610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132351610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:23:53.259482 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26588): Process ended prematurely: osmo-stp_10.42.42.5(pid=26588) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26588)] [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:23:53.268302 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:23:53.294493 run osmo-hlr_10.42.42.2(pid=26585): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26585)] 13:23:53.341833 run osmo-hlr_10.42.42.2(pid=26585): stdout: | (launched: 2022-12-14_13:23:50.509804) 13:23:53.390674 run osmo-hlr_10.42.42.2(pid=26585): stderr: | 20221214132350688 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132350688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132350688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132350688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132350688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132350688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132350701 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132350709 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132350709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132350709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:23:53.459047 run osmo-msc_10.42.42.6(pid=26591): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26591)] 13:23:53.506228 run osmo-msc_10.42.42.6(pid=26591): stdout: | (launched: 2022-12-14_13:23:52.394526) 13:23:53.555066 run osmo-msc_10.42.42.6(pid=26591): stderr: | 20221214132352666 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132352667 DLGLOBAL DEBUG validating counter group 0x7f1e0beefc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132352667 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132352667 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132352667 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132352667 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132352669 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132352669 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132352669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132352670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:23:53.604222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26584): Terminating (SIGTERM) 13:23:53.643446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26587): Terminating (SIGTERM) 13:23:53.682876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26590): Terminating (SIGTERM) 13:23:53.722572 --- ParallelTerminationStrategy: PID 26584 died... 13:23:53.741484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26584): Terminated: ok {rc=0} 13:23:53.785848 --- ParallelTerminationStrategy: PID 26587 died... 13:23:53.804170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26587): Terminated: ok {rc=0} 13:23:53.847871 --- ParallelTerminationStrategy: PID 26590 died... 13:23:53.866239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26590): Terminated: ok {rc=0} 13:23:53.949453 bus /sierra_3: Setting Powered False 13:23:55.047407 bus /sierra_3: Setting Powered False 13:23:56.164444 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 13:23:57.408571 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:23:57.413149 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:23:57.445850 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 13:23:57.471919 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 13:23:57.554448 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:23:57.587083 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 13:23:57.612892 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 13:23:58.197865 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2405 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 13:23:58.202714 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:23:58.213430 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:23:58.262221 tst emergency_mo_mt_call.py: using LAC 41193 13:23:58.379382 tst emergency_mo_mt_call.py: using RAC 138 13:23:58.494210 tst emergency_mo_mt_call.py: using CellId 41193 13:23:58.609618 tst emergency_mo_mt_call.py: using BVCI 41194 13:23:58.715490 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:23:58.726325 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:23:58.736779 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:23:58.747249 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:23:58.757714 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:23:58.768688 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:23:58.880937 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:23:58.998975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:23:59.488261 run create_hlr_db(pid=26596): Launched 13:23:59.609745 bus /sierra_2: Setting Powered False 13:24:00.672283 run create_hlr_db(pid=26596): Terminated: ok {rc=0} 13:24:01.141782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26598): Launched 13:24:01.480019 run osmo-hlr_10.42.42.2(pid=26599): Launched 13:24:01.695997 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:02.382879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26637): Launched 13:24:02.740862 run osmo-stp_10.42.42.5(pid=26650): Launched 13:24:03.007618 tst emergency_mo_mt_call.py: using MSISDN 8706 13:24:03.327545 run osmo-msc_10.42.42.6: Starting osmo-msc 13:24:04.024211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26790): Launched 13:24:04.427109 run osmo-msc_10.42.42.6(pid=26845): Launched 13:24:04.739755 run osmo-stp_10.42.42.5(pid=26650): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26650)] 13:24:05.010431 run osmo-stp_10.42.42.5(pid=26650): stdout: | (launched: 2022-12-14_13:24:02.671826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:05.211594 run osmo-stp_10.42.42.5(pid=26650): stderr: | 20221214132403003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132403003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132403003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132403003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132403004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132403004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132403004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:05.450732 run osmo-stp_10.42.42.5(pid=26650): stdout: | (launched: 2022-12-14_13:24:02.671826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:05.572372 run osmo-stp_10.42.42.5(pid=26650): stderr: | 20221214132403003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132403003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132403003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132403003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132403004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132403004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132403004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:05.719207 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=26650): Process ended prematurely: osmo-stp_10.42.42.5(pid=26650) [trial-2405↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26650)] [trial-2405↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 13:24:05.728477 tst emergency_mo_mt_call.py:19: Test FAILED (7.5 sec) 13:24:05.755838 run osmo-hlr_10.42.42.2(pid=26599): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26599)] 13:24:05.806331 run osmo-hlr_10.42.42.2(pid=26599): stdout: | (launched: 2022-12-14_13:24:01.415032) 13:24:05.858278 run osmo-hlr_10.42.42.2(pid=26599): stderr: | 20221214132401676 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132401676 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132401676 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132401676 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132401676 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132401676 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132401700 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132401721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132401721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132401726 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:05.928859 run osmo-msc_10.42.42.6(pid=26845): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26845)] 13:24:05.977461 run osmo-msc_10.42.42.6(pid=26845): stdout: | (launched: 2022-12-14_13:24:04.355014) 13:24:06.027897 run osmo-msc_10.42.42.6(pid=26845): stderr: | 20221214132404968 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132404968 DLGLOBAL DEBUG validating counter group 0x7f3f0acc2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132404968 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132404968 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132404968 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132404968 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132404970 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132404971 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132404971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132404971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:24:06.079480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26598): Terminating (SIGTERM) 13:24:06.120736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26637): Terminating (SIGTERM) 13:24:06.161990 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26790): Terminating (SIGTERM) 13:24:06.205313 --- ParallelTerminationStrategy: PID 26598 died... 13:24:06.225058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26598): Terminated: ok {rc=0} 13:24:06.272464 --- ParallelTerminationStrategy: PID 26637 died... 13:24:06.291804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26637): Terminated: ok {rc=0} 13:24:06.337067 --- ParallelTerminationStrategy: PID 26790 died... 13:24:06.357284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26790): Terminated: ok {rc=0} 13:24:06.443971 bus /sierra_3: Setting Powered False 13:24:07.543948 bus /sierra_3: Setting Powered False 13:24:08.660534 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 13:24:09.748072 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:24:09.760392 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:24:09.814376 tst emergency_preemptive_call.py: using LAC 41194 13:24:09.933038 tst emergency_preemptive_call.py: using RAC 139 13:24:10.050022 tst emergency_preemptive_call.py: using CellId 41194 13:24:10.166362 tst emergency_preemptive_call.py: using BVCI 41195 13:24:10.278146 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:24:10.290028 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:24:10.301640 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:24:10.313805 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:24:10.326768 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 13:24:10.339408 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:10.460635 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:10.579475 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:10.698229 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:10.814987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:11.294519 run create_hlr_db(pid=26878): Launched 13:24:11.458371 bus /sierra_2: Setting Powered False 13:24:12.517974 run create_hlr_db(pid=26878): Terminated: ok {rc=0} 13:24:12.957834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26880): Launched 13:24:13.293682 run osmo-hlr_10.42.42.2(pid=26881): Launched 13:24:13.537154 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:14.194927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26883): Launched 13:24:14.533311 run osmo-stp_10.42.42.5(pid=26884): Launched 13:24:14.787503 tst emergency_preemptive_call.py: using MSISDN 8707 13:24:15.023553 run osmo-msc_10.42.42.6: Starting osmo-msc 13:24:15.608762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26886): Launched 13:24:15.993463 run osmo-msc_10.42.42.6(pid=26887): Launched 13:24:16.335096 run osmo-stp_10.42.42.5(pid=26884): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26884)] 13:24:16.635192 run osmo-stp_10.42.42.5(pid=26884): stdout: | (launched: 2022-12-14_13:24:14.470218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:16.773978 run osmo-stp_10.42.42.5(pid=26884): stderr: | 20221214132414767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132414768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132414768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132414768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132414773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132414773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132414773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:16.913290 run osmo-stp_10.42.42.5(pid=26884): stdout: | (launched: 2022-12-14_13:24:14.470218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:17.045074 run osmo-stp_10.42.42.5(pid=26884): stderr: | 20221214132414767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132414768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132414768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132414768 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132414773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132414773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132414773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:17.203635 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=26884): Process ended prematurely: osmo-stp_10.42.42.5(pid=26884) [trial-2405↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26884)] [trial-2405↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 13:24:17.213826 tst emergency_preemptive_call.py:32: Test FAILED (7.5 sec) 13:24:17.242769 run osmo-hlr_10.42.42.2(pid=26881): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26881)] 13:24:17.299021 run osmo-hlr_10.42.42.2(pid=26881): stdout: | (launched: 2022-12-14_13:24:13.223604) 13:24:17.354351 run osmo-hlr_10.42.42.2(pid=26881): stderr: | 20221214132413529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132413529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132413529 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132413529 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132413529 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132413529 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132413553 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132413561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132413562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132413562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:17.430621 run osmo-msc_10.42.42.6(pid=26887): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=26887)] 13:24:17.484747 run osmo-msc_10.42.42.6(pid=26887): stdout: | (launched: 2022-12-14_13:24:15.918254) 13:24:17.539928 run osmo-msc_10.42.42.6(pid=26887): stderr: | 20221214132416422 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132416422 DLGLOBAL DEBUG validating counter group 0x7efe12ca5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132416422 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132416423 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132416423 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132416423 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132416425 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132416425 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132416425 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132416426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:24:17.595758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26880): Terminating (SIGTERM) 13:24:17.639665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26883): Terminating (SIGTERM) 13:24:17.687212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26886): Terminating (SIGTERM) 13:24:17.734084 --- ParallelTerminationStrategy: PID 26880 died... 13:24:17.756455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26880): Terminated: ok {rc=0} 13:24:17.806686 --- ParallelTerminationStrategy: PID 26883 died... 13:24:17.828447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26883): Terminated: ok {rc=0} 13:24:17.878520 --- ParallelTerminationStrategy: PID 26886 died... 13:24:17.900215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=26886): Terminated: ok {rc=0} 13:24:18.002955 bus /sierra_9: Setting Powered False 13:24:19.110756 bus /sierra_9: Setting Powered False 13:24:20.230203 bus /sierra_8: Setting Powered False 13:24:21.329589 bus /sierra_8: Setting Powered False 13:24:22.446872 bus /sierra_3: Setting Powered False 13:24:23.547976 bus /sierra_3: Setting Powered False 13:24:24.666911 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 13:24:25.946566 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:24:25.951095 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 13:24:25.984034 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 13:24:26.021859 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 13:24:26.107878 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 13:24:26.140675 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 13:24:26.178390 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 13:24:26.769593 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 13:24:26.818445 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:26.829082 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:24:26.877396 tst cs_paging_gprs_active.py: using LAC 41195 13:24:26.996999 tst cs_paging_gprs_active.py: using RAC 140 13:24:27.115250 tst cs_paging_gprs_active.py: using CellId 41195 13:24:27.234670 tst cs_paging_gprs_active.py: using BVCI 41196 13:24:27.344133 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:27.354985 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:27.365455 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:27.375847 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:27.386218 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:27.397167 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:27.407849 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:27.418692 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:27.429662 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:27.543545 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:27.661547 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:24:27.880381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:28.205645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26893): Launched 13:24:28.486637 run iperf3-srv_10.42.42.10(pid=26894): Launched 13:24:28.607870 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:24:28.826550 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:29.151448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26895): Launched 13:24:29.431854 run iperf3-srv_10.42.42.10(pid=26896): Launched 13:24:29.553420 tst cs_paging_gprs_active.py:38: start network... 13:24:29.771721 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:30.272489 run create_hlr_db(pid=26897): Launched 13:24:30.395687 bus /sierra_2: Setting Powered False 13:24:31.460402 run create_hlr_db(pid=26897): Terminated: ok {rc=0} 13:24:31.926637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26899): Launched 13:24:32.297040 run osmo-hlr_10.42.42.2(pid=26900): Launched 13:24:32.422070 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:32.979582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26902): Launched 13:24:33.303498 run osmo-stp_10.42.42.5(pid=26903): Launched 13:24:33.427317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:33.984556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26905): Launched 13:24:34.107946 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:34.380862 run patchelf(pid=26906): Launched 13:24:34.560537 run osmo-stp_10.42.42.5(pid=26903): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26903)] 13:24:34.697490 run osmo-stp_10.42.42.5(pid=26903): stdout: | (launched: 2022-12-14_13:24:33.244903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:34.836211 run osmo-stp_10.42.42.5(pid=26903): stderr: | 20221214132433439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132433439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132433440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132433440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132433440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132433441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132433441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:34.975462 run osmo-stp_10.42.42.5(pid=26903): stdout: | (launched: 2022-12-14_13:24:33.244903) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:35.108157 run osmo-stp_10.42.42.5(pid=26903): stderr: | 20221214132433439 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132433439 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132433440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132433440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132433440 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132433441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132433441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:35.265542 run patchelf(pid=26906): Terminating (SIGINT) 13:24:35.446731 run patchelf(pid=26906): Terminated: ok {rc=0} 13:24:35.577298 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26903): Process ended prematurely: osmo-stp_10.42.42.5(pid=26903) [trial-2405↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26903)] [trial-2405↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 13:24:35.587545 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:24:35.615863 run osmo-hlr_10.42.42.2(pid=26900): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26900)] 13:24:35.666278 run osmo-hlr_10.42.42.2(pid=26900): stdout: | (launched: 2022-12-14_13:24:32.237885) 13:24:35.717961 run osmo-hlr_10.42.42.2(pid=26900): stderr: | 20221214132432437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132432437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132432437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132432437 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132432437 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132432437 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132432450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132432459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132432459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132432459 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:35.770235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26893): Terminating (SIGTERM) 13:24:35.812061 run iperf3-srv_10.42.42.10(pid=26894): Terminating (SIGTERM) 13:24:35.854337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26895): Terminating (SIGTERM) 13:24:35.896249 run iperf3-srv_10.42.42.10(pid=26896): Terminating (SIGTERM) 13:24:35.938514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26899): Terminating (SIGTERM) 13:24:35.980648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26902): Terminating (SIGTERM) 13:24:36.022685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26905): Terminating (SIGTERM) 13:24:36.064574 --- ParallelTerminationStrategy: PID 26893 died... 13:24:36.084779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26893): Terminated: ok {rc=0} 13:24:36.131048 --- ParallelTerminationStrategy: PID 26894 died... 13:24:36.150616 run iperf3-srv_10.42.42.10(pid=26894): Terminated {rc=256} 13:24:36.196615 --- ParallelTerminationStrategy: PID 26895 died... 13:24:36.216554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26895): Terminated: ok {rc=0} 13:24:36.262550 --- ParallelTerminationStrategy: PID 26896 died... 13:24:36.282221 run iperf3-srv_10.42.42.10(pid=26896): Terminated {rc=256} 13:24:36.328033 --- ParallelTerminationStrategy: PID 26899 died... 13:24:36.347844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26899): Terminated: ok {rc=0} 13:24:36.393970 --- ParallelTerminationStrategy: PID 26902 died... 13:24:36.413715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26902): Terminated: ok {rc=0} 13:24:36.459954 --- ParallelTerminationStrategy: PID 26905 died... 13:24:36.479795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26905): Terminated: ok {rc=0} 13:24:36.567734 bus /gobi_0: Setting Powered False 13:24:37.666233 bus /gobi_0: Setting Powered False 13:24:38.778392 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 13:24:39.928176 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:39.940026 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:24:39.994349 tst iperf3.py: using LAC 41196 13:24:40.122344 tst iperf3.py: using RAC 141 13:24:40.248453 tst iperf3.py: using CellId 41196 13:24:40.375894 tst iperf3.py: using BVCI 41197 13:24:40.493075 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:40.504227 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:40.515159 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:40.526125 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:40.537401 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:40.548536 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:40.559923 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:40.571047 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:40.582559 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:40.698146 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:24:40.901273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:41.203442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26907): Launched 13:24:41.466049 run iperf3-srv_10.42.42.10(pid=26908): Launched 13:24:41.579483 tst iperf3.py:8: start network... 13:24:41.781051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:42.246002 run create_hlr_db(pid=26909): Launched 13:24:42.369462 bus /gobi_6: Setting Powered False 13:24:43.429633 run create_hlr_db(pid=26909): Terminated: ok {rc=0} 13:24:43.869580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26911): Launched 13:24:44.192747 run osmo-hlr_10.42.42.2(pid=26912): Launched 13:24:44.315952 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:44.877251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26914): Launched 13:24:45.201560 run osmo-stp_10.42.42.5(pid=26915): Launched 13:24:45.326055 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:45.889840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26917): Launched 13:24:46.029834 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:46.300780 run patchelf(pid=26918): Launched 13:24:46.486403 run osmo-stp_10.42.42.5(pid=26915): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26915)] 13:24:46.626688 run osmo-stp_10.42.42.5(pid=26915): stdout: | (launched: 2022-12-14_13:24:45.142906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:46.768091 run osmo-stp_10.42.42.5(pid=26915): stderr: | 20221214132445335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132445335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132445335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132445336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132445336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132445336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132445336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:46.909779 run osmo-stp_10.42.42.5(pid=26915): stdout: | (launched: 2022-12-14_13:24:45.142906) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:47.045498 run osmo-stp_10.42.42.5(pid=26915): stderr: | 20221214132445335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132445335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132445335 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132445336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132445336 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132445336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132445336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:47.205844 run patchelf(pid=26918): Terminating (SIGINT) 13:24:47.388387 run patchelf(pid=26918): Terminated: ok {rc=0} 13:24:47.519951 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26915): Process ended prematurely: osmo-stp_10.42.42.5(pid=26915) [trial-2405↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26915)] [trial-2405↪gprs:trx-sysmocell5000↪iperf3.py:8] 13:24:47.530426 tst iperf3.py:8: Test FAILED (7.6 sec) 13:24:47.559124 run osmo-hlr_10.42.42.2(pid=26912): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26912)] 13:24:47.611176 run osmo-hlr_10.42.42.2(pid=26912): stdout: | (launched: 2022-12-14_13:24:44.134617) 13:24:47.664835 run osmo-hlr_10.42.42.2(pid=26912): stderr: | 20221214132444334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132444334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132444334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132444334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132444334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132444334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132444346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132444354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132444354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132444354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:24:47.717248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26907): Terminating (SIGTERM) 13:24:47.760003 run iperf3-srv_10.42.42.10(pid=26908): Terminating (SIGTERM) 13:24:47.802888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26911): Terminating (SIGTERM) 13:24:47.845733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26914): Terminating (SIGTERM) 13:24:47.888634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26917): Terminating (SIGTERM) 13:24:47.932282 --- ParallelTerminationStrategy: PID 26907 died... 13:24:47.953556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26907): Terminated: ok {rc=0} 13:24:48.001519 --- ParallelTerminationStrategy: PID 26908 died... 13:24:48.022223 run iperf3-srv_10.42.42.10(pid=26908): Terminated {rc=256} 13:24:48.069732 --- ParallelTerminationStrategy: PID 26911 died... 13:24:48.090418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26911): Terminated: ok {rc=0} 13:24:48.137884 --- ParallelTerminationStrategy: PID 26914 died... 13:24:48.158639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26914): Terminated: ok {rc=0} 13:24:48.206230 --- ParallelTerminationStrategy: PID 26917 died... 13:24:48.226836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26917): Terminated: ok {rc=0} 13:24:48.316757 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 13:24:49.468457 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:49.480343 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:24:49.532088 tst iperf3m4.py: using LAC 41197 13:24:49.651985 tst iperf3m4.py: using RAC 142 13:24:49.772596 tst iperf3m4.py: using CellId 41197 13:24:49.892385 tst iperf3m4.py: using BVCI 41198 13:24:50.001351 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:50.012273 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:50.023326 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:50.033958 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:50.044413 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:50.055272 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:50.066298 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:50.076496 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:24:50.086932 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:50.208052 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:50.324897 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:50.443661 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:24:50.563768 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:24:50.783471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:51.110399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26919): Launched 13:24:51.392187 run iperf3-srv_10.42.42.10(pid=26920): Launched 13:24:51.514330 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:24:51.733342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:52.059107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26921): Launched 13:24:52.340404 run iperf3-srv_10.42.42.10(pid=26922): Launched 13:24:52.462226 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:24:52.680477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:53.005716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26923): Launched 13:24:53.287332 run iperf3-srv_10.42.42.10(pid=26924): Launched 13:24:53.408574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:24:53.626744 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:24:53.952086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26925): Launched 13:24:54.233674 run iperf3-srv_10.42.42.10(pid=26926): Launched 13:24:54.355076 tst iperf3m4.py:8: start network... 13:24:54.574403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:24:55.075923 run create_hlr_db(pid=26927): Launched 13:24:55.199155 bus /gobi_6: Setting Powered False 13:24:56.263116 run create_hlr_db(pid=26927): Terminated: ok {rc=0} 13:24:56.694369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26929): Launched 13:24:56.997851 run osmo-hlr_10.42.42.2(pid=26930): Launched 13:24:57.114029 run osmo-stp_10.42.42.5: Starting osmo-stp 13:24:57.635582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26932): Launched 13:24:57.937428 run osmo-stp_10.42.42.5(pid=26933): Launched 13:24:58.052136 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:24:58.572127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26935): Launched 13:24:58.687205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:24:58.942332 run patchelf(pid=26936): Launched 13:24:59.110832 run osmo-stp_10.42.42.5(pid=26933): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26933)] 13:24:59.238519 run osmo-stp_10.42.42.5(pid=26933): stdout: | (launched: 2022-12-14_13:24:57.882093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:59.367660 run osmo-stp_10.42.42.5(pid=26933): stderr: | 20221214132458051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132458051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132458052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132458052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132458052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132458053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132458053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:59.496829 run osmo-stp_10.42.42.5(pid=26933): stdout: | (launched: 2022-12-14_13:24:57.882093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:24:59.620474 run osmo-stp_10.42.42.5(pid=26933): stderr: | 20221214132458051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132458051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132458052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132458052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132458052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132458053 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132458053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:24:59.767232 run patchelf(pid=26936): Terminating (SIGINT) 13:24:59.936396 run patchelf(pid=26936): Terminated: ok {rc=0} 13:25:00.058606 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26933): Process ended prematurely: osmo-stp_10.42.42.5(pid=26933) [trial-2405↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26933)] [trial-2405↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 13:25:00.067887 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:25:00.094961 run osmo-hlr_10.42.42.2(pid=26930): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26930)] 13:25:00.142732 run osmo-hlr_10.42.42.2(pid=26930): stdout: | (launched: 2022-12-14_13:24:56.941902) 13:25:00.191795 run osmo-hlr_10.42.42.2(pid=26930): stderr: | 20221214132457118 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132457118 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132457118 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132457118 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132457118 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132457118 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132457133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132457143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132457144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132457144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:00.241481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26919): Terminating (SIGTERM) 13:25:00.280969 run iperf3-srv_10.42.42.10(pid=26920): Terminating (SIGTERM) 13:25:00.320243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26921): Terminating (SIGTERM) 13:25:00.361506 run iperf3-srv_10.42.42.10(pid=26922): Terminating (SIGTERM) 13:25:00.401144 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26923): Terminating (SIGTERM) 13:25:00.440607 run iperf3-srv_10.42.42.10(pid=26924): Terminating (SIGTERM) 13:25:00.479861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26925): Terminating (SIGTERM) 13:25:00.519352 run iperf3-srv_10.42.42.10(pid=26926): Terminating (SIGTERM) 13:25:00.558650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26929): Terminating (SIGTERM) 13:25:00.598121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26932): Terminating (SIGTERM) 13:25:00.637470 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26935): Terminating (SIGTERM) 13:25:00.677263 --- ParallelTerminationStrategy: PID 26919 died... 13:25:00.696454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26919): Terminated: ok {rc=0} 13:25:00.740732 --- ParallelTerminationStrategy: PID 26920 died... 13:25:00.759429 run iperf3-srv_10.42.42.10(pid=26920): Terminated {rc=256} 13:25:00.803068 --- ParallelTerminationStrategy: PID 26921 died... 13:25:00.821688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26921): Terminated: ok {rc=0} 13:25:00.888373 --- ParallelTerminationStrategy: PID 26922 died... 13:25:00.908928 run iperf3-srv_10.42.42.10(pid=26922): Terminated {rc=256} 13:25:00.954481 --- ParallelTerminationStrategy: PID 26923 died... 13:25:00.974085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26923): Terminated: ok {rc=0} 13:25:01.019938 --- ParallelTerminationStrategy: PID 26924 died... 13:25:01.039873 run iperf3-srv_10.42.42.10(pid=26924): Terminated {rc=256} 13:25:01.086437 --- ParallelTerminationStrategy: PID 26925 died... 13:25:01.108485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26925): Terminated: ok {rc=0} 13:25:01.157401 --- ParallelTerminationStrategy: PID 26926 died... 13:25:01.179333 run iperf3-srv_10.42.42.10(pid=26926): Terminated {rc=256} 13:25:01.228118 --- ParallelTerminationStrategy: PID 26929 died... 13:25:01.250050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26929): Terminated: ok {rc=0} 13:25:01.300327 --- ParallelTerminationStrategy: PID 26932 died... 13:25:01.322435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26932): Terminated: ok {rc=0} 13:25:01.371542 --- ParallelTerminationStrategy: PID 26935 died... 13:25:01.393333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26935): Terminated: ok {rc=0} 13:25:01.488027 bus /gobi_4: Setting Powered False 13:25:02.602663 bus /gobi_4: Setting Powered False 13:25:03.719908 bus /gobi_1: Setting Powered False 13:25:04.817760 bus /gobi_1: Setting Powered False 13:25:05.933987 bus /gobi_0: Setting Powered False 13:25:07.032813 bus /gobi_0: Setting Powered False 13:25:08.149814 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 13:25:09.253866 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:09.265926 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:25:09.315833 tst ping.py: using LAC 41198 13:25:09.433219 tst ping.py: using RAC 143 13:25:09.548262 tst ping.py: using CellId 41198 13:25:09.665120 tst ping.py: using BVCI 41199 13:25:09.774433 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:09.785243 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:09.796006 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:09.806687 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:09.817286 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:09.828112 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:09.839108 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:09.849991 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:25:09.968875 tst ping.py:19: start network... 13:25:10.183934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:10.677689 run create_hlr_db(pid=26940): Launched 13:25:10.807278 bus /gobi_6: Setting Powered False 13:25:11.869710 run create_hlr_db(pid=26940): Terminated: ok {rc=0} 13:25:12.293308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26942): Launched 13:25:12.589040 run osmo-hlr_10.42.42.2(pid=26943): Launched 13:25:12.701664 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:13.253832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26945): Launched 13:25:13.571612 run osmo-stp_10.42.42.5(pid=26946): Launched 13:25:13.693867 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:14.242836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26948): Launched 13:25:14.365450 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:14.634347 run patchelf(pid=26949): Launched 13:25:14.811508 run osmo-stp_10.42.42.5(pid=26946): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26946)] 13:25:14.946826 run osmo-stp_10.42.42.5(pid=26946): stdout: | (launched: 2022-12-14_13:25:13.513598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:15.083871 run osmo-stp_10.42.42.5(pid=26946): stderr: | 20221214132513707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132513707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132513708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132513708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132513709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132513709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132513709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:15.220815 run osmo-stp_10.42.42.5(pid=26946): stdout: | (launched: 2022-12-14_13:25:13.513598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:15.351845 run osmo-stp_10.42.42.5(pid=26946): stderr: | 20221214132513707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132513707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132513708 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132513708 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132513709 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132513709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132513709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:15.507466 run patchelf(pid=26949): Terminating (SIGINT) 13:25:15.685615 run patchelf(pid=26949): Terminated: ok {rc=0} 13:25:15.813876 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=26946): Process ended prematurely: osmo-stp_10.42.42.5(pid=26946) [trial-2405↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26946)] [trial-2405↪gprs:trx-sysmocell5000↪ping.py:22] 13:25:15.823204 tst ping.py:22: Test FAILED (6.6 sec) 13:25:15.863649 run osmo-hlr_10.42.42.2(pid=26943): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26943)] 13:25:15.913778 run osmo-hlr_10.42.42.2(pid=26943): stdout: | (launched: 2022-12-14_13:25:12.534617) 13:25:15.965930 run osmo-hlr_10.42.42.2(pid=26943): stderr: | 20221214132512710 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132512710 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132512710 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132512710 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132512710 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132512710 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132512722 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132512731 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132512731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132512731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:16.018220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26942): Terminating (SIGTERM) 13:25:16.062006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26945): Terminating (SIGTERM) 13:25:16.106571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26948): Terminating (SIGTERM) 13:25:16.151505 --- ParallelTerminationStrategy: PID 26942 died... 13:25:16.172739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26942): Terminated: ok {rc=0} 13:25:16.221364 --- ParallelTerminationStrategy: PID 26945 died... 13:25:16.242080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26945): Terminated: ok {rc=0} 13:25:16.290054 --- ParallelTerminationStrategy: PID 26948 died... 13:25:16.310893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26948): Terminated: ok {rc=0} 13:25:16.399892 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 13:25:17.486654 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:17.498472 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 13:25:17.549431 tst ping_idle_ping.py: using LAC 41199 13:25:17.668231 tst ping_idle_ping.py: using RAC 144 13:25:17.787137 tst ping_idle_ping.py: using CellId 41199 13:25:17.906781 tst ping_idle_ping.py: using BVCI 41200 13:25:18.015870 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:18.026839 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:18.037603 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:18.048232 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:18.058755 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:18.070576 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:18.082050 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 13:25:18.093304 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 13:25:18.212810 tst ping_idle_ping.py:24: start network... 13:25:18.427713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:18.924093 run create_hlr_db(pid=26950): Launched 13:25:19.047047 bus /gobi_6: Setting Powered False 13:25:20.110542 run create_hlr_db(pid=26950): Terminated: ok {rc=0} 13:25:20.537184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26952): Launched 13:25:20.835273 run osmo-hlr_10.42.42.2(pid=26953): Launched 13:25:20.948197 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:21.474958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26955): Launched 13:25:21.770976 run osmo-stp_10.42.42.5(pid=26956): Launched 13:25:21.885617 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:22.397797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26958): Launched 13:25:22.510716 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:22.760608 run patchelf(pid=26959): Launched 13:25:22.925232 run osmo-stp_10.42.42.5(pid=26956): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26956)] 13:25:23.050510 run osmo-stp_10.42.42.5(pid=26956): stdout: | (launched: 2022-12-14_13:25:21.716220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:23.176913 run osmo-stp_10.42.42.5(pid=26956): stderr: | 20221214132521888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132521888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132521888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132521889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132521889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132521889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132521889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:23.304482 run osmo-stp_10.42.42.5(pid=26956): stdout: | (launched: 2022-12-14_13:25:21.716220) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:23.425887 run osmo-stp_10.42.42.5(pid=26956): stderr: | 20221214132521888 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132521888 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132521888 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132521889 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132521889 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132521889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132521889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:23.569765 run patchelf(pid=26959): Terminating (SIGINT) 13:25:23.735203 run patchelf(pid=26959): Terminated: ok {rc=0} 13:25:23.854925 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=26956): Process ended prematurely: osmo-stp_10.42.42.5(pid=26956) [trial-2405↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26956)] [trial-2405↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 13:25:23.863614 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:25:23.890114 run osmo-hlr_10.42.42.2(pid=26953): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26953)] 13:25:23.937458 run osmo-hlr_10.42.42.2(pid=26953): stdout: | (launched: 2022-12-14_13:25:20.780236) 13:25:23.986572 run osmo-hlr_10.42.42.2(pid=26953): stderr: | 20221214132520954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132520955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132520955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132520955 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132520955 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132520955 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132520967 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132520978 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132520978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132520978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:24.036225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26952): Terminating (SIGTERM) 13:25:24.076147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26955): Terminating (SIGTERM) 13:25:24.116077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26958): Terminating (SIGTERM) 13:25:24.156260 --- ParallelTerminationStrategy: PID 26952 died... 13:25:24.175538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26952): Terminated: ok {rc=0} 13:25:24.219547 --- ParallelTerminationStrategy: PID 26955 died... 13:25:24.238380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26955): Terminated: ok {rc=0} 13:25:24.282462 --- ParallelTerminationStrategy: PID 26958 died... 13:25:24.301291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26958): Terminated: ok {rc=0} 13:25:24.384096 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 13:25:25.695845 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:25:25.702134 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:25:25.735195 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:25:25.773282 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:25:25.858669 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:25:25.891580 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:25:25.929090 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:25:26.522768 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:25:26.571933 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:26.583076 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:25:26.633010 tst cs_paging_gprs_active.py: using LAC 41200 13:25:26.752140 tst cs_paging_gprs_active.py: using RAC 145 13:25:26.870716 tst cs_paging_gprs_active.py: using CellId 41200 13:25:26.994580 tst cs_paging_gprs_active.py: using BVCI 41201 13:25:27.105194 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.116096 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.126770 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.137328 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.147713 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.158825 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.169948 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.181178 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:27.192410 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:27.312226 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:27.427867 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:25:27.630840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:27.933577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26963): Launched 13:25:28.195746 run iperf3-srv_10.42.42.10(pid=26964): Launched 13:25:28.308360 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:25:28.510179 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:28.812376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26965): Launched 13:25:29.074369 run iperf3-srv_10.42.42.10(pid=26966): Launched 13:25:29.186512 tst cs_paging_gprs_active.py:38: start network... 13:25:29.388521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:29.854229 run create_hlr_db(pid=26967): Launched 13:25:29.976000 bus /gobi_6: Setting Powered False 13:25:31.056028 run create_hlr_db(pid=26967): Terminated: ok {rc=0} 13:25:31.566095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26969): Launched 13:25:31.909588 run osmo-hlr_10.42.42.2(pid=26970): Launched 13:25:32.142850 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:32.704872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26972): Launched 13:25:33.029129 run osmo-stp_10.42.42.5(pid=26973): Launched 13:25:33.153589 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:33.713349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26975): Launched 13:25:33.837393 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:34.111962 run patchelf(pid=26976): Launched 13:25:34.291724 run osmo-stp_10.42.42.5(pid=26973): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26973)] 13:25:34.429451 run osmo-stp_10.42.42.5(pid=26973): stdout: | (launched: 2022-12-14_13:25:32.970175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:34.567927 run osmo-stp_10.42.42.5(pid=26973): stderr: | 20221214132533163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132533163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132533163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132533163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132533164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132533164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132533164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:34.707268 run osmo-stp_10.42.42.5(pid=26973): stdout: | (launched: 2022-12-14_13:25:32.970175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:34.840368 run osmo-stp_10.42.42.5(pid=26973): stderr: | 20221214132533163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132533163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132533163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132533163 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132533164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132533164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132533164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:34.999154 run patchelf(pid=26976): Terminating (SIGINT) 13:25:35.180630 run patchelf(pid=26976): Terminated: ok {rc=0} 13:25:35.312125 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=26973): Process ended prematurely: osmo-stp_10.42.42.5(pid=26973) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26973)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:25:35.322530 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 13:25:35.350950 run osmo-hlr_10.42.42.2(pid=26970): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26970)] 13:25:35.401886 run osmo-hlr_10.42.42.2(pid=26970): stdout: | (launched: 2022-12-14_13:25:31.844092) 13:25:35.454386 run osmo-hlr_10.42.42.2(pid=26970): stderr: | 20221214132532159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132532159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132532159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132532159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132532159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132532159 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132532187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132532203 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132532203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132532203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:35.506634 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26963): Terminating (SIGTERM) 13:25:35.548996 run iperf3-srv_10.42.42.10(pid=26964): Terminating (SIGTERM) 13:25:35.591518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26965): Terminating (SIGTERM) 13:25:35.634194 run iperf3-srv_10.42.42.10(pid=26966): Terminating (SIGTERM) 13:25:35.676524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26969): Terminating (SIGTERM) 13:25:35.719160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26972): Terminating (SIGTERM) 13:25:35.761553 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26975): Terminating (SIGTERM) 13:25:35.804219 --- ParallelTerminationStrategy: PID 26963 died... 13:25:35.824818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26963): Terminated: ok {rc=0} 13:25:35.871909 --- ParallelTerminationStrategy: PID 26964 died... 13:25:35.891755 run iperf3-srv_10.42.42.10(pid=26964): Terminated {rc=256} 13:25:35.938793 --- ParallelTerminationStrategy: PID 26965 died... 13:25:35.958605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26965): Terminated: ok {rc=0} 13:25:36.005044 --- ParallelTerminationStrategy: PID 26966 died... 13:25:36.024803 run iperf3-srv_10.42.42.10(pid=26966): Terminated {rc=256} 13:25:36.070986 --- ParallelTerminationStrategy: PID 26969 died... 13:25:36.090798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26969): Terminated: ok {rc=0} 13:25:36.136928 --- ParallelTerminationStrategy: PID 26972 died... 13:25:36.156692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26972): Terminated: ok {rc=0} 13:25:36.202862 --- ParallelTerminationStrategy: PID 26975 died... 13:25:36.222640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26975): Terminated: ok {rc=0} 13:25:36.310565 bus /gobi_0: Setting Powered False 13:25:37.409187 bus /gobi_0: Setting Powered False 13:25:38.527183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:25:39.673462 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:39.685065 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:25:39.739740 tst iperf3.py: using LAC 41201 13:25:39.859745 tst iperf3.py: using RAC 146 13:25:39.991391 tst iperf3.py: using CellId 41201 13:25:40.117357 tst iperf3.py: using BVCI 41202 13:25:40.234344 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:40.245986 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:40.257130 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:40.269283 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:40.280573 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:40.292003 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:40.303517 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:40.314905 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:40.326581 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:40.446593 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:25:40.664601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:40.987101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26977): Launched 13:25:41.266051 run iperf3-srv_10.42.42.10(pid=26978): Launched 13:25:41.386977 tst iperf3.py:8: start network... 13:25:41.604073 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:42.103317 run create_hlr_db(pid=26979): Launched 13:25:42.225501 bus /gobi_6: Setting Powered False 13:25:43.289073 run create_hlr_db(pid=26979): Terminated: ok {rc=0} 13:25:43.720221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26981): Launched 13:25:44.021476 run osmo-hlr_10.42.42.2(pid=26982): Launched 13:25:44.136102 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:44.660354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26984): Launched 13:25:44.960025 run osmo-stp_10.42.42.5(pid=26985): Launched 13:25:45.074564 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:45.594128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26987): Launched 13:25:45.709153 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:46.001736 run patchelf(pid=26988): Launched 13:25:46.191236 run osmo-stp_10.42.42.5(pid=26985): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26985)] 13:25:46.320416 run osmo-stp_10.42.42.5(pid=26985): stdout: | (launched: 2022-12-14_13:25:44.905320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:46.454757 run osmo-stp_10.42.42.5(pid=26985): stderr: | 20221214132545077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132545077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132545077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132545078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132545078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132545078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132545078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:46.586922 run osmo-stp_10.42.42.5(pid=26985): stdout: | (launched: 2022-12-14_13:25:44.905320) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:46.713141 run osmo-stp_10.42.42.5(pid=26985): stderr: | 20221214132545077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132545077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132545077 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132545078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132545078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132545078 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132545078 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:46.863009 run patchelf(pid=26988): Terminating (SIGINT) 13:25:47.035671 run patchelf(pid=26988): Terminated: ok {rc=0} 13:25:47.161679 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=26985): Process ended prematurely: osmo-stp_10.42.42.5(pid=26985) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26985)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 13:25:47.173636 tst iperf3.py:8: Test FAILED (7.5 sec) 13:25:47.208297 run osmo-hlr_10.42.42.2(pid=26982): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=26982)] 13:25:47.263229 run osmo-hlr_10.42.42.2(pid=26982): stdout: | (launched: 2022-12-14_13:25:43.966794) 13:25:47.316423 run osmo-hlr_10.42.42.2(pid=26982): stderr: | 20221214132544142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132544142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132544142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132544142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132544142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132544142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132544154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132544163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132544163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132544163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:47.370430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26977): Terminating (SIGTERM) 13:25:47.412871 run iperf3-srv_10.42.42.10(pid=26978): Terminating (SIGTERM) 13:25:47.455445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26981): Terminating (SIGTERM) 13:25:47.498486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26984): Terminating (SIGTERM) 13:25:47.541395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26987): Terminating (SIGTERM) 13:25:47.584454 --- ParallelTerminationStrategy: PID 26977 died... 13:25:47.605175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26977): Terminated: ok {rc=0} 13:25:47.652291 --- ParallelTerminationStrategy: PID 26978 died... 13:25:47.672466 run iperf3-srv_10.42.42.10(pid=26978): Terminated {rc=256} 13:25:47.719385 --- ParallelTerminationStrategy: PID 26981 died... 13:25:47.739694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=26981): Terminated: ok {rc=0} 13:25:47.786517 --- ParallelTerminationStrategy: PID 26984 died... 13:25:47.806846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=26984): Terminated: ok {rc=0} 13:25:47.853726 --- ParallelTerminationStrategy: PID 26987 died... 13:25:47.873905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=26987): Terminated: ok {rc=0} 13:25:47.963049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:25:49.106209 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:49.117812 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:25:49.169355 tst iperf3m4.py: using LAC 41202 13:25:49.297462 tst iperf3m4.py: using RAC 147 13:25:49.420598 tst iperf3m4.py: using CellId 41202 13:25:49.541847 tst iperf3m4.py: using BVCI 41203 13:25:49.650682 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:49.661645 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:49.672490 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:49.683476 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:49.694068 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:49.704664 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:49.716035 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:49.726893 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:25:49.737873 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:49.852862 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:49.975343 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:50.094809 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:25:50.210211 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:25:50.413273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:50.715812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26989): Launched 13:25:50.979112 run iperf3-srv_10.42.42.10(pid=26990): Launched 13:25:51.092215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:25:51.295021 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:51.599608 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26991): Launched 13:25:51.864009 run iperf3-srv_10.42.42.10(pid=26992): Launched 13:25:51.977173 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:25:52.180055 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:52.482285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26995): Launched 13:25:52.745654 run iperf3-srv_10.42.42.10(pid=26996): Launched 13:25:52.858510 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:25:53.060084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:25:53.362672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26997): Launched 13:25:53.626013 run iperf3-srv_10.42.42.10(pid=26998): Launched 13:25:53.738629 tst iperf3m4.py:8: start network... 13:25:53.940505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:25:54.407202 run create_hlr_db(pid=26999): Launched 13:25:54.529498 bus /gobi_6: Setting Powered False 13:25:55.590055 run create_hlr_db(pid=26999): Terminated: ok {rc=0} 13:25:56.034344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27001): Launched 13:25:56.359612 run osmo-hlr_10.42.42.2(pid=27002): Launched 13:25:56.484263 run osmo-stp_10.42.42.5: Starting osmo-stp 13:25:57.046404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27004): Launched 13:25:57.370199 run osmo-stp_10.42.42.5(pid=27005): Launched 13:25:57.494024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:25:58.052767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27007): Launched 13:25:58.176671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:25:58.449438 run patchelf(pid=27008): Launched 13:25:58.629587 run osmo-stp_10.42.42.5(pid=27005): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27005)] 13:25:58.766259 run osmo-stp_10.42.42.5(pid=27005): stdout: | (launched: 2022-12-14_13:25:57.311237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:58.904506 run osmo-stp_10.42.42.5(pid=27005): stderr: | 20221214132557504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132557504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132557504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132557505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132557505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132557505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132557505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:59.043741 run osmo-stp_10.42.42.5(pid=27005): stdout: | (launched: 2022-12-14_13:25:57.311237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:25:59.176415 run osmo-stp_10.42.42.5(pid=27005): stderr: | 20221214132557504 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132557504 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132557504 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132557505 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132557505 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132557505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132557505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:25:59.333993 run patchelf(pid=27008): Terminating (SIGINT) 13:25:59.515810 run patchelf(pid=27008): Terminated: ok {rc=0} 13:25:59.646626 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27005): Process ended prematurely: osmo-stp_10.42.42.5(pid=27005) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27005)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 13:25:59.656580 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:25:59.685352 run osmo-hlr_10.42.42.2(pid=27002): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27002)] 13:25:59.736229 run osmo-hlr_10.42.42.2(pid=27002): stdout: | (launched: 2022-12-14_13:25:56.300594) 13:25:59.788531 run osmo-hlr_10.42.42.2(pid=27002): stderr: | 20221214132556499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132556499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132556499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132556499 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132556499 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132556499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132556516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132556525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132556525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132556525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:25:59.841651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26989): Terminating (SIGTERM) 13:25:59.883291 run iperf3-srv_10.42.42.10(pid=26990): Terminating (SIGTERM) 13:25:59.927074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26991): Terminating (SIGTERM) 13:25:59.970024 run iperf3-srv_10.42.42.10(pid=26992): Terminating (SIGTERM) 13:26:00.012561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26995): Terminating (SIGTERM) 13:26:00.054640 run iperf3-srv_10.42.42.10(pid=26996): Terminating (SIGTERM) 13:26:00.096548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26997): Terminating (SIGTERM) 13:26:00.139050 run iperf3-srv_10.42.42.10(pid=26998): Terminating (SIGTERM) 13:26:00.181543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27001): Terminating (SIGTERM) 13:26:00.223556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27004): Terminating (SIGTERM) 13:26:00.266117 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27007): Terminating (SIGTERM) 13:26:00.308440 --- ParallelTerminationStrategy: PID 26989 died... 13:26:00.328835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26989): Terminated: ok {rc=0} 13:26:00.375830 --- ParallelTerminationStrategy: PID 26990 died... 13:26:00.395611 run iperf3-srv_10.42.42.10(pid=26990): Terminated {rc=256} 13:26:00.441860 --- ParallelTerminationStrategy: PID 26991 died... 13:26:00.461776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26991): Terminated: ok {rc=0} 13:26:00.508081 --- ParallelTerminationStrategy: PID 26992 died... 13:26:00.527860 run iperf3-srv_10.42.42.10(pid=26992): Terminated {rc=256} 13:26:00.574163 --- ParallelTerminationStrategy: PID 26995 died... 13:26:00.593641 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26995): Terminated: ok {rc=0} 13:26:00.640179 --- ParallelTerminationStrategy: PID 26996 died... 13:26:00.660027 run iperf3-srv_10.42.42.10(pid=26996): Terminated {rc=256} 13:26:00.706154 --- ParallelTerminationStrategy: PID 26997 died... 13:26:00.725975 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=26997): Terminated: ok {rc=0} 13:26:00.772402 --- ParallelTerminationStrategy: PID 26998 died... 13:26:00.792239 run iperf3-srv_10.42.42.10(pid=26998): Terminated {rc=256} 13:26:00.850267 --- ParallelTerminationStrategy: PID 27001 died... 13:26:00.871313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27001): Terminated: ok {rc=0} 13:26:00.937137 --- ParallelTerminationStrategy: PID 27004 died... 13:26:00.957756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27004): Terminated: ok {rc=0} 13:26:01.005397 --- ParallelTerminationStrategy: PID 27007 died... 13:26:01.026043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27007): Terminated: ok {rc=0} 13:26:01.121914 bus /gobi_4: Setting Powered False 13:26:02.232278 bus /gobi_4: Setting Powered False 13:26:03.347403 bus /gobi_1: Setting Powered False 13:26:04.442578 bus /gobi_1: Setting Powered False 13:26:05.558234 bus /gobi_0: Setting Powered False 13:26:06.656617 bus /gobi_0: Setting Powered False 13:26:07.773182 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 13:26:08.876902 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:08.888911 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:26:08.945441 tst ping.py: using LAC 41203 13:26:09.061637 tst ping.py: using RAC 148 13:26:09.176392 tst ping.py: using CellId 41203 13:26:09.293601 tst ping.py: using BVCI 41204 13:26:09.400159 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:09.411234 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:09.422250 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:09.432878 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:09.443416 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:09.453985 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:09.465236 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:09.476015 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:26:09.595380 tst ping.py:19: start network... 13:26:09.809503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:10.301600 run create_hlr_db(pid=27010): Launched 13:26:10.423099 bus /gobi_6: Setting Powered False 13:26:11.486034 run create_hlr_db(pid=27010): Terminated: ok {rc=0} 13:26:11.911003 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27012): Launched 13:26:12.209911 run osmo-hlr_10.42.42.2(pid=27013): Launched 13:26:12.322740 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:12.835915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27015): Launched 13:26:13.133289 run osmo-stp_10.42.42.5(pid=27016): Launched 13:26:13.246348 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:13.757690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27018): Launched 13:26:13.870356 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:14.120542 run patchelf(pid=27019): Launched 13:26:14.284811 run osmo-stp_10.42.42.5(pid=27016): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27016)] 13:26:14.410037 run osmo-stp_10.42.42.5(pid=27016): stdout: | (launched: 2022-12-14_13:26:13.078772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:14.536814 run osmo-stp_10.42.42.5(pid=27016): stderr: | 20221214132613249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132613250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132613250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132613250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132613251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132613251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132613251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:14.663940 run osmo-stp_10.42.42.5(pid=27016): stdout: | (launched: 2022-12-14_13:26:13.078772) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:14.785627 run osmo-stp_10.42.42.5(pid=27016): stderr: | 20221214132613249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132613250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132613250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132613250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132613251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132613251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132613251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:14.929574 run patchelf(pid=27019): Terminating (SIGINT) 13:26:15.095816 run patchelf(pid=27019): Terminated: ok {rc=0} 13:26:15.215664 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27016): Process ended prematurely: osmo-stp_10.42.42.5(pid=27016) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27016)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 13:26:15.224623 tst ping.py:22: Test FAILED (6.3 sec) 13:26:15.251461 run osmo-hlr_10.42.42.2(pid=27013): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27013)] 13:26:15.300007 run osmo-hlr_10.42.42.2(pid=27013): stdout: | (launched: 2022-12-14_13:26:12.155085) 13:26:15.349803 run osmo-hlr_10.42.42.2(pid=27013): stderr: | 20221214132612332 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132612332 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132612332 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132612332 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132612332 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132612332 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132612345 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132612355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132612355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132612355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:15.399863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27012): Terminating (SIGTERM) 13:26:15.440032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27015): Terminating (SIGTERM) 13:26:15.480015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27018): Terminating (SIGTERM) 13:26:15.520236 --- ParallelTerminationStrategy: PID 27012 died... 13:26:15.539572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27012): Terminated: ok {rc=0} 13:26:15.583873 --- ParallelTerminationStrategy: PID 27015 died... 13:26:15.603230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27015): Terminated: ok {rc=0} 13:26:15.647711 --- ParallelTerminationStrategy: PID 27018 died... 13:26:15.666704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27018): Terminated: ok {rc=0} 13:26:15.750236 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:26:16.837194 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:16.851529 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:26:16.902808 tst ping_idle_ping.py: using LAC 41204 13:26:17.038644 tst ping_idle_ping.py: using RAC 149 13:26:17.170273 tst ping_idle_ping.py: using CellId 41204 13:26:17.299048 tst ping_idle_ping.py: using BVCI 41205 13:26:17.406111 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:17.417158 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:17.428006 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:17.438760 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:17.449489 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:17.460145 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:17.470981 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:26:17.481577 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:26:17.595199 tst ping_idle_ping.py:24: start network... 13:26:17.794399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:18.257407 run create_hlr_db(pid=27020): Launched 13:26:18.380485 bus /gobi_6: Setting Powered False 13:26:19.440204 run create_hlr_db(pid=27020): Terminated: ok {rc=0} 13:26:19.876212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27022): Launched 13:26:20.195341 run osmo-hlr_10.42.42.2(pid=27023): Launched 13:26:20.318296 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:20.868058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27025): Launched 13:26:21.187072 run osmo-stp_10.42.42.5(pid=27026): Launched 13:26:21.308518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:21.860326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27028): Launched 13:26:22.010289 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:22.280137 run patchelf(pid=27029): Launched 13:26:22.458292 run osmo-stp_10.42.42.5(pid=27026): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27026)] 13:26:22.593709 run osmo-stp_10.42.42.5(pid=27026): stdout: | (launched: 2022-12-14_13:26:21.128760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:22.730860 run osmo-stp_10.42.42.5(pid=27026): stderr: | 20221214132621320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132621320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132621320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132621321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132621323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132621323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132621323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:22.867833 run osmo-stp_10.42.42.5(pid=27026): stdout: | (launched: 2022-12-14_13:26:21.128760) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:23.000104 run osmo-stp_10.42.42.5(pid=27026): stderr: | 20221214132621320 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132621320 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132621320 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132621321 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132621323 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132621323 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132621323 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:23.156059 run patchelf(pid=27029): Terminating (SIGINT) 13:26:23.334790 run patchelf(pid=27029): Terminated: ok {rc=0} 13:26:23.463027 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27026): Process ended prematurely: osmo-stp_10.42.42.5(pid=27026) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27026)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 13:26:23.472327 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:26:23.500054 run osmo-hlr_10.42.42.2(pid=27023): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27023)] 13:26:23.550505 run osmo-hlr_10.42.42.2(pid=27023): stdout: | (launched: 2022-12-14_13:26:20.137385) 13:26:23.602512 run osmo-hlr_10.42.42.2(pid=27023): stderr: | 20221214132620333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132620333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132620333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132620333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132620333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132620333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132620346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132620354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132620354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132620354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:23.654656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27022): Terminating (SIGTERM) 13:26:23.696908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27025): Terminating (SIGTERM) 13:26:23.739317 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27028): Terminating (SIGTERM) 13:26:23.781738 --- ParallelTerminationStrategy: PID 27022 died... 13:26:23.802181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27022): Terminated: ok {rc=0} 13:26:23.848619 --- ParallelTerminationStrategy: PID 27025 died... 13:26:23.868804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27025): Terminated: ok {rc=0} 13:26:23.915521 --- ParallelTerminationStrategy: PID 27028 died... 13:26:23.935795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27028): Terminated: ok {rc=0} 13:26:24.024388 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:26:25.339178 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:26:25.345813 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:26:25.380541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:26:25.420674 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:26:25.509556 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:26:25.543325 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:26:25.582314 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:26:26.179365 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:26:26.232221 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:26.243663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:26:26.314880 tst cs_paging_gprs_active.py: using LAC 41205 13:26:26.443023 tst cs_paging_gprs_active.py: using RAC 150 13:26:26.570665 tst cs_paging_gprs_active.py: using CellId 41205 13:26:26.722655 tst cs_paging_gprs_active.py: using BVCI 41206 13:26:26.832935 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:26.844051 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:26.854954 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:26.865897 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:26.877290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:26.888156 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:26.899315 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:26.910127 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:26.921257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:27.041864 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:27.159289 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:26:27.362044 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:27.666912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27033): Launched 13:26:27.929944 run iperf3-srv_10.42.42.10(pid=27034): Launched 13:26:28.042495 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:26:28.243893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:28.546425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27035): Launched 13:26:28.807990 run iperf3-srv_10.42.42.10(pid=27036): Launched 13:26:28.920859 tst cs_paging_gprs_active.py:38: start network... 13:26:29.123164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:29.590416 run create_hlr_db(pid=27037): Launched 13:26:29.714273 bus /gobi_6: Setting Powered False 13:26:30.774478 run create_hlr_db(pid=27037): Terminated: ok {rc=0} 13:26:31.256606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27039): Launched 13:26:31.605157 run osmo-hlr_10.42.42.2(pid=27040): Launched 13:26:31.861116 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:32.520838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27042): Launched 13:26:32.845679 run osmo-stp_10.42.42.5(pid=27043): Launched 13:26:32.970424 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:33.529790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27045): Launched 13:26:33.653844 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:33.928042 run patchelf(pid=27046): Launched 13:26:34.108627 run osmo-stp_10.42.42.5(pid=27043): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27043)] 13:26:34.245859 run osmo-stp_10.42.42.5(pid=27043): stdout: | (launched: 2022-12-14_13:26:32.786901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:34.385181 run osmo-stp_10.42.42.5(pid=27043): stderr: | 20221214132632979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132632979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132632979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132632980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132632980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132632980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132632980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:34.523932 run osmo-stp_10.42.42.5(pid=27043): stdout: | (launched: 2022-12-14_13:26:32.786901) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:34.656723 run osmo-stp_10.42.42.5(pid=27043): stderr: | 20221214132632979 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132632979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132632979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132632980 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132632980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132632980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132632980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:34.813919 run patchelf(pid=27046): Terminating (SIGINT) 13:26:34.994895 run patchelf(pid=27046): Terminated: ok {rc=0} 13:26:35.126142 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27043): Process ended prematurely: osmo-stp_10.42.42.5(pid=27043) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27043)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:26:35.136189 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:26:35.164437 run osmo-hlr_10.42.42.2(pid=27040): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27040)] 13:26:35.215263 run osmo-hlr_10.42.42.2(pid=27040): stdout: | (launched: 2022-12-14_13:26:31.542113) 13:26:35.267052 run osmo-hlr_10.42.42.2(pid=27040): stderr: | 20221214132631852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132631852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132631852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132631852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132631852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132631852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132631875 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132631891 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132631892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132631892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:35.319155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27033): Terminating (SIGTERM) 13:26:35.361162 run iperf3-srv_10.42.42.10(pid=27034): Terminating (SIGTERM) 13:26:35.403371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27035): Terminating (SIGTERM) 13:26:35.445453 run iperf3-srv_10.42.42.10(pid=27036): Terminating (SIGTERM) 13:26:35.487598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27039): Terminating (SIGTERM) 13:26:35.529788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27042): Terminating (SIGTERM) 13:26:35.571982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27045): Terminating (SIGTERM) 13:26:35.614549 --- ParallelTerminationStrategy: PID 27033 died... 13:26:35.635012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27033): Terminated: ok {rc=0} 13:26:35.681540 --- ParallelTerminationStrategy: PID 27034 died... 13:26:35.701403 run iperf3-srv_10.42.42.10(pid=27034): Terminated {rc=256} 13:26:35.747656 --- ParallelTerminationStrategy: PID 27035 died... 13:26:35.767632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27035): Terminated: ok {rc=0} 13:26:35.814145 --- ParallelTerminationStrategy: PID 27036 died... 13:26:35.834137 run iperf3-srv_10.42.42.10(pid=27036): Terminated {rc=256} 13:26:35.880367 --- ParallelTerminationStrategy: PID 27039 died... 13:26:35.900331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27039): Terminated: ok {rc=0} 13:26:35.946699 --- ParallelTerminationStrategy: PID 27042 died... 13:26:35.967068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27042): Terminated: ok {rc=0} 13:26:36.013408 --- ParallelTerminationStrategy: PID 27045 died... 13:26:36.033408 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27045): Terminated: ok {rc=0} 13:26:36.121996 bus /gobi_0: Setting Powered False 13:26:37.220063 bus /gobi_0: Setting Powered False 13:26:38.335276 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:26:39.485058 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:39.497164 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:26:39.572097 tst iperf3.py: using LAC 41206 13:26:39.697660 tst iperf3.py: using RAC 151 13:26:39.819124 tst iperf3.py: using CellId 41206 13:26:39.940390 tst iperf3.py: using BVCI 41207 13:26:40.050359 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:40.061546 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:40.072461 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:40.083390 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:40.094958 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:40.106627 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:40.118267 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:40.129736 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:40.141298 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:40.260140 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:26:40.479155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:40.803468 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27047): Launched 13:26:41.085552 run iperf3-srv_10.42.42.10(pid=27048): Launched 13:26:41.206653 tst iperf3.py:8: start network... 13:26:41.424764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:41.925225 run create_hlr_db(pid=27049): Launched 13:26:42.049388 bus /gobi_6: Setting Powered False 13:26:43.113303 run create_hlr_db(pid=27049): Terminated: ok {rc=0} 13:26:43.564280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27051): Launched 13:26:43.887818 run osmo-hlr_10.42.42.2(pid=27052): Launched 13:26:44.011828 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:44.569545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27054): Launched 13:26:44.892593 run osmo-stp_10.42.42.5(pid=27055): Launched 13:26:45.016439 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:45.572899 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27057): Launched 13:26:45.695979 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:45.981798 run patchelf(pid=27058): Launched 13:26:46.168151 run osmo-stp_10.42.42.5(pid=27055): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27055)] 13:26:46.308730 run osmo-stp_10.42.42.5(pid=27055): stdout: | (launched: 2022-12-14_13:26:44.834202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:46.451341 run osmo-stp_10.42.42.5(pid=27055): stderr: | 20221214132645026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132645026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132645026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132645027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132645027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132645027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132645027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:46.594327 run osmo-stp_10.42.42.5(pid=27055): stdout: | (launched: 2022-12-14_13:26:44.834202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:46.731025 run osmo-stp_10.42.42.5(pid=27055): stderr: | 20221214132645026 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132645026 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132645026 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132645027 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132645027 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132645027 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132645027 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:46.890644 run patchelf(pid=27058): Terminating (SIGINT) 13:26:47.065888 run patchelf(pid=27058): Terminated: ok {rc=0} 13:26:47.201089 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27055): Process ended prematurely: osmo-stp_10.42.42.5(pid=27055) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27055)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 13:26:47.211581 tst iperf3.py:8: Test FAILED (7.8 sec) 13:26:47.240464 run osmo-hlr_10.42.42.2(pid=27052): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27052)] 13:26:47.291693 run osmo-hlr_10.42.42.2(pid=27052): stdout: | (launched: 2022-12-14_13:26:43.829134) 13:26:47.344796 run osmo-hlr_10.42.42.2(pid=27052): stderr: | 20221214132644024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132644024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132644024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132644024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132644024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132644024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132644037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132644046 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132644046 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132644046 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:47.397914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27047): Terminating (SIGTERM) 13:26:47.440533 run iperf3-srv_10.42.42.10(pid=27048): Terminating (SIGTERM) 13:26:47.482797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27051): Terminating (SIGTERM) 13:26:47.525106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27054): Terminating (SIGTERM) 13:26:47.567324 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27057): Terminating (SIGTERM) 13:26:47.609867 --- ParallelTerminationStrategy: PID 27047 died... 13:26:47.630412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27047): Terminated: ok {rc=0} 13:26:47.677367 --- ParallelTerminationStrategy: PID 27048 died... 13:26:47.697387 run iperf3-srv_10.42.42.10(pid=27048): Terminated {rc=256} 13:26:47.744342 --- ParallelTerminationStrategy: PID 27051 died... 13:26:47.764504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27051): Terminated: ok {rc=0} 13:26:47.811160 --- ParallelTerminationStrategy: PID 27054 died... 13:26:47.831250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27054): Terminated: ok {rc=0} 13:26:47.878422 --- ParallelTerminationStrategy: PID 27057 died... 13:26:47.898489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27057): Terminated: ok {rc=0} 13:26:47.987295 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:26:49.136895 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:49.149131 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:26:49.222507 tst iperf3m4.py: using LAC 41207 13:26:49.349565 tst iperf3m4.py: using RAC 152 13:26:49.476689 tst iperf3m4.py: using CellId 41207 13:26:49.604112 tst iperf3m4.py: using BVCI 41208 13:26:49.721180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:49.732596 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:49.743850 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:49.755045 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:49.766517 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:49.778121 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:49.789925 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:49.801464 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:26:49.813092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:49.929565 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:50.052454 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:50.169597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:26:50.284893 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:26:50.487521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:50.791239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27059): Launched 13:26:51.054699 run iperf3-srv_10.42.42.10(pid=27060): Launched 13:26:51.168040 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:26:51.370541 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:51.673586 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27061): Launched 13:26:51.937459 run iperf3-srv_10.42.42.10(pid=27062): Launched 13:26:52.051128 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:26:52.253530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:52.556222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27063): Launched 13:26:52.819972 run iperf3-srv_10.42.42.10(pid=27064): Launched 13:26:52.933223 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:26:53.135900 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:26:53.439100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27065): Launched 13:26:53.701747 run iperf3-srv_10.42.42.10(pid=27066): Launched 13:26:53.814515 tst iperf3m4.py:8: start network... 13:26:54.017490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:26:54.483710 run create_hlr_db(pid=27067): Launched 13:26:54.608207 bus /gobi_6: Setting Powered False 13:26:55.667895 run create_hlr_db(pid=27067): Terminated: ok {rc=0} 13:26:56.112056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27069): Launched 13:26:56.436039 run osmo-hlr_10.42.42.2(pid=27070): Launched 13:26:56.561113 run osmo-stp_10.42.42.5: Starting osmo-stp 13:26:57.123694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27072): Launched 13:26:57.448386 run osmo-stp_10.42.42.5(pid=27073): Launched 13:26:57.572607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:26:58.133665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27075): Launched 13:26:58.257762 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:26:58.530899 run patchelf(pid=27076): Launched 13:26:58.710819 run osmo-stp_10.42.42.5(pid=27073): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27073)] 13:26:58.847773 run osmo-stp_10.42.42.5(pid=27073): stdout: | (launched: 2022-12-14_13:26:57.389598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:58.987354 run osmo-stp_10.42.42.5(pid=27073): stderr: | 20221214132657585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132657585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132657585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132657586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132657586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132657586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132657586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:59.126829 run osmo-stp_10.42.42.5(pid=27073): stdout: | (launched: 2022-12-14_13:26:57.389598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:26:59.260016 run osmo-stp_10.42.42.5(pid=27073): stderr: | 20221214132657585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132657585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132657585 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132657586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132657586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132657586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132657586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:26:59.417944 run patchelf(pid=27076): Terminating (SIGINT) 13:26:59.598921 run patchelf(pid=27076): Terminated: ok {rc=0} 13:26:59.729786 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27073): Process ended prematurely: osmo-stp_10.42.42.5(pid=27073) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27073)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:26:59.739992 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:26:59.768930 run osmo-hlr_10.42.42.2(pid=27070): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27070)] 13:26:59.819776 run osmo-hlr_10.42.42.2(pid=27070): stdout: | (launched: 2022-12-14_13:26:56.377255) 13:26:59.872177 run osmo-hlr_10.42.42.2(pid=27070): stderr: | 20221214132656575 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132656575 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132656575 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132656575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132656575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132656575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132656588 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132656598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132656598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132656598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:26:59.924772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27059): Terminating (SIGTERM) 13:26:59.966679 run iperf3-srv_10.42.42.10(pid=27060): Terminating (SIGTERM) 13:27:00.009557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27061): Terminating (SIGTERM) 13:27:00.051836 run iperf3-srv_10.42.42.10(pid=27062): Terminating (SIGTERM) 13:27:00.094214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27063): Terminating (SIGTERM) 13:27:00.136336 run iperf3-srv_10.42.42.10(pid=27064): Terminating (SIGTERM) 13:27:00.178322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27065): Terminating (SIGTERM) 13:27:00.220185 run iperf3-srv_10.42.42.10(pid=27066): Terminating (SIGTERM) 13:27:00.262207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27069): Terminating (SIGTERM) 13:27:00.304206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27072): Terminating (SIGTERM) 13:27:00.346268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27075): Terminating (SIGTERM) 13:27:00.388377 --- ParallelTerminationStrategy: PID 27059 died... 13:27:00.408753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27059): Terminated: ok {rc=0} 13:27:00.455066 --- ParallelTerminationStrategy: PID 27060 died... 13:27:00.474796 run iperf3-srv_10.42.42.10(pid=27060): Terminated {rc=256} 13:27:00.521060 --- ParallelTerminationStrategy: PID 27061 died... 13:27:00.540839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27061): Terminated: ok {rc=0} 13:27:00.587564 --- ParallelTerminationStrategy: PID 27062 died... 13:27:00.607428 run iperf3-srv_10.42.42.10(pid=27062): Terminated {rc=256} 13:27:00.653569 --- ParallelTerminationStrategy: PID 27063 died... 13:27:00.673441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27063): Terminated: ok {rc=0} 13:27:00.720005 --- ParallelTerminationStrategy: PID 27064 died... 13:27:00.739801 run iperf3-srv_10.42.42.10(pid=27064): Terminated {rc=256} 13:27:00.786016 --- ParallelTerminationStrategy: PID 27065 died... 13:27:00.805919 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27065): Terminated: ok {rc=0} 13:27:00.862676 --- ParallelTerminationStrategy: PID 27066 died... 13:27:00.883672 run iperf3-srv_10.42.42.10(pid=27066): Terminated {rc=256} 13:27:00.944363 --- ParallelTerminationStrategy: PID 27069 died... 13:27:00.965564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27069): Terminated: ok {rc=0} 13:27:01.013857 --- ParallelTerminationStrategy: PID 27072 died... 13:27:01.040531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27072): Terminated: ok {rc=0} 13:27:01.088074 --- ParallelTerminationStrategy: PID 27075 died... 13:27:01.108288 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27075): Terminated: ok {rc=0} 13:27:01.199542 bus /gobi_4: Setting Powered False 13:27:02.313431 bus /gobi_4: Setting Powered False 13:27:03.429562 bus /gobi_1: Setting Powered False 13:27:04.525068 bus /gobi_1: Setting Powered False 13:27:05.636888 bus /gobi_0: Setting Powered False 13:27:06.734741 bus /gobi_0: Setting Powered False 13:27:07.853038 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:27:08.959575 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:08.971754 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:27:09.045693 tst ping.py: using LAC 41208 13:27:09.171507 tst ping.py: using RAC 153 13:27:09.292502 tst ping.py: using CellId 41208 13:27:09.408721 tst ping.py: using BVCI 41209 13:27:09.515926 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:09.527026 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:09.538057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:09.548753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:09.559431 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:09.570640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:09.581689 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:09.592424 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:27:09.707110 tst ping.py:19: start network... 13:27:09.905610 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:10.365783 run create_hlr_db(pid=27077): Launched 13:27:10.486775 bus /gobi_6: Setting Powered False 13:27:11.546341 run create_hlr_db(pid=27077): Terminated: ok {rc=0} 13:27:11.960375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27079): Launched 13:27:12.257375 run osmo-hlr_10.42.42.2(pid=27080): Launched 13:27:12.370035 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:12.881105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27082): Launched 13:27:13.176399 run osmo-stp_10.42.42.5(pid=27083): Launched 13:27:13.288853 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:13.800631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27085): Launched 13:27:13.913177 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:14.163368 run patchelf(pid=27086): Launched 13:27:14.327556 run osmo-stp_10.42.42.5(pid=27083): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27083)] 13:27:14.452767 run osmo-stp_10.42.42.5(pid=27083): stdout: | (launched: 2022-12-14_13:27:13.122355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:14.580231 run osmo-stp_10.42.42.5(pid=27083): stderr: | 20221214132713291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132713291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132713292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132713292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132713294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132713294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132713295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:14.707450 run osmo-stp_10.42.42.5(pid=27083): stdout: | (launched: 2022-12-14_13:27:13.122355) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:14.829174 run osmo-stp_10.42.42.5(pid=27083): stderr: | 20221214132713291 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132713291 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132713292 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132713292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132713294 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132713294 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132713295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:14.973479 run patchelf(pid=27086): Terminating (SIGINT) 13:27:15.139484 run patchelf(pid=27086): Terminated: ok {rc=0} 13:27:15.259122 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27083): Process ended prematurely: osmo-stp_10.42.42.5(pid=27083) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27083)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 13:27:15.267858 tst ping.py:22: Test FAILED (6.3 sec) 13:27:15.294414 run osmo-hlr_10.42.42.2(pid=27080): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27080)] 13:27:15.341898 run osmo-hlr_10.42.42.2(pid=27080): stdout: | (launched: 2022-12-14_13:27:12.203131) 13:27:15.391097 run osmo-hlr_10.42.42.2(pid=27080): stderr: | 20221214132712377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132712377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132712377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132712377 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132712377 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132712377 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132712390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132712399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132712400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132712400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:15.440669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27079): Terminating (SIGTERM) 13:27:15.480230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27082): Terminating (SIGTERM) 13:27:15.519827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27085): Terminating (SIGTERM) 13:27:15.559520 --- ParallelTerminationStrategy: PID 27079 died... 13:27:15.578618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27079): Terminated: ok {rc=0} 13:27:15.622408 --- ParallelTerminationStrategy: PID 27082 died... 13:27:15.640886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27082): Terminated: ok {rc=0} 13:27:15.685048 --- ParallelTerminationStrategy: PID 27085 died... 13:27:15.703546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27085): Terminated: ok {rc=0} 13:27:15.787362 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:27:16.890096 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:16.907213 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:27:17.004843 tst ping_idle_ping.py: using LAC 41209 13:27:17.157101 tst ping_idle_ping.py: using RAC 154 13:27:17.274936 tst ping_idle_ping.py: using CellId 41209 13:27:17.402698 tst ping_idle_ping.py: using BVCI 41210 13:27:17.519529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:17.531307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:17.542792 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:17.554289 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:17.566851 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:17.579279 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:17.591638 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:27:17.603813 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:27:17.723813 tst ping_idle_ping.py:24: start network... 13:27:17.940183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:18.442860 run create_hlr_db(pid=27087): Launched 13:27:18.564768 bus /gobi_6: Setting Powered False 13:27:19.628193 run create_hlr_db(pid=27087): Terminated: ok {rc=0} 13:27:20.055239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27089): Launched 13:27:20.353658 run osmo-hlr_10.42.42.2(pid=27090): Launched 13:27:20.466935 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:20.978318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27092): Launched 13:27:21.275482 run osmo-stp_10.42.42.5(pid=27093): Launched 13:27:21.389075 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:21.901648 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27095): Launched 13:27:22.015230 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:22.266555 run patchelf(pid=27096): Launched 13:27:22.430886 run osmo-stp_10.42.42.5(pid=27093): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27093)] 13:27:22.556095 run osmo-stp_10.42.42.5(pid=27093): stdout: | (launched: 2022-12-14_13:27:21.220723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:22.683193 run osmo-stp_10.42.42.5(pid=27093): stderr: | 20221214132721388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132721388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132721389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132721389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132721391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132721391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132721391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:22.810131 run osmo-stp_10.42.42.5(pid=27093): stdout: | (launched: 2022-12-14_13:27:21.220723) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:22.931734 run osmo-stp_10.42.42.5(pid=27093): stderr: | 20221214132721388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132721388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132721389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132721389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132721391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132721391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132721391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:23.076016 run patchelf(pid=27096): Terminating (SIGINT) 13:27:23.242521 run patchelf(pid=27096): Terminated: ok {rc=0} 13:27:23.362398 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27093): Process ended prematurely: osmo-stp_10.42.42.5(pid=27093) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27093)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:27:23.371207 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:27:23.397600 run osmo-hlr_10.42.42.2(pid=27090): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27090)] 13:27:23.444685 run osmo-hlr_10.42.42.2(pid=27090): stdout: | (launched: 2022-12-14_13:27:20.299205) 13:27:23.493551 run osmo-hlr_10.42.42.2(pid=27090): stderr: | 20221214132720473 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132720473 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132720474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132720474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132720474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132720474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132720486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132720497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132720497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132720497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:23.542785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27089): Terminating (SIGTERM) 13:27:23.582076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27092): Terminating (SIGTERM) 13:27:23.621295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27095): Terminating (SIGTERM) 13:27:23.661503 --- ParallelTerminationStrategy: PID 27089 died... 13:27:23.680408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27089): Terminated: ok {rc=0} 13:27:23.725662 --- ParallelTerminationStrategy: PID 27092 died... 13:27:23.743898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27092): Terminated: ok {rc=0} 13:27:23.787161 --- ParallelTerminationStrategy: PID 27095 died... 13:27:23.805559 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27095): Terminated: ok {rc=0} 13:27:23.888429 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:27:25.188442 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:27:25.194571 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:27:25.227743 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:27:25.266092 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:27:25.351962 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:27:25.384827 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:27:25.422313 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:27:26.017882 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:27:26.066969 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:26.078052 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:27:26.151380 tst cs_paging_gprs_active.py: using LAC 41210 13:27:26.270339 tst cs_paging_gprs_active.py: using RAC 155 13:27:26.389835 tst cs_paging_gprs_active.py: using CellId 41210 13:27:26.506993 tst cs_paging_gprs_active.py: using BVCI 41211 13:27:26.618671 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:26.629616 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:26.640269 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:26.650952 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:26.661770 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:26.672617 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:26.683579 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:26.694425 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:26.705441 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:26.827108 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:26.944545 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:27:27.149073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:27.453662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27100): Launched 13:27:27.718137 run iperf3-srv_10.42.42.10(pid=27101): Launched 13:27:27.831413 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:27:28.033939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:28.338378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27102): Launched 13:27:28.601557 run iperf3-srv_10.42.42.10(pid=27103): Launched 13:27:28.714859 tst cs_paging_gprs_active.py:38: start network... 13:27:28.917963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:29.385377 run create_hlr_db(pid=27104): Launched 13:27:29.509437 bus /gobi_6: Setting Powered False 13:27:30.570148 run create_hlr_db(pid=27104): Terminated: ok {rc=0} 13:27:31.057810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27106): Launched 13:27:31.406974 run osmo-hlr_10.42.42.2(pid=27107): Launched 13:27:31.657250 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:32.476094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27109): Launched 13:27:32.800640 run osmo-stp_10.42.42.5(pid=27110): Launched 13:27:32.924282 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:33.482878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27112): Launched 13:27:33.606711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:33.879898 run patchelf(pid=27113): Launched 13:27:34.060248 run osmo-stp_10.42.42.5(pid=27110): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27110)] 13:27:34.197426 run osmo-stp_10.42.42.5(pid=27110): stdout: | (launched: 2022-12-14_13:27:32.741893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:34.336078 run osmo-stp_10.42.42.5(pid=27110): stderr: | 20221214132732937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132732937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132732938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132732938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132732939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132732939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132732939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:34.474832 run osmo-stp_10.42.42.5(pid=27110): stdout: | (launched: 2022-12-14_13:27:32.741893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:34.607548 run osmo-stp_10.42.42.5(pid=27110): stderr: | 20221214132732937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132732937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132732938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132732938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132732939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132732939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132732939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:34.765121 run patchelf(pid=27113): Terminating (SIGINT) 13:27:34.946045 run patchelf(pid=27113): Terminated: ok {rc=0} 13:27:35.077326 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27110): Process ended prematurely: osmo-stp_10.42.42.5(pid=27110) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27110)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:27:35.087409 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 13:27:35.115600 run osmo-hlr_10.42.42.2(pid=27107): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27107)] 13:27:35.166051 run osmo-hlr_10.42.42.2(pid=27107): stdout: | (launched: 2022-12-14_13:27:31.335098) 13:27:35.217610 run osmo-hlr_10.42.42.2(pid=27107): stderr: | 20221214132731713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132731713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132731713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132731713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132731714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132731714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132731730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132731751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132731752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132731752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:35.270029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27100): Terminating (SIGTERM) 13:27:35.311769 run iperf3-srv_10.42.42.10(pid=27101): Terminating (SIGTERM) 13:27:35.353431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27102): Terminating (SIGTERM) 13:27:35.395623 run iperf3-srv_10.42.42.10(pid=27103): Terminating (SIGTERM) 13:27:35.437342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27106): Terminating (SIGTERM) 13:27:35.479473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27109): Terminating (SIGTERM) 13:27:35.521134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27112): Terminating (SIGTERM) 13:27:35.562931 --- ParallelTerminationStrategy: PID 27100 died... 13:27:35.582984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27100): Terminated: ok {rc=0} 13:27:35.629155 --- ParallelTerminationStrategy: PID 27101 died... 13:27:35.648639 run iperf3-srv_10.42.42.10(pid=27101): Terminated {rc=256} 13:27:35.694780 --- ParallelTerminationStrategy: PID 27102 died... 13:27:35.714591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27102): Terminated: ok {rc=0} 13:27:35.760565 --- ParallelTerminationStrategy: PID 27103 died... 13:27:35.780322 run iperf3-srv_10.42.42.10(pid=27103): Terminated {rc=256} 13:27:35.826223 --- ParallelTerminationStrategy: PID 27106 died... 13:27:35.845906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27106): Terminated: ok {rc=0} 13:27:35.892210 --- ParallelTerminationStrategy: PID 27109 died... 13:27:35.911929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27109): Terminated: ok {rc=0} 13:27:35.958011 --- ParallelTerminationStrategy: PID 27112 died... 13:27:35.977728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27112): Terminated: ok {rc=0} 13:27:36.065630 bus /gobi_0: Setting Powered False 13:27:37.164690 bus /gobi_0: Setting Powered False 13:27:38.279918 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:27:39.426071 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:39.437764 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:27:39.511005 tst iperf3.py: using LAC 41211 13:27:39.630219 tst iperf3.py: using RAC 156 13:27:39.750447 tst iperf3.py: using CellId 41211 13:27:39.871293 tst iperf3.py: using BVCI 41212 13:27:39.984079 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:39.995219 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:40.006319 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:40.017313 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:40.028070 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:40.038764 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:40.049652 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:40.060365 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:40.071175 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:40.190670 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:27:40.410624 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:40.735655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27114): Launched 13:27:41.018063 run iperf3-srv_10.42.42.10(pid=27115): Launched 13:27:41.139904 tst iperf3.py:8: start network... 13:27:41.359252 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:41.860860 run create_hlr_db(pid=27116): Launched 13:27:41.985538 bus /gobi_6: Setting Powered False 13:27:43.050176 run create_hlr_db(pid=27116): Terminated: ok {rc=0} 13:27:43.482630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27118): Launched 13:27:43.784194 run osmo-hlr_10.42.42.2(pid=27119): Launched 13:27:43.899004 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:44.421044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27121): Launched 13:27:44.722409 run osmo-stp_10.42.42.5(pid=27122): Launched 13:27:44.836842 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:45.358162 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27124): Launched 13:27:45.473397 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:45.727686 run patchelf(pid=27125): Launched 13:27:45.920276 run osmo-stp_10.42.42.5(pid=27122): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27122)] 13:27:46.062973 run osmo-stp_10.42.42.5(pid=27122): stdout: | (launched: 2022-12-14_13:27:44.667176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:46.205753 run osmo-stp_10.42.42.5(pid=27122): stderr: | 20221214132744838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132744839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132744839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132744839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132744840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132744840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132744840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:46.350420 run osmo-stp_10.42.42.5(pid=27122): stdout: | (launched: 2022-12-14_13:27:44.667176) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:46.487931 run osmo-stp_10.42.42.5(pid=27122): stderr: | 20221214132744838 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132744839 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132744839 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132744839 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132744840 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132744840 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132744840 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:46.652130 run patchelf(pid=27125): Terminating (SIGINT) 13:27:46.840274 run patchelf(pid=27125): Terminated: ok {rc=0} 13:27:46.983122 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27122): Process ended prematurely: osmo-stp_10.42.42.5(pid=27122) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27122)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 13:27:46.996308 tst iperf3.py:8: Test FAILED (7.6 sec) 13:27:47.030801 run osmo-hlr_10.42.42.2(pid=27119): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27119)] 13:27:47.084698 run osmo-hlr_10.42.42.2(pid=27119): stdout: | (launched: 2022-12-14_13:27:43.729357) 13:27:47.135876 run osmo-hlr_10.42.42.2(pid=27119): stderr: | 20221214132743906 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132743906 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132743906 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132743906 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132743906 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132743906 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132743921 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132743931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132743931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132743931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:47.186537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27114): Terminating (SIGTERM) 13:27:47.226755 run iperf3-srv_10.42.42.10(pid=27115): Terminating (SIGTERM) 13:27:47.266526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27118): Terminating (SIGTERM) 13:27:47.306283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27121): Terminating (SIGTERM) 13:27:47.345888 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27124): Terminating (SIGTERM) 13:27:47.386014 --- ParallelTerminationStrategy: PID 27114 died... 13:27:47.405369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27114): Terminated: ok {rc=0} 13:27:47.449799 --- ParallelTerminationStrategy: PID 27115 died... 13:27:47.468530 run iperf3-srv_10.42.42.10(pid=27115): Terminated {rc=256} 13:27:47.512773 --- ParallelTerminationStrategy: PID 27118 died... 13:27:47.531587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27118): Terminated: ok {rc=0} 13:27:47.575739 --- ParallelTerminationStrategy: PID 27121 died... 13:27:47.594675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27121): Terminated: ok {rc=0} 13:27:47.638786 --- ParallelTerminationStrategy: PID 27124 died... 13:27:47.657561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27124): Terminated: ok {rc=0} 13:27:47.743154 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:27:48.888511 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:48.899913 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:27:48.970457 tst iperf3m4.py: using LAC 41212 13:27:49.088434 tst iperf3m4.py: using RAC 157 13:27:49.207693 tst iperf3m4.py: using CellId 41212 13:27:49.330701 tst iperf3m4.py: using BVCI 41213 13:27:49.450900 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:49.462604 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:49.474155 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:49.485679 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:49.498086 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:49.510323 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:49.522880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:49.535098 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:27:49.547594 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:49.666327 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:49.789436 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:49.905866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:27:50.026124 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:27:50.246835 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:50.573880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27126): Launched 13:27:50.857255 run iperf3-srv_10.42.42.10(pid=27127): Launched 13:27:50.979076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:27:51.199084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:51.524420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27128): Launched 13:27:51.807106 run iperf3-srv_10.42.42.10(pid=27129): Launched 13:27:51.929132 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:27:52.148521 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:52.474157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27130): Launched 13:27:52.757405 run iperf3-srv_10.42.42.10(pid=27131): Launched 13:27:52.879219 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:27:53.099048 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:27:53.424197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27132): Launched 13:27:53.706453 run iperf3-srv_10.42.42.10(pid=27133): Launched 13:27:53.827955 tst iperf3m4.py:8: start network... 13:27:54.047250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:27:54.550540 run create_hlr_db(pid=27134): Launched 13:27:54.674222 bus /gobi_6: Setting Powered False 13:27:55.738242 run create_hlr_db(pid=27134): Terminated: ok {rc=0} 13:27:56.170986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27136): Launched 13:27:56.472701 run osmo-hlr_10.42.42.2(pid=27137): Launched 13:27:56.588791 run osmo-stp_10.42.42.5: Starting osmo-stp 13:27:57.107910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27139): Launched 13:27:57.408496 run osmo-stp_10.42.42.5(pid=27140): Launched 13:27:57.524217 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:27:58.043574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27142): Launched 13:27:58.158936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:27:58.413859 run patchelf(pid=27143): Launched 13:27:58.581537 run osmo-stp_10.42.42.5(pid=27140): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27140)] 13:27:58.708940 run osmo-stp_10.42.42.5(pid=27140): stdout: | (launched: 2022-12-14_13:27:57.353529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:58.837962 run osmo-stp_10.42.42.5(pid=27140): stderr: | 20221214132757525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132757525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132757525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132757526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132757526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132757526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132757526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:58.967311 run osmo-stp_10.42.42.5(pid=27140): stdout: | (launched: 2022-12-14_13:27:57.353529) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:27:59.090962 run osmo-stp_10.42.42.5(pid=27140): stderr: | 20221214132757525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132757525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132757525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132757526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132757526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132757526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132757526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:27:59.237682 run patchelf(pid=27143): Terminating (SIGINT) 13:27:59.407285 run patchelf(pid=27143): Terminated: ok {rc=0} 13:27:59.529288 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27140): Process ended prematurely: osmo-stp_10.42.42.5(pid=27140) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27140)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:27:59.540387 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:27:59.567811 run osmo-hlr_10.42.42.2(pid=27137): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27137)] 13:27:59.615639 run osmo-hlr_10.42.42.2(pid=27137): stdout: | (launched: 2022-12-14_13:27:56.417379) 13:27:59.664839 run osmo-hlr_10.42.42.2(pid=27137): stderr: | 20221214132756591 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132756591 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132756591 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132756591 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132756591 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132756591 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132756607 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132756617 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132756617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132756618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:27:59.714054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27126): Terminating (SIGTERM) 13:27:59.753776 run iperf3-srv_10.42.42.10(pid=27127): Terminating (SIGTERM) 13:27:59.793151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27128): Terminating (SIGTERM) 13:27:59.832593 run iperf3-srv_10.42.42.10(pid=27129): Terminating (SIGTERM) 13:27:59.872060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27130): Terminating (SIGTERM) 13:27:59.911505 run iperf3-srv_10.42.42.10(pid=27131): Terminating (SIGTERM) 13:27:59.950880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27132): Terminating (SIGTERM) 13:27:59.990246 run iperf3-srv_10.42.42.10(pid=27133): Terminating (SIGTERM) 13:28:00.029593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27136): Terminating (SIGTERM) 13:28:00.069143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27139): Terminating (SIGTERM) 13:28:00.108476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27142): Terminating (SIGTERM) 13:28:00.148200 --- ParallelTerminationStrategy: PID 27126 died... 13:28:00.167537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27126): Terminated: ok {rc=0} 13:28:00.211754 --- ParallelTerminationStrategy: PID 27127 died... 13:28:00.230471 run iperf3-srv_10.42.42.10(pid=27127): Terminated {rc=256} 13:28:00.273956 --- ParallelTerminationStrategy: PID 27128 died... 13:28:00.292482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27128): Terminated: ok {rc=0} 13:28:00.336329 --- ParallelTerminationStrategy: PID 27129 died... 13:28:00.354925 run iperf3-srv_10.42.42.10(pid=27129): Terminated {rc=256} 13:28:00.398600 --- ParallelTerminationStrategy: PID 27130 died... 13:28:00.417300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27130): Terminated: ok {rc=0} 13:28:00.461494 --- ParallelTerminationStrategy: PID 27131 died... 13:28:00.480457 run iperf3-srv_10.42.42.10(pid=27131): Terminated {rc=256} 13:28:00.524013 --- ParallelTerminationStrategy: PID 27132 died... 13:28:00.542774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27132): Terminated: ok {rc=0} 13:28:00.586679 --- ParallelTerminationStrategy: PID 27133 died... 13:28:00.605361 run iperf3-srv_10.42.42.10(pid=27133): Terminated {rc=256} 13:28:00.649120 --- ParallelTerminationStrategy: PID 27136 died... 13:28:00.667822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27136): Terminated: ok {rc=0} 13:28:00.711441 --- ParallelTerminationStrategy: PID 27139 died... 13:28:00.730155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27139): Terminated: ok {rc=0} 13:28:00.773762 --- ParallelTerminationStrategy: PID 27142 died... 13:28:00.792535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27142): Terminated: ok {rc=0} 13:28:00.896646 bus /gobi_4: Setting Powered False 13:28:02.006676 bus /gobi_4: Setting Powered False 13:28:03.125696 bus /gobi_1: Setting Powered False 13:28:04.225264 bus /gobi_1: Setting Powered False 13:28:05.339691 bus /gobi_0: Setting Powered False 13:28:06.438841 bus /gobi_0: Setting Powered False 13:28:07.554911 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:28:08.658708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:08.670362 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:28:08.740097 tst ping.py: using LAC 41213 13:28:08.855573 tst ping.py: using RAC 158 13:28:08.970740 tst ping.py: using CellId 41213 13:28:09.088327 tst ping.py: using BVCI 41214 13:28:09.195459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:09.206479 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:09.217249 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:09.227872 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:09.238485 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:09.249172 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:09.259898 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:09.270551 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:28:09.383585 tst ping.py:19: start network... 13:28:09.580629 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:10.037130 run create_hlr_db(pid=27144): Launched 13:28:10.158428 bus /gobi_6: Setting Powered False 13:28:11.217962 run create_hlr_db(pid=27144): Terminated: ok {rc=0} 13:28:11.630524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27146): Launched 13:28:11.926429 run osmo-hlr_10.42.42.2(pid=27147): Launched 13:28:12.038964 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:12.568746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27149): Launched 13:28:12.865521 run osmo-stp_10.42.42.5(pid=27150): Launched 13:28:12.978537 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:13.489060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27152): Launched 13:28:13.602075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:13.851906 run patchelf(pid=27153): Launched 13:28:14.015742 run osmo-stp_10.42.42.5(pid=27150): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27150)] 13:28:14.140579 run osmo-stp_10.42.42.5(pid=27150): stdout: | (launched: 2022-12-14_13:28:12.810232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:14.267565 run osmo-stp_10.42.42.5(pid=27150): stderr: | 20221214132812981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132812981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132812982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132812982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132812982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132812983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132812983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:14.394217 run osmo-stp_10.42.42.5(pid=27150): stdout: | (launched: 2022-12-14_13:28:12.810232) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:14.515590 run osmo-stp_10.42.42.5(pid=27150): stderr: | 20221214132812981 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132812981 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132812982 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132812982 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132812982 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132812983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132812983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:14.660288 run patchelf(pid=27153): Terminating (SIGINT) 13:28:14.826409 run patchelf(pid=27153): Terminated: ok {rc=0} 13:28:14.946677 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27150): Process ended prematurely: osmo-stp_10.42.42.5(pid=27150) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27150)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 13:28:14.955374 tst ping.py:22: Test FAILED (6.3 sec) 13:28:14.981864 run osmo-hlr_10.42.42.2(pid=27147): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27147)] 13:28:15.029551 run osmo-hlr_10.42.42.2(pid=27147): stdout: | (launched: 2022-12-14_13:28:11.871851) 13:28:15.078626 run osmo-hlr_10.42.42.2(pid=27147): stderr: | 20221214132812046 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132812046 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132812046 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132812046 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132812046 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132812046 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132812057 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132812069 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132812069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132812069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:15.127886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27146): Terminating (SIGTERM) 13:28:15.167432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27149): Terminating (SIGTERM) 13:28:15.207072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27152): Terminating (SIGTERM) 13:28:15.246819 --- ParallelTerminationStrategy: PID 27146 died... 13:28:15.266186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27146): Terminated: ok {rc=0} 13:28:15.310399 --- ParallelTerminationStrategy: PID 27149 died... 13:28:15.329220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27149): Terminated: ok {rc=0} 13:28:15.373132 --- ParallelTerminationStrategy: PID 27152 died... 13:28:15.391979 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27152): Terminated: ok {rc=0} 13:28:15.477780 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:28:16.568383 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:16.588137 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:28:16.685082 tst ping_idle_ping.py: using LAC 41214 13:28:16.847006 tst ping_idle_ping.py: using RAC 159 13:28:16.967855 tst ping_idle_ping.py: using CellId 41214 13:28:17.117274 tst ping_idle_ping.py: using BVCI 41215 13:28:17.227856 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:17.239949 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:17.252077 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:17.263977 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:17.275996 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:17.287656 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:17.299268 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:28:17.310972 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:28:17.427192 tst ping_idle_ping.py:24: start network... 13:28:17.626330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:18.089810 run create_hlr_db(pid=27154): Launched 13:28:18.212388 bus /gobi_6: Setting Powered False 13:28:19.272317 run create_hlr_db(pid=27154): Terminated: ok {rc=0} 13:28:19.708432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27156): Launched 13:28:20.028075 run osmo-hlr_10.42.42.2(pid=27157): Launched 13:28:20.151177 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:20.702522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27159): Launched 13:28:21.021777 run osmo-stp_10.42.42.5(pid=27160): Launched 13:28:21.144308 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:21.696039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27162): Launched 13:28:21.818446 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:22.088072 run patchelf(pid=27163): Launched 13:28:22.264800 run osmo-stp_10.42.42.5(pid=27160): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27160)] 13:28:22.399805 run osmo-stp_10.42.42.5(pid=27160): stdout: | (launched: 2022-12-14_13:28:20.963239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:22.536151 run osmo-stp_10.42.42.5(pid=27160): stderr: | 20221214132821155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132821155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132821155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132821155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132821156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132821156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132821156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:22.673303 run osmo-stp_10.42.42.5(pid=27160): stdout: | (launched: 2022-12-14_13:28:20.963239) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:22.804436 run osmo-stp_10.42.42.5(pid=27160): stderr: | 20221214132821155 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132821155 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132821155 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132821155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132821156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132821156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132821156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:22.959825 run patchelf(pid=27163): Terminating (SIGINT) 13:28:23.138957 run patchelf(pid=27163): Terminated: ok {rc=0} 13:28:23.267946 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27160): Process ended prematurely: osmo-stp_10.42.42.5(pid=27160) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27160)] [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:28:23.277488 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:28:23.305286 run osmo-hlr_10.42.42.2(pid=27157): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27157)] 13:28:23.355888 run osmo-hlr_10.42.42.2(pid=27157): stdout: | (launched: 2022-12-14_13:28:19.969988) 13:28:23.408052 run osmo-hlr_10.42.42.2(pid=27157): stderr: | 20221214132820168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132820168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132820168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132820169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132820169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132820169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132820180 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132820188 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132820189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132820189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:23.460583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27156): Terminating (SIGTERM) 13:28:23.502336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27159): Terminating (SIGTERM) 13:28:23.544829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27162): Terminating (SIGTERM) 13:28:23.587355 --- ParallelTerminationStrategy: PID 27156 died... 13:28:23.607621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27156): Terminated: ok {rc=0} 13:28:23.654336 --- ParallelTerminationStrategy: PID 27159 died... 13:28:23.674281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27159): Terminated: ok {rc=0} 13:28:23.720904 --- ParallelTerminationStrategy: PID 27162 died... 13:28:23.740794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27162): Terminated: ok {rc=0} 13:28:23.828925 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:28:25.137239 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:25.143698 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:28:25.176636 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:28:25.211108 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:28:25.262020 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:28:25.295293 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:28:25.329467 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:28:25.893301 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:28:25.898822 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:25.910777 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:28:25.980872 tst switch_tch_pdch.py: using LAC 41215 13:28:26.104351 tst switch_tch_pdch.py: using RAC 160 13:28:26.226767 tst switch_tch_pdch.py: using CellId 41215 13:28:26.349275 tst switch_tch_pdch.py: using BVCI 41216 13:28:26.464613 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:26.476352 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:26.487892 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:26.499415 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:26.511288 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:26.523168 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:26.535124 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:28:26.547311 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:28:26.664485 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:28:26.778799 tst switch_tch_pdch.py:51: start network... 13:28:26.977964 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:27.438358 run create_hlr_db(pid=27168): Launched 13:28:27.562171 bus /gobi_6: Setting Powered False 13:28:28.621847 run create_hlr_db(pid=27168): Terminated: ok {rc=0} 13:28:29.058119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27170): Launched 13:28:29.378151 run osmo-hlr_10.42.42.2(pid=27171): Launched 13:28:29.499593 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:30.045488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27173): Launched 13:28:30.362942 run osmo-stp_10.42.42.5(pid=27174): Launched 13:28:30.483868 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:31.061866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27176): Launched 13:28:31.186897 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:31.473752 run patchelf(pid=27177): Launched 13:28:31.682741 run osmo-stp_10.42.42.5(pid=27174): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27174)] 13:28:31.821050 run osmo-stp_10.42.42.5(pid=27174): stdout: | (launched: 2022-12-14_13:28:30.304931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:31.960562 run osmo-stp_10.42.42.5(pid=27174): stderr: | 20221214132830498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132830498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132830498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132830499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132830499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132830499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132830499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:32.101046 run osmo-stp_10.42.42.5(pid=27174): stdout: | (launched: 2022-12-14_13:28:30.304931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:32.235818 run osmo-stp_10.42.42.5(pid=27174): stderr: | 20221214132830498 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132830498 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132830498 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132830499 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132830499 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132830499 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132830499 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:32.394512 run patchelf(pid=27177): Terminating (SIGINT) 13:28:32.572495 run patchelf(pid=27177): Terminated: ok {rc=0} 13:28:32.701155 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27174): Process ended prematurely: osmo-stp_10.42.42.5(pid=27174) [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27174)] [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:28:32.710882 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 13:28:32.739245 run osmo-hlr_10.42.42.2(pid=27171): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27171)] 13:28:32.790044 run osmo-hlr_10.42.42.2(pid=27171): stdout: | (launched: 2022-12-14_13:28:29.319785) 13:28:32.842137 run osmo-hlr_10.42.42.2(pid=27171): stderr: | 20221214132829518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132829518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132829519 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132829519 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132829519 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132829519 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132829532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132829540 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132829540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132829540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:32.894982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27170): Terminating (SIGTERM) 13:28:32.936792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27173): Terminating (SIGTERM) 13:28:32.978767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27176): Terminating (SIGTERM) 13:28:33.021657 --- ParallelTerminationStrategy: PID 27170 died... 13:28:33.041858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27170): Terminated: ok {rc=0} 13:28:33.089093 --- ParallelTerminationStrategy: PID 27173 died... 13:28:33.109293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27173): Terminated: ok {rc=0} 13:28:33.156192 --- ParallelTerminationStrategy: PID 27176 died... 13:28:33.176271 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27176): Terminated: ok {rc=0} 13:28:33.265181 bus /gobi_0: Setting Powered False 13:28:34.364388 bus /gobi_0: Setting Powered False 13:28:35.479287 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:28:36.737982 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:36.744531 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:28:36.779199 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:28:36.814786 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:28:36.869839 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:28:36.904313 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:28:36.939468 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:28:37.491057 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:28:37.496334 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:37.507479 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:28:37.577107 tst switch_tch_pdch.py: using LAC 41216 13:28:37.693406 tst switch_tch_pdch.py: using RAC 161 13:28:37.809897 tst switch_tch_pdch.py: using CellId 41216 13:28:37.925994 tst switch_tch_pdch.py: using BVCI 41217 13:28:38.034770 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:38.045785 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:38.056487 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:38.067260 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:38.077997 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:38.088776 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:38.099682 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:28:38.110407 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:28:38.230620 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:28:38.351576 tst switch_tch_pdch.py:51: start network... 13:28:38.566899 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:39.033416 run create_hlr_db(pid=27181): Launched 13:28:39.157173 bus /gobi_6: Setting Powered False 13:28:40.221044 run create_hlr_db(pid=27181): Terminated: ok {rc=0} 13:28:40.622201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27183): Launched 13:28:40.919052 run osmo-hlr_10.42.42.2(pid=27184): Launched 13:28:41.031429 run osmo-stp_10.42.42.5: Starting osmo-stp 13:28:41.514959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27186): Launched 13:28:41.809676 run osmo-stp_10.42.42.5(pid=27187): Launched 13:28:41.922934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:28:42.406565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27189): Launched 13:28:42.519389 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:28:42.768463 run patchelf(pid=27190): Launched 13:28:42.933328 run osmo-stp_10.42.42.5(pid=27187): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27187)] 13:28:43.058680 run osmo-stp_10.42.42.5(pid=27187): stdout: | (launched: 2022-12-14_13:28:41.755498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:43.185306 run osmo-stp_10.42.42.5(pid=27187): stderr: | 20221214132841925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132841925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132841926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132841926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132841926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132841926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132841927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:43.311726 run osmo-stp_10.42.42.5(pid=27187): stdout: | (launched: 2022-12-14_13:28:41.755498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:28:43.432544 run osmo-stp_10.42.42.5(pid=27187): stderr: | 20221214132841925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132841925 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132841926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132841926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132841926 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132841926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132841927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:28:43.576630 run patchelf(pid=27190): Terminating (SIGINT) 13:28:43.742197 run patchelf(pid=27190): Terminated: ok {rc=0} 13:28:43.862113 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=27187): Process ended prematurely: osmo-stp_10.42.42.5(pid=27187) [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27187)] [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:28:43.870842 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:28:43.897202 run osmo-hlr_10.42.42.2(pid=27184): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27184)] 13:28:43.944548 run osmo-hlr_10.42.42.2(pid=27184): stdout: | (launched: 2022-12-14_13:28:40.864677) 13:28:43.993495 run osmo-hlr_10.42.42.2(pid=27184): stderr: | 20221214132841041 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132841041 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132841041 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132841041 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132841041 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132841041 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132841053 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132841062 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132841063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132841063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:28:44.042819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27183): Terminating (SIGTERM) 13:28:44.082697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27186): Terminating (SIGTERM) 13:28:44.122407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27189): Terminating (SIGTERM) 13:28:44.162469 --- ParallelTerminationStrategy: PID 27183 died... 13:28:44.181790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27183): Terminated: ok {rc=0} 13:28:44.226037 --- ParallelTerminationStrategy: PID 27186 died... 13:28:44.244804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27186): Terminated: ok {rc=0} 13:28:44.288731 --- ParallelTerminationStrategy: PID 27189 died... 13:28:44.307580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27189): Terminated: ok {rc=0} 13:28:44.390692 bus /gobi_0: Setting Powered False 13:28:45.488172 bus /gobi_0: Setting Powered False 13:28:46.604606 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_sms:trx-umtrx --------------------------------------------------------------------- 13:28:47.860303 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:47.864494 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:28:47.897096 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 13:28:47.905155 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 13:28:47.958592 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:28:47.991929 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 13:28:47.999084 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 13:28:48.534675 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 13:28:48.539921 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 13:28:48.550662 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 13:28:48.596751 tst mo_mt_sms.py: using LAC 41217 13:28:48.712748 tst mo_mt_sms.py: using RAC 162 13:28:48.829467 tst mo_mt_sms.py: using CellId 41217 13:28:48.947768 tst mo_mt_sms.py: using BVCI 41218 13:28:49.056316 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:28:49.173712 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:28:49.290422 tst mo_mt_sms.py:9: start nitb and bts... 13:28:49.506998 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:28:50.156657 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27195): Launched 13:28:50.474937 run osmo-nitb_10.42.42.2(pid=27196): Launched 13:28:50.651213 run osmo-nitb_10.42.42.2(pid=27196): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27196)] 13:28:50.794371 run osmo-nitb_10.42.42.2(pid=27196): stdout: | (launched: 2022-12-14_13:28:50.417352) 13:28:50.939047 run osmo-nitb_10.42.42.2(pid=27196): stderr: | (launched: 2022-12-14_13:28:50.464672) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:28:51.083759 run osmo-nitb_10.42.42.2(pid=27196): stdout: | (launched: 2022-12-14_13:28:50.417352) 13:28:51.222646 run osmo-nitb_10.42.42.2(pid=27196): stderr: | (launched: 2022-12-14_13:28:50.464672) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27196): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27196) [trial-2405↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27196)] 13:28:51.595723 tst osmo-nitb_10.42.42.2(pid=27196): stdout: | (launched: 2022-12-14_13:28:50.417352) 13:28:51.725667 tst osmo-nitb_10.42.42.2(pid=27196): stderr: | (launched: 2022-12-14_13:28:50.464672) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:28:51.878082 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=27196): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27196) [trial-2405↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27196)] [trial-2405↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 13:28:51.887184 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:28:51.894378 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27195): Terminating (SIGTERM) 13:28:52.105388 --- ParallelTerminationStrategy: PID 27195 died... 13:28:52.126556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27195): Terminated: ok {rc=0} 13:28:52.215181 bus /sierra_3: Setting Powered False 13:28:53.313789 bus /sierra_3: Setting Powered False 13:28:54.432316 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 sms:trx-umtrx --------------------------------------------------------------------- 13:28:55.626885 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:28:55.630855 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:28:55.662745 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:28:55.689405 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 13:28:55.741227 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:28:55.774231 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:28:55.801797 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 13:28:56.346863 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 13:28:56.352295 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:28:56.364395 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 13:28:56.411150 tst mo_mt_sms.py: using LAC 41218 13:28:56.540305 tst mo_mt_sms.py: using RAC 163 13:28:56.665949 tst mo_mt_sms.py: using CellId 41218 13:28:56.789312 tst mo_mt_sms.py: using BVCI 41219 13:28:56.905241 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:28:56.916445 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:28:56.927330 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:28:56.938333 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:28:56.949655 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:28:56.960577 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:28:57.077319 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 13:28:57.195089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:28:57.687901 run create_hlr_db(pid=27200): Launched 13:28:57.809265 bus /sierra_2: Setting Powered False 13:28:58.872216 run create_hlr_db(pid=27200): Terminated: ok {rc=0} 13:28:59.315292 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27202): Launched 13:28:59.632104 run osmo-hlr_10.42.42.2(pid=27203): Launched 13:28:59.753188 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:00.302386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27205): Launched 13:29:00.620405 run osmo-stp_10.42.42.5(pid=27206): Launched 13:29:00.741948 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:01.373773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27208): Launched 13:29:01.707497 run osmo-msc_10.42.42.6(pid=27209): Launched 13:29:02.147784 run osmo-stp_10.42.42.5(pid=27206): ERR: Terminated: ERROR {rc=1} [trial-2405↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27206)] 13:29:02.394986 run osmo-stp_10.42.42.5(pid=27206): stdout: | (launched: 2022-12-14_13:29:00.562425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:02.564328 run osmo-stp_10.42.42.5(pid=27206): stderr: | 20221214132900756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132900756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132900756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132900757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132900757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132900757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132900758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:02.698691 run osmo-stp_10.42.42.5(pid=27206): stdout: | (launched: 2022-12-14_13:29:00.562425) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:02.826359 run osmo-stp_10.42.42.5(pid=27206): stderr: | 20221214132900756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132900756 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132900756 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132900757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132900757 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132900757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132900758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:02.979009 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=27206): Process ended prematurely: osmo-stp_10.42.42.5(pid=27206) [trial-2405↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27206)] [trial-2405↪sms:trx-umtrx↪mo_mt_sms.py:16] 13:29:02.988038 tst mo_mt_sms.py:16: Test FAILED (6.6 sec) 13:29:03.015661 run osmo-hlr_10.42.42.2(pid=27203): ERR: Terminated: ERROR {rc=237} [trial-2405↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27203)] 13:29:03.066809 run osmo-hlr_10.42.42.2(pid=27203): stdout: | (launched: 2022-12-14_13:28:59.574307) 13:29:03.119460 run osmo-hlr_10.42.42.2(pid=27203): stderr: | 20221214132859772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132859772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132859772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132859773 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132859773 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132859773 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132859785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132859793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132859793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132859793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:03.191832 run osmo-msc_10.42.42.6(pid=27209): ERR: Terminated: ERROR {rc=2} [trial-2405↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27209)] 13:29:03.241539 run osmo-msc_10.42.42.6(pid=27209): stdout: | (launched: 2022-12-14_13:29:01.643672) 13:29:03.293656 run osmo-msc_10.42.42.6(pid=27209): stderr: | 20221214132902358 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132902358 DLGLOBAL DEBUG validating counter group 0x7f5baec38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132902358 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132902358 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132902358 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132902359 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132902360 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132902361 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132902361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132902361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:03.345860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27202): Terminating (SIGTERM) 13:29:03.387598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27205): Terminating (SIGTERM) 13:29:03.429754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27208): Terminating (SIGTERM) 13:29:03.472308 --- ParallelTerminationStrategy: PID 27202 died... 13:29:03.492565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27202): Terminated: ok {rc=0} 13:29:03.539181 --- ParallelTerminationStrategy: PID 27205 died... 13:29:03.559047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27205): Terminated: ok {rc=0} 13:29:03.605422 --- ParallelTerminationStrategy: PID 27208 died... 13:29:03.625378 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27208): Terminated: ok {rc=0} 13:29:03.713603 bus /sierra_3: Setting Powered False 13:29:04.812318 bus /sierra_3: Setting Powered False 13:29:05.926945 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 13:29:07.156616 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:07.160715 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:29:07.193603 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 13:29:07.201517 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 13:29:07.238152 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:29:07.271254 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 13:29:07.278214 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 13:29:07.795939 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 13:29:07.801164 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 13:29:07.811653 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 13:29:07.858212 tst assert_extension.py: using LAC 41219 13:29:07.976422 tst assert_extension.py: using RAC 164 13:29:08.092337 tst assert_extension.py: using CellId 41219 13:29:08.211192 tst assert_extension.py: using BVCI 41220 13:29:08.327537 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 13:29:08.440469 tst assert_extension.py:10: start nitb and bts... 13:29:08.638243 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:29:09.243555 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27215): Launched 13:29:09.538856 run osmo-nitb_10.42.42.2(pid=27216): Launched 13:29:09.702762 run osmo-nitb_10.42.42.2(pid=27216): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27216)] 13:29:09.835190 run osmo-nitb_10.42.42.2(pid=27216): stdout: | (launched: 2022-12-14_13:29:09.484701) 13:29:09.968788 run osmo-nitb_10.42.42.2(pid=27216): stderr: | (launched: 2022-12-14_13:29:09.528825) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:29:10.103074 run osmo-nitb_10.42.42.2(pid=27216): stdout: | (launched: 2022-12-14_13:29:09.484701) 13:29:10.231695 run osmo-nitb_10.42.42.2(pid=27216): stderr: | (launched: 2022-12-14_13:29:09.528825) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=27216): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27216) [trial-2405↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27216)] 13:29:10.650881 tst osmo-nitb_10.42.42.2(pid=27216): stdout: | (launched: 2022-12-14_13:29:09.484701) 13:29:10.770145 tst osmo-nitb_10.42.42.2(pid=27216): stderr: | (launched: 2022-12-14_13:29:09.528825) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:29:10.910330 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=27216): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27216) [trial-2405↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27216)] [trial-2405↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 13:29:10.918549 tst assert_extension.py:12: Test FAILED (3.1 sec) 13:29:10.925030 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27215): Terminating (SIGTERM) 13:29:11.133461 --- ParallelTerminationStrategy: PID 27215 died... 13:29:11.153895 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=27215): Terminated: ok {rc=0} 13:29:11.236577 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 ussd:trx-umtrx --------------------------------------------------------------------- 13:29:12.411696 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:12.416099 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:29:12.449291 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:29:12.477820 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 13:29:12.517702 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:29:12.551414 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:29:12.578782 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 13:29:13.101359 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 13:29:13.107527 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:29:13.118615 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 13:29:13.166587 tst assert_extension.py: using LAC 41220 13:29:13.291554 tst assert_extension.py: using RAC 165 13:29:13.415273 tst assert_extension.py: using CellId 41220 13:29:13.538763 tst assert_extension.py: using BVCI 41221 13:29:13.655762 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:29:13.666992 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:29:13.678042 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:29:13.688648 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:29:13.699719 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:29:13.710899 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 13:29:13.824364 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:14.283799 run create_hlr_db(pid=27220): Launched 13:29:14.405986 bus /sierra_2: Setting Powered False 13:29:15.464903 run create_hlr_db(pid=27220): Terminated: ok {rc=0} 13:29:15.905101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27222): Launched 13:29:16.258033 run osmo-hlr_10.42.42.2(pid=27223): Launched 13:29:16.446846 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:17.141871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27225): Launched 13:29:17.450355 run osmo-stp_10.42.42.5(pid=27226): Launched 13:29:17.564501 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:18.097662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27228): Launched 13:29:18.392352 run osmo-msc_10.42.42.6(pid=27229): Launched 13:29:18.557240 run osmo-stp_10.42.42.5(pid=27226): ERR: Terminated: ERROR {rc=1} [trial-2405↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27226)] 13:29:18.682098 run osmo-stp_10.42.42.5(pid=27226): stdout: | (launched: 2022-12-14_13:29:17.395693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:18.807446 run osmo-stp_10.42.42.5(pid=27226): stderr: | 20221214132917566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132917566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132917566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132917567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132917567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132917567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132917567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:18.930422 run osmo-stp_10.42.42.5(pid=27226): stdout: | (launched: 2022-12-14_13:29:17.395693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:19.048025 run osmo-stp_10.42.42.5(pid=27226): stderr: | 20221214132917566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132917566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132917566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132917567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132917567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132917567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132917567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:19.190029 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=27226): Process ended prematurely: osmo-stp_10.42.42.5(pid=27226) [trial-2405↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27226)] [trial-2405↪ussd:trx-umtrx↪assert_extension.py:17] 13:29:19.198207 tst assert_extension.py:17: Test FAILED (6.1 sec) 13:29:19.223982 run osmo-hlr_10.42.42.2(pid=27223): ERR: Terminated: ERROR {rc=237} [trial-2405↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27223)] 13:29:19.271452 run osmo-hlr_10.42.42.2(pid=27223): stdout: | (launched: 2022-12-14_13:29:16.195288) 13:29:19.320530 run osmo-hlr_10.42.42.2(pid=27223): stderr: | 20221214132916530 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132916530 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132916530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132916530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132916530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132916530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132916550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132916562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132916562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132916562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:19.389040 run osmo-msc_10.42.42.6(pid=27229): ERR: Terminated: ERROR {rc=2} [trial-2405↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27229)] 13:29:19.436267 run osmo-msc_10.42.42.6(pid=27229): stdout: | (launched: 2022-12-14_13:29:18.337941) 13:29:19.485131 run osmo-msc_10.42.42.6(pid=27229): stderr: | 20221214132918609 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132918609 DLGLOBAL DEBUG validating counter group 0x7f20ec268c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132918610 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132918610 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132918610 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132918610 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132918613 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132918614 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132918614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132918614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:19.534346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27222): Terminating (SIGTERM) 13:29:19.573446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27225): Terminating (SIGTERM) 13:29:19.613084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27228): Terminating (SIGTERM) 13:29:19.653199 --- ParallelTerminationStrategy: PID 27222 died... 13:29:19.672269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27222): Terminated: ok {rc=0} 13:29:19.716100 --- ParallelTerminationStrategy: PID 27225 died... 13:29:19.734602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27225): Terminated: ok {rc=0} 13:29:19.778138 --- ParallelTerminationStrategy: PID 27228 died... 13:29:19.796639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27228): Terminated: ok {rc=0} 13:29:19.880262 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:29:21.085400 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:21.091886 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:29:21.123959 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:29:21.153432 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:29:21.209473 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:29:21.242965 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:29:21.270823 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:29:21.819137 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:29:21.873335 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:21.885196 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:29:21.955215 tst mo_mt_call.py: using LAC 41221 13:29:22.080085 tst mo_mt_call.py: using RAC 166 13:29:22.199149 tst mo_mt_call.py: using CellId 41221 13:29:22.317376 tst mo_mt_call.py: using BVCI 41222 13:29:22.427003 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:22.438227 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:22.449271 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:22.460112 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:22.471682 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:22.483161 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:29:22.603507 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:29:22.718991 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:23.188708 run create_hlr_db(pid=27234): Launched 13:29:23.312413 bus /sierra_2: Setting Powered False 13:29:24.373308 run create_hlr_db(pid=27234): Terminated: ok {rc=0} 13:29:24.817415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27236): Launched 13:29:25.142242 run osmo-hlr_10.42.42.2(pid=27237): Launched 13:29:25.265238 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:25.826674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27239): Launched 13:29:26.151326 run osmo-stp_10.42.42.5(pid=27240): Launched 13:29:26.274809 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:26.860522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27242): Launched 13:29:27.183667 run osmo-msc_10.42.42.6(pid=27243): Launched 13:29:27.363943 run osmo-stp_10.42.42.5(pid=27240): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27240)] 13:29:27.500369 run osmo-stp_10.42.42.5(pid=27240): stdout: | (launched: 2022-12-14_13:29:26.092328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:27.637772 run osmo-stp_10.42.42.5(pid=27240): stderr: | 20221214132926284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132926284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132926284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132926285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132926287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132926287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132926287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:27.774208 run osmo-stp_10.42.42.5(pid=27240): stdout: | (launched: 2022-12-14_13:29:26.092328) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:27.904059 run osmo-stp_10.42.42.5(pid=27240): stderr: | 20221214132926284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132926284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132926284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132926285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132926287 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132926287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132926287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:28.059502 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27240): Process ended prematurely: osmo-stp_10.42.42.5(pid=27240) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27240)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:29:28.069374 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:29:28.097366 run osmo-hlr_10.42.42.2(pid=27237): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27237)] 13:29:28.148196 run osmo-hlr_10.42.42.2(pid=27237): stdout: | (launched: 2022-12-14_13:29:25.083481) 13:29:28.200450 run osmo-hlr_10.42.42.2(pid=27237): stderr: | 20221214132925283 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132925283 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132925283 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132925283 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132925283 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132925283 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132925296 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132925304 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132925305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132925305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:28.272676 run osmo-msc_10.42.42.6(pid=27243): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27243)] 13:29:28.322490 run osmo-msc_10.42.42.6(pid=27243): stdout: | (launched: 2022-12-14_13:29:27.125091) 13:29:28.375296 run osmo-msc_10.42.42.6(pid=27243): stderr: | 20221214132927447 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132927447 DLGLOBAL DEBUG validating counter group 0x7fd488477c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132927447 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132927447 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132927447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132927448 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132927449 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132927450 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132927450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132927450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:28.427362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27236): Terminating (SIGTERM) 13:29:28.469293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27239): Terminating (SIGTERM) 13:29:28.511938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27242): Terminating (SIGTERM) 13:29:28.554066 --- ParallelTerminationStrategy: PID 27236 died... 13:29:28.574245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27236): Terminated: ok {rc=0} 13:29:28.620392 --- ParallelTerminationStrategy: PID 27239 died... 13:29:28.640135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27239): Terminated: ok {rc=0} 13:29:28.686399 --- ParallelTerminationStrategy: PID 27242 died... 13:29:28.706135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27242): Terminated: ok {rc=0} 13:29:28.793985 bus /sierra_3: Setting Powered False 13:29:29.892275 bus /sierra_3: Setting Powered False 13:29:31.008050 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:29:32.167606 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:32.180452 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:29:32.253378 tst mo_mt_call_osmux.py: using LAC 41222 13:29:32.379744 tst mo_mt_call_osmux.py: using RAC 167 13:29:32.508941 tst mo_mt_call_osmux.py: using CellId 41222 13:29:32.637842 tst mo_mt_call_osmux.py: using BVCI 41223 13:29:32.755687 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:32.767161 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:32.778419 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:32.789707 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:32.801284 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:29:32.812698 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:29:32.929516 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:29:33.050401 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:33.551552 run create_hlr_db(pid=27245): Launched 13:29:33.674497 bus /sierra_2: Setting Powered False 13:29:34.738365 run create_hlr_db(pid=27245): Terminated: ok {rc=0} 13:29:35.187581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27247): Launched 13:29:35.509418 run osmo-hlr_10.42.42.2(pid=27248): Launched 13:29:35.632740 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:36.190100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27250): Launched 13:29:36.512148 run osmo-stp_10.42.42.5(pid=27251): Launched 13:29:36.635569 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:37.220270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27253): Launched 13:29:37.542582 run osmo-msc_10.42.42.6(pid=27254): Launched 13:29:37.722876 run osmo-stp_10.42.42.5(pid=27251): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27251)] 13:29:37.859516 run osmo-stp_10.42.42.5(pid=27251): stdout: | (launched: 2022-12-14_13:29:36.453822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:37.996910 run osmo-stp_10.42.42.5(pid=27251): stderr: | 20221214132936645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132936645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132936645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132936645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132936646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132936646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132936646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:38.133828 run osmo-stp_10.42.42.5(pid=27251): stdout: | (launched: 2022-12-14_13:29:36.453822) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:38.262845 run osmo-stp_10.42.42.5(pid=27251): stderr: | 20221214132936645 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132936645 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132936645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132936645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132936646 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132936646 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132936646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:38.417508 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27251): Process ended prematurely: osmo-stp_10.42.42.5(pid=27251) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27251)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:29:38.427044 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:29:38.454583 run osmo-hlr_10.42.42.2(pid=27248): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27248)] 13:29:38.505308 run osmo-hlr_10.42.42.2(pid=27248): stdout: | (launched: 2022-12-14_13:29:35.451122) 13:29:38.557288 run osmo-hlr_10.42.42.2(pid=27248): stderr: | 20221214132935648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132935648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132935648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132935648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132935648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132935648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132935660 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132935669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132935670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132935670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:38.629222 run osmo-msc_10.42.42.6(pid=27254): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27254)] 13:29:38.678756 run osmo-msc_10.42.42.6(pid=27254): stdout: | (launched: 2022-12-14_13:29:37.483986) 13:29:38.730454 run osmo-msc_10.42.42.6(pid=27254): stderr: | 20221214132937806 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132937806 DLGLOBAL DEBUG validating counter group 0x7ff0d7602c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132937806 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132937806 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132937807 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132937807 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132937809 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132937809 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132937809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132937809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:38.782055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27247): Terminating (SIGTERM) 13:29:38.823675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27250): Terminating (SIGTERM) 13:29:38.865120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27253): Terminating (SIGTERM) 13:29:38.907531 --- ParallelTerminationStrategy: PID 27247 died... 13:29:38.927575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27247): Terminated: ok {rc=0} 13:29:38.973748 --- ParallelTerminationStrategy: PID 27250 died... 13:29:38.993436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27250): Terminated: ok {rc=0} 13:29:39.039543 --- ParallelTerminationStrategy: PID 27253 died... 13:29:39.059436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27253): Terminated: ok {rc=0} 13:29:39.147332 bus /sierra_3: Setting Powered False 13:29:40.246104 bus /sierra_3: Setting Powered False 13:29:41.362589 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:29:42.615451 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:29:42.622433 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:29:42.655109 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:29:42.683172 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:29:42.742047 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:29:42.774302 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:29:42.800772 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:29:43.348017 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:29:43.401292 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:43.413160 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:29:43.481522 tst mo_mt_call.py: using LAC 41223 13:29:43.600922 tst mo_mt_call.py: using RAC 168 13:29:43.719768 tst mo_mt_call.py: using CellId 41223 13:29:43.838893 tst mo_mt_call.py: using BVCI 41224 13:29:43.947390 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:43.958374 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:43.969373 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:43.980038 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:43.990832 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:44.001758 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:29:44.114383 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:29:44.233400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:44.734151 run create_hlr_db(pid=27259): Launched 13:29:44.857014 bus /sierra_2: Setting Powered False 13:29:45.933951 run create_hlr_db(pid=27259): Terminated: ok {rc=0} 13:29:46.395795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27261): Launched 13:29:46.803721 run osmo-hlr_10.42.42.2(pid=27262): Launched 13:29:46.970432 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:47.661198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27264): Launched 13:29:47.983857 run osmo-stp_10.42.42.5(pid=27265): Launched 13:29:48.107978 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:48.692309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27267): Launched 13:29:49.014736 run osmo-msc_10.42.42.6(pid=27268): Launched 13:29:49.196685 run osmo-stp_10.42.42.5(pid=27265): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27265)] 13:29:49.333703 run osmo-stp_10.42.42.5(pid=27265): stdout: | (launched: 2022-12-14_13:29:47.925204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:49.471357 run osmo-stp_10.42.42.5(pid=27265): stderr: | 20221214132948119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132948119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132948120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132948120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132948120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132948121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132948121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:49.608009 run osmo-stp_10.42.42.5(pid=27265): stdout: | (launched: 2022-12-14_13:29:47.925204) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:49.737766 run osmo-stp_10.42.42.5(pid=27265): stderr: | 20221214132948119 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132948119 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132948120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132948120 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132948120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132948121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132948121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:49.892729 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27265): Process ended prematurely: osmo-stp_10.42.42.5(pid=27265) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27265)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:29:49.902146 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:29:49.929813 run osmo-hlr_10.42.42.2(pid=27262): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27262)] 13:29:49.980455 run osmo-hlr_10.42.42.2(pid=27262): stdout: | (launched: 2022-12-14_13:29:46.738795) 13:29:50.032918 run osmo-hlr_10.42.42.2(pid=27262): stderr: | 20221214132947132 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132947132 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132947132 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132947132 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132947132 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132947132 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132947152 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132947168 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132947168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132947168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:29:50.105800 run osmo-msc_10.42.42.6(pid=27268): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27268)] 13:29:50.155680 run osmo-msc_10.42.42.6(pid=27268): stdout: | (launched: 2022-12-14_13:29:48.956086) 13:29:50.207939 run osmo-msc_10.42.42.6(pid=27268): stderr: | 20221214132949278 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132949278 DLGLOBAL DEBUG validating counter group 0x7f0866072c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132949278 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132949278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132949278 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132949279 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132949280 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132949281 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132949281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132949281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:29:50.259783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27261): Terminating (SIGTERM) 13:29:50.302122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27264): Terminating (SIGTERM) 13:29:50.344647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27267): Terminating (SIGTERM) 13:29:50.387249 --- ParallelTerminationStrategy: PID 27261 died... 13:29:50.407785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27261): Terminated: ok {rc=0} 13:29:50.454674 --- ParallelTerminationStrategy: PID 27264 died... 13:29:50.474985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27264): Terminated: ok {rc=0} 13:29:50.521858 --- ParallelTerminationStrategy: PID 27267 died... 13:29:50.542440 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27267): Terminated: ok {rc=0} 13:29:50.631333 bus /sierra_3: Setting Powered False 13:29:51.727824 bus /sierra_3: Setting Powered False 13:29:52.843797 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:29:53.990523 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:54.002212 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:29:54.070851 tst mo_mt_call_osmux.py: using LAC 41224 13:29:54.191819 tst mo_mt_call_osmux.py: using RAC 169 13:29:54.311886 tst mo_mt_call_osmux.py: using CellId 41224 13:29:54.431723 tst mo_mt_call_osmux.py: using BVCI 41225 13:29:54.541099 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:54.552136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:54.563032 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:54.573862 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:54.584805 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:29:54.595652 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:29:54.714799 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:29:54.833220 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:29:55.299126 run create_hlr_db(pid=27270): Launched 13:29:55.422742 bus /sierra_2: Setting Powered False 13:29:56.486752 run create_hlr_db(pid=27270): Terminated: ok {rc=0} 13:29:56.917231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27272): Launched 13:29:57.217560 run osmo-hlr_10.42.42.2(pid=27273): Launched 13:29:57.332335 run osmo-stp_10.42.42.5: Starting osmo-stp 13:29:57.867823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27275): Launched 13:29:58.167823 run osmo-stp_10.42.42.5(pid=27276): Launched 13:29:58.282036 run osmo-msc_10.42.42.6: Starting osmo-msc 13:29:58.823641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27278): Launched 13:29:59.124321 run osmo-msc_10.42.42.6(pid=27279): Launched 13:29:59.291541 run osmo-stp_10.42.42.5(pid=27276): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27276)] 13:29:59.419667 run osmo-stp_10.42.42.5(pid=27276): stdout: | (launched: 2022-12-14_13:29:58.112819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:59.546679 run osmo-stp_10.42.42.5(pid=27276): stderr: | 20221214132958285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132958285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132958285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132958286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132958286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132958286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132958286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:59.671430 run osmo-stp_10.42.42.5(pid=27276): stdout: | (launched: 2022-12-14_13:29:58.112819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:29:59.790878 run osmo-stp_10.42.42.5(pid=27276): stderr: | 20221214132958285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214132958285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214132958285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214132958286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214132958286 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214132958286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214132958286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:29:59.933889 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27276): Process ended prematurely: osmo-stp_10.42.42.5(pid=27276) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27276)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:29:59.942607 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:29:59.968325 run osmo-hlr_10.42.42.2(pid=27273): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27273)] 13:30:00.015967 run osmo-hlr_10.42.42.2(pid=27273): stdout: | (launched: 2022-12-14_13:29:57.162823) 13:30:00.064708 run osmo-hlr_10.42.42.2(pid=27273): stderr: | 20221214132957343 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214132957343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214132957344 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214132957344 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214132957344 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214132957344 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214132957355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214132957363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214132957364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214132957364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:00.132725 run osmo-msc_10.42.42.6(pid=27279): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27279)] 13:30:00.179421 run osmo-msc_10.42.42.6(pid=27279): stdout: | (launched: 2022-12-14_13:29:59.069273) 13:30:00.228006 run osmo-msc_10.42.42.6(pid=27279): stderr: | 20221214132959342 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214132959342 DLGLOBAL DEBUG validating counter group 0x7f2f43bbac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214132959342 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214132959342 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214132959343 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214132959343 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214132959345 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214132959345 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214132959345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214132959345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:00.276684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27272): Terminating (SIGTERM) 13:30:00.315594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27275): Terminating (SIGTERM) 13:30:00.354412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27278): Terminating (SIGTERM) 13:30:00.393663 --- ParallelTerminationStrategy: PID 27272 died... 13:30:00.412535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27272): Terminated: ok {rc=0} 13:30:00.455902 --- ParallelTerminationStrategy: PID 27275 died... 13:30:00.474282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27275): Terminated: ok {rc=0} 13:30:00.517524 --- ParallelTerminationStrategy: PID 27278 died... 13:30:00.535898 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27278): Terminated: ok {rc=0} 13:30:00.620077 bus /sierra_3: Setting Powered False 13:30:01.726924 bus /sierra_3: Setting Powered False 13:30:02.845091 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:30:04.089064 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:30:04.095602 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:30:04.127258 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:30:04.153599 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:30:04.205565 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:30:04.239139 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:30:04.266669 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:30:04.813484 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:30:04.863156 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:04.874197 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:30:04.942299 tst mo_mt_call.py: using LAC 41225 13:30:05.060460 tst mo_mt_call.py: using RAC 170 13:30:05.181176 tst mo_mt_call.py: using CellId 41225 13:30:05.299944 tst mo_mt_call.py: using BVCI 41226 13:30:05.410011 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:05.421310 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:05.432010 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:05.442918 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:05.453783 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:05.464475 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:30:05.578484 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:30:05.698487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:06.165099 run create_hlr_db(pid=27287): Launched 13:30:06.287607 bus /sierra_2: Setting Powered False 13:30:07.351868 run create_hlr_db(pid=27287): Terminated: ok {rc=0} 13:30:07.802447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27289): Launched 13:30:08.125596 run osmo-hlr_10.42.42.2(pid=27290): Launched 13:30:08.248896 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:08.808281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27292): Launched 13:30:09.131728 run osmo-stp_10.42.42.5(pid=27293): Launched 13:30:09.254701 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:09.839580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27295): Launched 13:30:10.164236 run osmo-msc_10.42.42.6(pid=27296): Launched 13:30:10.344563 run osmo-stp_10.42.42.5(pid=27293): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27293)] 13:30:10.480916 run osmo-stp_10.42.42.5(pid=27293): stdout: | (launched: 2022-12-14_13:30:09.072933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:10.617737 run osmo-stp_10.42.42.5(pid=27293): stderr: | 20221214133009266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133009267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133009267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133009267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133009268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133009268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133009268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:10.754053 run osmo-stp_10.42.42.5(pid=27293): stdout: | (launched: 2022-12-14_13:30:09.072933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:10.882902 run osmo-stp_10.42.42.5(pid=27293): stderr: | 20221214133009266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133009267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133009267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133009267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133009268 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133009268 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133009268 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:11.037144 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27293): Process ended prematurely: osmo-stp_10.42.42.5(pid=27293) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27293)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:30:11.046644 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:30:11.074682 run osmo-hlr_10.42.42.2(pid=27290): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27290)] 13:30:11.125473 run osmo-hlr_10.42.42.2(pid=27290): stdout: | (launched: 2022-12-14_13:30:08.066697) 13:30:11.177297 run osmo-hlr_10.42.42.2(pid=27290): stderr: | 20221214133008265 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133008265 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133008265 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133008265 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133008265 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133008265 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133008278 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133008287 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133008287 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133008287 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:11.249773 run osmo-msc_10.42.42.6(pid=27296): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27296)] 13:30:11.299594 run osmo-msc_10.42.42.6(pid=27296): stdout: | (launched: 2022-12-14_13:30:10.105454) 13:30:11.351917 run osmo-msc_10.42.42.6(pid=27296): stderr: | 20221214133010428 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133010428 DLGLOBAL DEBUG validating counter group 0x7fbecf49ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133010428 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133010428 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133010428 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133010429 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133010431 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133010431 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133010431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133010431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:11.403760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27289): Terminating (SIGTERM) 13:30:11.445709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27292): Terminating (SIGTERM) 13:30:11.487730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27295): Terminating (SIGTERM) 13:30:11.530452 --- ParallelTerminationStrategy: PID 27289 died... 13:30:11.550774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27289): Terminated: ok {rc=0} 13:30:11.597263 --- ParallelTerminationStrategy: PID 27292 died... 13:30:11.617114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27292): Terminated: ok {rc=0} 13:30:11.663666 --- ParallelTerminationStrategy: PID 27295 died... 13:30:11.683537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27295): Terminated: ok {rc=0} 13:30:11.770890 bus /sierra_3: Setting Powered False 13:30:12.868861 bus /sierra_3: Setting Powered False 13:30:13.984200 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:30:15.129820 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:15.141375 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:30:15.210761 tst mo_mt_call_osmux.py: using LAC 41226 13:30:15.329785 tst mo_mt_call_osmux.py: using RAC 171 13:30:15.447537 tst mo_mt_call_osmux.py: using CellId 41226 13:30:15.568104 tst mo_mt_call_osmux.py: using BVCI 41227 13:30:15.678784 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:15.689802 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:15.700501 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:15.711225 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:15.722200 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:30:15.732875 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:30:15.859108 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:30:15.999297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:16.528103 run create_hlr_db(pid=27298): Launched 13:30:16.710248 bus /sierra_2: Setting Powered False 13:30:17.774616 run create_hlr_db(pid=27298): Terminated: ok {rc=0} 13:30:18.240761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27300): Launched 13:30:18.542690 run osmo-hlr_10.42.42.2(pid=27301): Launched 13:30:18.656837 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:19.192187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27303): Launched 13:30:19.493679 run osmo-stp_10.42.42.5(pid=27304): Launched 13:30:19.609525 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:20.153587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27306): Launched 13:30:20.453727 run osmo-msc_10.42.42.6(pid=27307): Launched 13:30:20.621355 run osmo-stp_10.42.42.5(pid=27304): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27304)] 13:30:20.747765 run osmo-stp_10.42.42.5(pid=27304): stdout: | (launched: 2022-12-14_13:30:19.438728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:20.874735 run osmo-stp_10.42.42.5(pid=27304): stderr: | 20221214133019610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133019610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133019610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133019610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133019611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133019611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133019611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:20.999409 run osmo-stp_10.42.42.5(pid=27304): stdout: | (launched: 2022-12-14_13:30:19.438728) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:21.118712 run osmo-stp_10.42.42.5(pid=27304): stderr: | 20221214133019610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133019610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133019610 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133019610 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133019611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133019611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133019611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:21.261747 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27304): Process ended prematurely: osmo-stp_10.42.42.5(pid=27304) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27304)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:30:21.270388 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:30:21.296408 run osmo-hlr_10.42.42.2(pid=27301): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27301)] 13:30:21.343314 run osmo-hlr_10.42.42.2(pid=27301): stdout: | (launched: 2022-12-14_13:30:18.487478) 13:30:21.392672 run osmo-hlr_10.42.42.2(pid=27301): stderr: | 20221214133018665 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133018665 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133018666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133018666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133018666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133018666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133018678 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133018687 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133018688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133018688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:21.460828 run osmo-msc_10.42.42.6(pid=27307): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27307)] 13:30:21.507710 run osmo-msc_10.42.42.6(pid=27307): stdout: | (launched: 2022-12-14_13:30:20.398598) 13:30:21.556543 run osmo-msc_10.42.42.6(pid=27307): stderr: | 20221214133020669 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133020670 DLGLOBAL DEBUG validating counter group 0x7f87d9ff8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133020670 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133020670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133020670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133020670 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133020672 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133020672 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133020672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133020672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:21.605738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27300): Terminating (SIGTERM) 13:30:21.644568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27303): Terminating (SIGTERM) 13:30:21.683760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27306): Terminating (SIGTERM) 13:30:21.723210 --- ParallelTerminationStrategy: PID 27300 died... 13:30:21.742045 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27300): Terminated: ok {rc=0} 13:30:21.785448 --- ParallelTerminationStrategy: PID 27303 died... 13:30:21.803688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27303): Terminated: ok {rc=0} 13:30:21.847285 --- ParallelTerminationStrategy: PID 27306 died... 13:30:21.865700 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27306): Terminated: ok {rc=0} 13:30:21.950889 bus /sierra_3: Setting Powered False 13:30:23.050757 bus /sierra_3: Setting Powered False 13:30:24.164375 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:30:25.406794 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:30:25.413230 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:30:25.445110 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:30:25.471491 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:30:25.523105 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:30:25.556187 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:30:25.583521 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:30:26.130732 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:30:26.179137 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:26.190453 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:30:26.271719 tst mo_mt_call.py: using LAC 41227 13:30:26.395040 tst mo_mt_call.py: using RAC 172 13:30:26.525652 tst mo_mt_call.py: using CellId 41227 13:30:26.653143 tst mo_mt_call.py: using BVCI 41228 13:30:26.770527 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:26.782062 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:26.793538 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:26.804766 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:26.816527 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:26.828138 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:30:26.943619 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:30:27.063852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:27.565092 run create_hlr_db(pid=27312): Launched 13:30:27.689330 bus /sierra_2: Setting Powered False 13:30:28.753950 run create_hlr_db(pid=27312): Terminated: ok {rc=0} 13:30:29.185860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27314): Launched 13:30:29.488111 run osmo-hlr_10.42.42.2(pid=27315): Launched 13:30:29.604616 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:30.125128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27317): Launched 13:30:30.427607 run osmo-stp_10.42.42.5(pid=27318): Launched 13:30:30.543255 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:31.122339 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27320): Launched 13:30:31.509706 run osmo-msc_10.42.42.6(pid=27321): Launched 13:30:31.708586 run osmo-stp_10.42.42.5(pid=27318): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27318)] 13:30:31.904341 run osmo-stp_10.42.42.5(pid=27318): stdout: | (launched: 2022-12-14_13:30:30.371980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:32.102931 run osmo-stp_10.42.42.5(pid=27318): stderr: | 20221214133030543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133030544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133030544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133030544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133030545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133030545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133030545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:32.366532 run osmo-stp_10.42.42.5(pid=27318): stdout: | (launched: 2022-12-14_13:30:30.371980) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:32.496831 run osmo-stp_10.42.42.5(pid=27318): stderr: | 20221214133030543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133030544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133030544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133030544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133030545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133030545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133030545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:32.642458 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27318): Process ended prematurely: osmo-stp_10.42.42.5(pid=27318) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27318)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:30:32.651285 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:30:32.678025 run osmo-hlr_10.42.42.2(pid=27315): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27315)] 13:30:32.726622 run osmo-hlr_10.42.42.2(pid=27315): stdout: | (launched: 2022-12-14_13:30:29.432920) 13:30:32.776801 run osmo-hlr_10.42.42.2(pid=27315): stderr: | 20221214133029606 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133029606 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133029606 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133029606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133029606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133029606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133029618 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133029626 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133029626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133029626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:32.846519 run osmo-msc_10.42.42.6(pid=27321): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27321)] 13:30:32.894613 run osmo-msc_10.42.42.6(pid=27321): stdout: | (launched: 2022-12-14_13:30:31.440202) 13:30:32.944636 run osmo-msc_10.42.42.6(pid=27321): stderr: | 20221214133032084 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133032084 DLGLOBAL DEBUG validating counter group 0x7f1816daac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133032084 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133032084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133032086 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133032087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133032088 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133032094 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133032094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133032094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:32.994802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27314): Terminating (SIGTERM) 13:30:33.034875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27317): Terminating (SIGTERM) 13:30:33.074861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27320): Terminating (SIGTERM) 13:30:33.115156 --- ParallelTerminationStrategy: PID 27314 died... 13:30:33.134943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27314): Terminated: ok {rc=0} 13:30:33.179484 --- ParallelTerminationStrategy: PID 27317 died... 13:30:33.198358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27317): Terminated: ok {rc=0} 13:30:33.242515 --- ParallelTerminationStrategy: PID 27320 died... 13:30:33.261304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27320): Terminated: ok {rc=0} 13:30:33.347153 bus /sierra_3: Setting Powered False 13:30:34.446542 bus /sierra_3: Setting Powered False 13:30:35.558734 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:30:36.708037 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:36.720167 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:30:36.794948 tst mo_mt_call_osmux.py: using LAC 41228 13:30:36.920449 tst mo_mt_call_osmux.py: using RAC 173 13:30:37.045672 tst mo_mt_call_osmux.py: using CellId 41228 13:30:37.163683 tst mo_mt_call_osmux.py: using BVCI 41229 13:30:37.273522 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:37.284708 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:37.295707 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:37.306761 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:37.318296 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:30:37.329790 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:30:37.449512 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:30:37.572159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:38.074728 run create_hlr_db(pid=27323): Launched 13:30:38.199382 bus /sierra_2: Setting Powered False 13:30:39.262629 run create_hlr_db(pid=27323): Terminated: ok {rc=0} 13:30:39.712936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27325): Launched 13:30:40.037021 run osmo-hlr_10.42.42.2(pid=27326): Launched 13:30:40.162019 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:40.721493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27328): Launched 13:30:41.044407 run osmo-stp_10.42.42.5(pid=27329): Launched 13:30:41.168546 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:41.752552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27331): Launched 13:30:42.078645 run osmo-msc_10.42.42.6(pid=27332): Launched 13:30:42.258941 run osmo-stp_10.42.42.5(pid=27329): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27329)] 13:30:42.395400 run osmo-stp_10.42.42.5(pid=27329): stdout: | (launched: 2022-12-14_13:30:40.985824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:42.532396 run osmo-stp_10.42.42.5(pid=27329): stderr: | 20221214133041177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133041177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133041177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133041178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133041178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133041178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133041178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:42.668185 run osmo-stp_10.42.42.5(pid=27329): stdout: | (launched: 2022-12-14_13:30:40.985824) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:42.797366 run osmo-stp_10.42.42.5(pid=27329): stderr: | 20221214133041177 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133041177 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133041177 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133041178 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133041178 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133041178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133041178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:42.952066 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27329): Process ended prematurely: osmo-stp_10.42.42.5(pid=27329) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27329)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:30:42.961619 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:30:42.989192 run osmo-hlr_10.42.42.2(pid=27326): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27326)] 13:30:43.039666 run osmo-hlr_10.42.42.2(pid=27326): stdout: | (launched: 2022-12-14_13:30:39.978135) 13:30:43.092174 run osmo-hlr_10.42.42.2(pid=27326): stderr: | 20221214133040175 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133040175 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133040175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133040175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133040176 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133040176 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133040188 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133040196 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133040196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133040196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:43.164444 run osmo-msc_10.42.42.6(pid=27332): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27332)] 13:30:43.213945 run osmo-msc_10.42.42.6(pid=27332): stdout: | (launched: 2022-12-14_13:30:42.019994) 13:30:43.265384 run osmo-msc_10.42.42.6(pid=27332): stderr: | 20221214133042340 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133042340 DLGLOBAL DEBUG validating counter group 0x7fb21cf82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133042340 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133042340 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133042341 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133042341 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133042342 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133042343 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133042343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133042343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:43.317817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27325): Terminating (SIGTERM) 13:30:43.359239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27328): Terminating (SIGTERM) 13:30:43.401359 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27331): Terminating (SIGTERM) 13:30:43.443434 --- ParallelTerminationStrategy: PID 27325 died... 13:30:43.463611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27325): Terminated: ok {rc=0} 13:30:43.509933 --- ParallelTerminationStrategy: PID 27328 died... 13:30:43.529602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27328): Terminated: ok {rc=0} 13:30:43.575597 --- ParallelTerminationStrategy: PID 27331 died... 13:30:43.595367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27331): Terminated: ok {rc=0} 13:30:43.682335 bus /sierra_3: Setting Powered False 13:30:44.780126 bus /sierra_3: Setting Powered False 13:30:45.909322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:30:47.188103 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:30:47.195208 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:30:47.228763 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:30:47.255831 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:30:47.306804 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:30:47.338976 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:30:47.364839 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:30:47.918795 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:30:47.971409 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:47.983042 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:30:48.052464 tst mo_mt_call.py: using LAC 41229 13:30:48.179228 tst mo_mt_call.py: using RAC 174 13:30:48.306372 tst mo_mt_call.py: using CellId 41229 13:30:48.434407 tst mo_mt_call.py: using BVCI 41230 13:30:48.551522 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:48.563018 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:48.574278 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:48.585517 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:48.597194 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:48.608680 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:30:48.724104 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:30:48.844516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:49.345529 run create_hlr_db(pid=27337): Launched 13:30:49.468447 bus /sierra_2: Setting Powered False 13:30:50.532688 run create_hlr_db(pid=27337): Terminated: ok {rc=0} 13:30:50.963795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27339): Launched 13:30:51.265694 run osmo-hlr_10.42.42.2(pid=27340): Launched 13:30:51.379654 run osmo-stp_10.42.42.5: Starting osmo-stp 13:30:51.897406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27342): Launched 13:30:52.198567 run osmo-stp_10.42.42.5(pid=27347): Launched 13:30:52.312249 run osmo-msc_10.42.42.6: Starting osmo-msc 13:30:52.854710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27349): Launched 13:30:53.155381 run osmo-msc_10.42.42.6(pid=27350): Launched 13:30:53.323598 run osmo-stp_10.42.42.5(pid=27347): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27347)] 13:30:53.451057 run osmo-stp_10.42.42.5(pid=27347): stdout: | (launched: 2022-12-14_13:30:52.143786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:53.577996 run osmo-stp_10.42.42.5(pid=27347): stderr: | 20221214133052313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133052313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133052314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133052314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133052316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133052316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133052316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:53.705352 run osmo-stp_10.42.42.5(pid=27347): stdout: | (launched: 2022-12-14_13:30:52.143786) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:30:53.826019 run osmo-stp_10.42.42.5(pid=27347): stderr: | 20221214133052313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133052313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133052314 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133052314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133052316 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133052316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133052316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:30:53.969512 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27347): Process ended prematurely: osmo-stp_10.42.42.5(pid=27347) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27347)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:30:53.978251 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:30:54.004400 run osmo-hlr_10.42.42.2(pid=27340): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27340)] 13:30:54.051973 run osmo-hlr_10.42.42.2(pid=27340): stdout: | (launched: 2022-12-14_13:30:51.210352) 13:30:54.101532 run osmo-hlr_10.42.42.2(pid=27340): stderr: | 20221214133051388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133051388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133051388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133051388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133051388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133051388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133051400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133051410 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133051411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133051411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:30:54.170478 run osmo-msc_10.42.42.6(pid=27350): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27350)] 13:30:54.218130 run osmo-msc_10.42.42.6(pid=27350): stdout: | (launched: 2022-12-14_13:30:53.100267) 13:30:54.267269 run osmo-msc_10.42.42.6(pid=27350): stderr: | 20221214133053373 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133053373 DLGLOBAL DEBUG validating counter group 0x7f921ca97c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133053373 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133053373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133053373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133053373 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133053375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133053375 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133053376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133053376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:30:54.317361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27339): Terminating (SIGTERM) 13:30:54.357144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27342): Terminating (SIGTERM) 13:30:54.396663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27349): Terminating (SIGTERM) 13:30:54.436518 --- ParallelTerminationStrategy: PID 27339 died... 13:30:54.455691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27339): Terminated: ok {rc=0} 13:30:54.499661 --- ParallelTerminationStrategy: PID 27342 died... 13:30:54.518448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27342): Terminated: ok {rc=0} 13:30:54.562290 --- ParallelTerminationStrategy: PID 27349 died... 13:30:54.580891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27349): Terminated: ok {rc=0} 13:30:54.666037 bus /sierra_3: Setting Powered False 13:30:55.767060 bus /sierra_3: Setting Powered False 13:30:56.884694 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:30:58.035170 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:58.047340 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:30:58.118270 tst mo_mt_call_osmux.py: using LAC 41230 13:30:58.244200 tst mo_mt_call_osmux.py: using RAC 175 13:30:58.370196 tst mo_mt_call_osmux.py: using CellId 41230 13:30:58.495993 tst mo_mt_call_osmux.py: using BVCI 41231 13:30:58.615105 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:58.626602 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:58.637865 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:58.649128 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:58.660753 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:30:58.672349 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:30:58.789276 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:30:58.907489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:30:59.409533 run create_hlr_db(pid=27352): Launched 13:30:59.532595 bus /sierra_2: Setting Powered False 13:31:00.596839 run create_hlr_db(pid=27352): Terminated: ok {rc=0} 13:31:01.065847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27354): Launched 13:31:01.383493 run osmo-hlr_10.42.42.2(pid=27355): Launched 13:31:01.564886 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:02.324488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27357): Launched 13:31:02.633018 run osmo-stp_10.42.42.5(pid=27358): Launched 13:31:02.747776 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:03.294579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27360): Launched 13:31:03.596339 run osmo-msc_10.42.42.6(pid=27361): Launched 13:31:03.765737 run osmo-stp_10.42.42.5(pid=27358): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27358)] 13:31:03.894420 run osmo-stp_10.42.42.5(pid=27358): stdout: | (launched: 2022-12-14_13:31:02.577522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:04.022053 run osmo-stp_10.42.42.5(pid=27358): stderr: | 20221214133102749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133102750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133102750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133102751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133102751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133102751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133102751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:04.147716 run osmo-stp_10.42.42.5(pid=27358): stdout: | (launched: 2022-12-14_13:31:02.577522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:04.267591 run osmo-stp_10.42.42.5(pid=27358): stderr: | 20221214133102749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133102750 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133102750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133102751 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133102751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133102751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133102751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:04.411270 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27358): Process ended prematurely: osmo-stp_10.42.42.5(pid=27358) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27358)] [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:31:04.420088 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:31:04.446315 run osmo-hlr_10.42.42.2(pid=27355): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27355)] 13:31:04.493943 run osmo-hlr_10.42.42.2(pid=27355): stdout: | (launched: 2022-12-14_13:31:01.320494) 13:31:04.543419 run osmo-hlr_10.42.42.2(pid=27355): stderr: | 20221214133101708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133101708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133101708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133101708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133101708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133101708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133101734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133101761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133101761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133101762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:04.612357 run osmo-msc_10.42.42.6(pid=27361): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27361)] 13:31:04.659820 run osmo-msc_10.42.42.6(pid=27361): stdout: | (launched: 2022-12-14_13:31:03.541052) 13:31:04.708909 run osmo-msc_10.42.42.6(pid=27361): stderr: | 20221214133103813 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133103813 DLGLOBAL DEBUG validating counter group 0x7fcb3a3d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133103813 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133103813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133103814 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133103814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133103815 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133103816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133103816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133103816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:04.758375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27354): Terminating (SIGTERM) 13:31:04.797965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27357): Terminating (SIGTERM) 13:31:04.837414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27360): Terminating (SIGTERM) 13:31:04.877205 --- ParallelTerminationStrategy: PID 27354 died... 13:31:04.896361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27354): Terminated: ok {rc=0} 13:31:04.940763 --- ParallelTerminationStrategy: PID 27357 died... 13:31:04.959391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27357): Terminated: ok {rc=0} 13:31:05.003095 --- ParallelTerminationStrategy: PID 27360 died... 13:31:05.021743 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27360): Terminated: ok {rc=0} 13:31:05.107117 bus /sierra_3: Setting Powered False 13:31:06.208407 bus /sierra_3: Setting Powered False 13:31:07.324254 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:31:08.579638 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:08.586620 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:31:08.619661 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:31:08.647718 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:31:08.702232 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:31:08.734217 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:31:08.760362 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:31:09.308684 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:31:09.357449 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:09.368530 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:31:09.436359 tst mo_mt_call.py: using LAC 41231 13:31:09.554692 tst mo_mt_call.py: using RAC 176 13:31:09.675606 tst mo_mt_call.py: using CellId 41231 13:31:09.795996 tst mo_mt_call.py: using BVCI 41232 13:31:09.907099 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:09.918187 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:09.929195 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:09.940221 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:09.951233 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:09.962107 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:31:10.081674 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:31:10.201238 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:10.702919 run create_hlr_db(pid=27366): Launched 13:31:10.826600 bus /sierra_2: Setting Powered False 13:31:11.890253 run create_hlr_db(pid=27366): Terminated: ok {rc=0} 13:31:12.341339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27368): Launched 13:31:12.664513 run osmo-hlr_10.42.42.2(pid=27369): Launched 13:31:12.788771 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:13.349056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27371): Launched 13:31:13.671966 run osmo-stp_10.42.42.5(pid=27372): Launched 13:31:13.795805 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:14.380582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27375): Launched 13:31:14.703249 run osmo-msc_10.42.42.6(pid=27376): Launched 13:31:14.883287 run osmo-stp_10.42.42.5(pid=27372): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27372)] 13:31:15.020602 run osmo-stp_10.42.42.5(pid=27372): stdout: | (launched: 2022-12-14_13:31:13.613421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:15.158926 run osmo-stp_10.42.42.5(pid=27372): stderr: | 20221214133113806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133113806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133113806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133113807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133113809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133113809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133113809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:15.295729 run osmo-stp_10.42.42.5(pid=27372): stdout: | (launched: 2022-12-14_13:31:13.613421) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:15.425204 run osmo-stp_10.42.42.5(pid=27372): stderr: | 20221214133113806 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133113806 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133113806 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133113807 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133113809 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133113809 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133113809 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:15.580141 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27372): Process ended prematurely: osmo-stp_10.42.42.5(pid=27372) [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27372)] [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:31:15.589717 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:31:15.617209 run osmo-hlr_10.42.42.2(pid=27369): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27369)] 13:31:15.667618 run osmo-hlr_10.42.42.2(pid=27369): stdout: | (launched: 2022-12-14_13:31:12.605703) 13:31:15.719137 run osmo-hlr_10.42.42.2(pid=27369): stderr: | 20221214133112805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133112805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133112805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133112806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133112806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133112806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133112817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133112825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133112826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133112826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:15.791575 run osmo-msc_10.42.42.6(pid=27376): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27376)] 13:31:15.847281 run osmo-msc_10.42.42.6(pid=27376): stdout: | (launched: 2022-12-14_13:31:14.644541) 13:31:15.903994 run osmo-msc_10.42.42.6(pid=27376): stderr: | 20221214133114965 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133114965 DLGLOBAL DEBUG validating counter group 0x7f44afebbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133114965 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133114965 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133114966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133114966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133114967 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133114968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133114968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133114968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:15.958079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27368): Terminating (SIGTERM) 13:31:16.001079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27371): Terminating (SIGTERM) 13:31:16.045175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27375): Terminating (SIGTERM) 13:31:16.090976 --- ParallelTerminationStrategy: PID 27368 died... 13:31:16.113291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27368): Terminated: ok {rc=0} 13:31:16.162067 --- ParallelTerminationStrategy: PID 27371 died... 13:31:16.183681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27371): Terminated: ok {rc=0} 13:31:16.232347 --- ParallelTerminationStrategy: PID 27375 died... 13:31:16.254115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27375): Terminated: ok {rc=0} 13:31:16.346133 bus /sierra_3: Setting Powered False 13:31:17.441182 bus /sierra_3: Setting Powered False 13:31:18.556223 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:31:19.706625 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:19.719065 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:31:19.790635 tst mo_mt_call_osmux.py: using LAC 41232 13:31:19.916625 tst mo_mt_call_osmux.py: using RAC 177 13:31:20.042489 tst mo_mt_call_osmux.py: using CellId 41232 13:31:20.170889 tst mo_mt_call_osmux.py: using BVCI 41233 13:31:20.289804 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.301504 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.312825 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.324225 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.336044 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:31:20.347793 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:31:20.464132 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:31:20.582570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:21.086499 run create_hlr_db(pid=27378): Launched 13:31:21.210047 bus /sierra_2: Setting Powered False 13:31:22.274694 run create_hlr_db(pid=27378): Terminated: ok {rc=0} 13:31:22.709262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27380): Launched 13:31:23.012431 run osmo-hlr_10.42.42.2(pid=27381): Launched 13:31:23.127739 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:23.652745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27383): Launched 13:31:23.983660 run osmo-stp_10.42.42.5(pid=27384): Launched 13:31:24.107311 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:24.694182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27386): Launched 13:31:25.017971 run osmo-msc_10.42.42.6(pid=27387): Launched 13:31:25.198288 run osmo-stp_10.42.42.5(pid=27384): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27384)] 13:31:25.334938 run osmo-stp_10.42.42.5(pid=27384): stdout: | (launched: 2022-12-14_13:31:23.924676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:25.472532 run osmo-stp_10.42.42.5(pid=27384): stderr: | 20221214133124117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133124117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133124118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133124118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133124120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133124120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133124120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:25.609382 run osmo-stp_10.42.42.5(pid=27384): stdout: | (launched: 2022-12-14_13:31:23.924676) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:25.738998 run osmo-stp_10.42.42.5(pid=27384): stderr: | 20221214133124117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133124117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133124118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133124118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133124120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133124120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133124120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:25.894178 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27384): Process ended prematurely: osmo-stp_10.42.42.5(pid=27384) [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27384)] [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:31:25.903655 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:31:25.931296 run osmo-hlr_10.42.42.2(pid=27381): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27381)] 13:31:25.981904 run osmo-hlr_10.42.42.2(pid=27381): stdout: | (launched: 2022-12-14_13:31:22.957167) 13:31:26.034210 run osmo-hlr_10.42.42.2(pid=27381): stderr: | 20221214133123134 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133123134 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133123134 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133123134 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133123134 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133123134 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133123150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133123160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133123161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133123161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:26.107597 run osmo-msc_10.42.42.6(pid=27387): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27387)] 13:31:26.157554 run osmo-msc_10.42.42.6(pid=27387): stdout: | (launched: 2022-12-14_13:31:24.958805) 13:31:26.209519 run osmo-msc_10.42.42.6(pid=27387): stderr: | 20221214133125278 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133125278 DLGLOBAL DEBUG validating counter group 0x7fc58c838c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133125278 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133125278 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133125279 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133125279 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133125281 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133125282 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133125282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133125282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:26.261819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27380): Terminating (SIGTERM) 13:31:26.303702 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27383): Terminating (SIGTERM) 13:31:26.346015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27386): Terminating (SIGTERM) 13:31:26.388552 --- ParallelTerminationStrategy: PID 27380 died... 13:31:26.409113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27380): Terminated: ok {rc=0} 13:31:26.455773 --- ParallelTerminationStrategy: PID 27383 died... 13:31:26.475544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27383): Terminated: ok {rc=0} 13:31:26.522290 --- ParallelTerminationStrategy: PID 27386 died... 13:31:26.542224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27386): Terminated: ok {rc=0} 13:31:26.631039 bus /sierra_3: Setting Powered False 13:31:27.730058 bus /sierra_3: Setting Powered False 13:31:28.846746 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:31:30.099441 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:30.105602 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:31:30.139335 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:31:30.167271 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:31:30.226097 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:31:30.259345 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:31:30.286454 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:31:30.832245 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:31:30.897108 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:30.910085 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:31:30.992678 tst mo_mt_call.py: using LAC 41233 13:31:31.125356 tst mo_mt_call.py: using RAC 178 13:31:31.244075 tst mo_mt_call.py: using CellId 41233 13:31:31.404117 tst mo_mt_call.py: using BVCI 41234 13:31:31.524401 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:31.536768 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:31.548607 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:31.560463 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:31.573300 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:31.586044 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:31:31.729284 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:31:31.879400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:32.363472 run create_hlr_db(pid=27392): Launched 13:31:32.487017 bus /sierra_2: Setting Powered False 13:31:33.551309 run create_hlr_db(pid=27392): Terminated: ok {rc=0} 13:31:34.003879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27394): Launched 13:31:34.329568 run osmo-hlr_10.42.42.2(pid=27395): Launched 13:31:34.454384 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:35.012178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27397): Launched 13:31:35.337427 run osmo-stp_10.42.42.5(pid=27398): Launched 13:31:35.461420 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:36.047704 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27400): Launched 13:31:36.373291 run osmo-msc_10.42.42.6(pid=27401): Launched 13:31:36.554281 run osmo-stp_10.42.42.5(pid=27398): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27398)] 13:31:36.691899 run osmo-stp_10.42.42.5(pid=27398): stdout: | (launched: 2022-12-14_13:31:35.278235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:36.830325 run osmo-stp_10.42.42.5(pid=27398): stderr: | 20221214133135472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133135472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133135473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133135473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133135473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133135473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133135473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:36.967473 run osmo-stp_10.42.42.5(pid=27398): stdout: | (launched: 2022-12-14_13:31:35.278235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:37.097512 run osmo-stp_10.42.42.5(pid=27398): stderr: | 20221214133135472 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133135472 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133135473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133135473 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133135473 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133135473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133135473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:37.253725 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27398): Process ended prematurely: osmo-stp_10.42.42.5(pid=27398) [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27398)] [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:31:37.263166 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 13:31:37.291064 run osmo-hlr_10.42.42.2(pid=27395): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27395)] 13:31:37.342238 run osmo-hlr_10.42.42.2(pid=27395): stdout: | (launched: 2022-12-14_13:31:34.270926) 13:31:37.395064 run osmo-hlr_10.42.42.2(pid=27395): stderr: | 20221214133134471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133134471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133134471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133134471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133134471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133134471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133134483 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133134491 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133134492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133134492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:37.468200 run osmo-msc_10.42.42.6(pid=27401): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27401)] 13:31:37.518725 run osmo-msc_10.42.42.6(pid=27401): stdout: | (launched: 2022-12-14_13:31:36.314236) 13:31:37.571326 run osmo-msc_10.42.42.6(pid=27401): stderr: | 20221214133136634 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133136634 DLGLOBAL DEBUG validating counter group 0x7fbb5ce39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133136634 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133136635 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133136635 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133136635 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133136637 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133136637 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133136637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133136637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:37.623942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27394): Terminating (SIGTERM) 13:31:37.665946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27397): Terminating (SIGTERM) 13:31:37.708218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27400): Terminating (SIGTERM) 13:31:37.750966 --- ParallelTerminationStrategy: PID 27394 died... 13:31:37.771479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27394): Terminated: ok {rc=0} 13:31:37.818606 --- ParallelTerminationStrategy: PID 27397 died... 13:31:37.839076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27397): Terminated: ok {rc=0} 13:31:37.885815 --- ParallelTerminationStrategy: PID 27400 died... 13:31:37.905891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27400): Terminated: ok {rc=0} 13:31:37.993883 bus /sierra_3: Setting Powered False 13:31:39.093940 bus /sierra_3: Setting Powered False 13:31:40.210365 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:31:41.360408 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:41.372428 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:31:41.444396 tst mo_mt_call_osmux.py: using LAC 41234 13:31:41.570754 tst mo_mt_call_osmux.py: using RAC 179 13:31:41.696679 tst mo_mt_call_osmux.py: using CellId 41234 13:31:41.822262 tst mo_mt_call_osmux.py: using BVCI 41235 13:31:41.941591 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:41.952913 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:41.964070 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:41.975139 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:41.986556 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:31:41.998098 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:31:42.116698 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:31:42.233155 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:42.735826 run create_hlr_db(pid=27403): Launched 13:31:42.859898 bus /sierra_2: Setting Powered False 13:31:43.924845 run create_hlr_db(pid=27403): Terminated: ok {rc=0} 13:31:44.359519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27405): Launched 13:31:44.661413 run osmo-hlr_10.42.42.2(pid=27406): Launched 13:31:44.776896 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:45.316052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27408): Launched 13:31:45.617509 run osmo-stp_10.42.42.5(pid=27409): Launched 13:31:45.733291 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:46.345802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27411): Launched 13:31:46.666996 run osmo-msc_10.42.42.6(pid=27412): Launched 13:31:47.092817 run osmo-stp_10.42.42.5(pid=27409): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27409)] 13:31:47.309799 run osmo-stp_10.42.42.5(pid=27409): stdout: | (launched: 2022-12-14_13:31:45.562123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:47.445656 run osmo-stp_10.42.42.5(pid=27409): stderr: | 20221214133145734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133145734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133145734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133145735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133145735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133145735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133145735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:47.581343 run osmo-stp_10.42.42.5(pid=27409): stdout: | (launched: 2022-12-14_13:31:45.562123) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:47.711532 run osmo-stp_10.42.42.5(pid=27409): stderr: | 20221214133145734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133145734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133145734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133145735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133145735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133145735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133145735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:47.868070 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27409): Process ended prematurely: osmo-stp_10.42.42.5(pid=27409) [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27409)] [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:31:47.877613 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 13:31:47.905655 run osmo-hlr_10.42.42.2(pid=27406): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27406)] 13:31:47.957131 run osmo-hlr_10.42.42.2(pid=27406): stdout: | (launched: 2022-12-14_13:31:44.606423) 13:31:48.009856 run osmo-hlr_10.42.42.2(pid=27406): stderr: | 20221214133144783 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133144784 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133144784 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133144784 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133144784 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133144784 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133144795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133144804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133144804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133144804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:48.083133 run osmo-msc_10.42.42.6(pid=27412): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27412)] 13:31:48.134134 run osmo-msc_10.42.42.6(pid=27412): stdout: | (launched: 2022-12-14_13:31:46.605604) 13:31:48.187085 run osmo-msc_10.42.42.6(pid=27412): stderr: | 20221214133146963 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133146963 DLGLOBAL DEBUG validating counter group 0x7f8b739a4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133146963 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133146963 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133146964 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133146964 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133146978 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133146978 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133146978 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133146978 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:48.240275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27405): Terminating (SIGTERM) 13:31:48.283428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27408): Terminating (SIGTERM) 13:31:48.326295 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27411): Terminating (SIGTERM) 13:31:48.369254 --- ParallelTerminationStrategy: PID 27405 died... 13:31:48.389748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27405): Terminated: ok {rc=0} 13:31:48.436938 --- ParallelTerminationStrategy: PID 27408 died... 13:31:48.457182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27408): Terminated: ok {rc=0} 13:31:48.504077 --- ParallelTerminationStrategy: PID 27411 died... 13:31:48.524163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27411): Terminated: ok {rc=0} 13:31:48.613813 bus /sierra_3: Setting Powered False 13:31:49.712610 bus /sierra_3: Setting Powered False 13:31:50.830076 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:31:52.081418 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:31:52.087425 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:31:52.119138 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 13:31:52.146348 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 13:31:52.196263 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:31:52.229510 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 13:31:52.256888 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 13:31:52.806715 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 13:31:52.855573 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:31:52.867016 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:31:52.916318 tst mo_mt_call.py: using LAC 41235 13:31:53.032841 tst mo_mt_call.py: using RAC 180 13:31:53.149810 tst mo_mt_call.py: using CellId 41235 13:31:53.266820 tst mo_mt_call.py: using BVCI 41236 13:31:53.375773 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:31:53.387056 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:31:53.398124 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:31:53.409053 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:31:53.420062 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:31:53.431096 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:31:53.551541 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:31:53.666360 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:31:54.135264 run create_hlr_db(pid=27417): Launched 13:31:54.257905 bus /sierra_2: Setting Powered False 13:31:55.318224 run create_hlr_db(pid=27417): Terminated: ok {rc=0} 13:31:55.739490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27419): Launched 13:31:56.041715 run osmo-hlr_10.42.42.2(pid=27420): Launched 13:31:56.157111 run osmo-stp_10.42.42.5: Starting osmo-stp 13:31:56.692014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27422): Launched 13:31:56.993643 run osmo-stp_10.42.42.5(pid=27423): Launched 13:31:57.108748 run osmo-msc_10.42.42.6: Starting osmo-msc 13:31:57.654281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27425): Launched 13:31:57.955461 run osmo-msc_10.42.42.6(pid=27426): Launched 13:31:58.124275 run osmo-stp_10.42.42.5(pid=27423): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27423)] 13:31:58.251910 run osmo-stp_10.42.42.5(pid=27423): stdout: | (launched: 2022-12-14_13:31:56.938233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:58.380622 run osmo-stp_10.42.42.5(pid=27423): stderr: | 20221214133157110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133157110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133157110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133157110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133157111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133157111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133157111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:58.506382 run osmo-stp_10.42.42.5(pid=27423): stdout: | (launched: 2022-12-14_13:31:56.938233) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:31:58.626558 run osmo-stp_10.42.42.5(pid=27423): stderr: | 20221214133157110 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133157110 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133157110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133157110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133157111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133157111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133157111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:31:58.770772 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27423): Process ended prematurely: osmo-stp_10.42.42.5(pid=27423) [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27423)] [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 13:31:58.779446 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:31:58.805507 run osmo-hlr_10.42.42.2(pid=27420): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27420)] 13:31:58.852688 run osmo-hlr_10.42.42.2(pid=27420): stdout: | (launched: 2022-12-14_13:31:55.986437) 13:31:58.901486 run osmo-hlr_10.42.42.2(pid=27420): stderr: | 20221214133156163 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133156163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133156164 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133156164 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133156164 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133156164 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133156176 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133156185 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133156185 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133156185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:31:58.969941 run osmo-msc_10.42.42.6(pid=27426): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27426)] 13:31:59.017087 run osmo-msc_10.42.42.6(pid=27426): stdout: | (launched: 2022-12-14_13:31:57.900131) 13:31:59.065696 run osmo-msc_10.42.42.6(pid=27426): stderr: | 20221214133158171 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133158171 DLGLOBAL DEBUG validating counter group 0x7f128f31cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133158171 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133158171 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133158171 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133158171 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133158173 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133158174 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133158174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133158174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:31:59.114688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27419): Terminating (SIGTERM) 13:31:59.154469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27422): Terminating (SIGTERM) 13:31:59.193590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27425): Terminating (SIGTERM) 13:31:59.233133 --- ParallelTerminationStrategy: PID 27419 died... 13:31:59.251983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27419): Terminated: ok {rc=0} 13:31:59.295604 --- ParallelTerminationStrategy: PID 27422 died... 13:31:59.314068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27422): Terminated: ok {rc=0} 13:31:59.357271 --- ParallelTerminationStrategy: PID 27425 died... 13:31:59.375669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27425): Terminated: ok {rc=0} 13:31:59.460394 bus /sierra_3: Setting Powered False 13:32:00.559952 bus /sierra_3: Setting Powered False 13:32:01.674899 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 13:32:02.818005 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:32:02.830010 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:32:02.881530 tst mo_mt_call_osmux.py: using LAC 41236 13:32:03.011858 tst mo_mt_call_osmux.py: using RAC 181 13:32:03.140299 tst mo_mt_call_osmux.py: using CellId 41236 13:32:03.267624 tst mo_mt_call_osmux.py: using BVCI 41237 13:32:03.386356 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:32:03.398106 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:32:03.409808 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:32:03.421869 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:32:03.434041 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 13:32:03.446072 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:32:03.563363 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 13:32:03.684645 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:04.190341 run create_hlr_db(pid=27428): Launched 13:32:04.314672 bus /sierra_2: Setting Powered False 13:32:05.378785 run create_hlr_db(pid=27428): Terminated: ok {rc=0} 13:32:05.813195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27430): Launched 13:32:06.116041 run osmo-hlr_10.42.42.2(pid=27431): Launched 13:32:06.231150 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:06.752262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27433): Launched 13:32:07.054965 run osmo-stp_10.42.42.5(pid=27434): Launched 13:32:07.170445 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:07.717384 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27436): Launched 13:32:08.020933 run osmo-msc_10.42.42.6(pid=27437): Launched 13:32:08.190403 run osmo-stp_10.42.42.5(pid=27434): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27434)] 13:32:08.318658 run osmo-stp_10.42.42.5(pid=27434): stdout: | (launched: 2022-12-14_13:32:06.999225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:08.447870 run osmo-stp_10.42.42.5(pid=27434): stderr: | 20221214133207171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133207171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133207171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133207171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133207172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133207172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133207172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:08.574238 run osmo-stp_10.42.42.5(pid=27434): stdout: | (launched: 2022-12-14_13:32:06.999225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:08.695470 run osmo-stp_10.42.42.5(pid=27434): stderr: | 20221214133207171 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133207171 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133207171 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133207171 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133207172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133207172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133207172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:08.840370 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27434): Process ended prematurely: osmo-stp_10.42.42.5(pid=27434) [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27434)] [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 13:32:08.849321 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:32:08.875788 run osmo-hlr_10.42.42.2(pid=27431): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27431)] 13:32:08.923625 run osmo-hlr_10.42.42.2(pid=27431): stdout: | (launched: 2022-12-14_13:32:06.060520) 13:32:08.973432 run osmo-hlr_10.42.42.2(pid=27431): stderr: | 20221214133206236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133206236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133206236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133206236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133206236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133206236 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133206247 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133206256 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133206256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133206256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:09.042725 run osmo-msc_10.42.42.6(pid=27437): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27437)] 13:32:09.090252 run osmo-msc_10.42.42.6(pid=27437): stdout: | (launched: 2022-12-14_13:32:07.965396) 13:32:09.139392 run osmo-msc_10.42.42.6(pid=27437): stderr: | 20221214133208237 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133208237 DLGLOBAL DEBUG validating counter group 0x7fe40e1a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133208237 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133208237 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133208237 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133208238 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133208239 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133208240 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133208240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133208240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:09.189175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27430): Terminating (SIGTERM) 13:32:09.228689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27433): Terminating (SIGTERM) 13:32:09.268505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27436): Terminating (SIGTERM) 13:32:09.308280 --- ParallelTerminationStrategy: PID 27430 died... 13:32:09.327438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27430): Terminated: ok {rc=0} 13:32:09.371418 --- ParallelTerminationStrategy: PID 27433 died... 13:32:09.390094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27433): Terminated: ok {rc=0} 13:32:09.433757 --- ParallelTerminationStrategy: PID 27436 died... 13:32:09.452297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27436): Terminated: ok {rc=0} 13:32:09.539338 bus /sierra_3: Setting Powered False 13:32:10.639763 bus /sierra_3: Setting Powered False 13:32:11.754439 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 emergency:trx-umtrx --------------------------------------------------------------------- 13:32:12.998853 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:32:13.003227 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:32:13.034850 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 13:32:13.061468 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 13:32:13.144521 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:32:13.176409 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 13:32:13.202578 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 13:32:13.784218 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2405 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 13:32:13.789496 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:13.799940 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 13:32:13.847389 tst emergency_mo_mt_call.py: using LAC 41237 13:32:13.963863 tst emergency_mo_mt_call.py: using RAC 182 13:32:14.081774 tst emergency_mo_mt_call.py: using CellId 41237 13:32:14.202928 tst emergency_mo_mt_call.py: using BVCI 41238 13:32:14.310051 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:14.320723 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:14.331210 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:14.341779 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:14.352012 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:14.362824 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:32:14.476460 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:32:14.596620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:15.093283 run create_hlr_db(pid=27442): Launched 13:32:15.216825 bus /sierra_2: Setting Powered False 13:32:16.286794 run create_hlr_db(pid=27442): Terminated: ok {rc=0} 13:32:16.742807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27444): Launched 13:32:17.081679 run osmo-hlr_10.42.42.2(pid=27445): Launched 13:32:17.222865 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:17.779383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27447): Launched 13:32:18.098959 run osmo-stp_10.42.42.5(pid=27448): Launched 13:32:18.231890 tst emergency_mo_mt_call.py: using MSISDN 8708 13:32:18.395841 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:18.970930 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27450): Launched 13:32:19.293296 run osmo-msc_10.42.42.6(pid=27451): Launched 13:32:19.473306 run osmo-stp_10.42.42.5(pid=27448): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27448)] 13:32:19.609074 run osmo-stp_10.42.42.5(pid=27448): stdout: | (launched: 2022-12-14_13:32:18.040441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:19.745251 run osmo-stp_10.42.42.5(pid=27448): stderr: | 20221214133218230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133218231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133218231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133218231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133218234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133218234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133218234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:19.880663 run osmo-stp_10.42.42.5(pid=27448): stdout: | (launched: 2022-12-14_13:32:18.040441) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:20.009536 run osmo-stp_10.42.42.5(pid=27448): stderr: | 20221214133218230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133218231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133218231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133218231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133218234 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133218234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133218234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:20.163416 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=27448): Process ended prematurely: osmo-stp_10.42.42.5(pid=27448) [trial-2405↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27448)] [trial-2405↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 13:32:20.172323 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 13:32:20.199828 run osmo-hlr_10.42.42.2(pid=27445): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27445)] 13:32:20.250746 run osmo-hlr_10.42.42.2(pid=27445): stdout: | (launched: 2022-12-14_13:32:17.014138) 13:32:20.302703 run osmo-hlr_10.42.42.2(pid=27445): stderr: | 20221214133217306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133217306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133217306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133217306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133217306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133217306 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133217318 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133217326 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133217326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133217326 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:20.375587 run osmo-msc_10.42.42.6(pid=27451): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27451)] 13:32:20.425432 run osmo-msc_10.42.42.6(pid=27451): stdout: | (launched: 2022-12-14_13:32:19.234674) 13:32:20.477167 run osmo-msc_10.42.42.6(pid=27451): stderr: | 20221214133219554 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133219555 DLGLOBAL DEBUG validating counter group 0x7fe5530f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133219555 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133219555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133219555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133219555 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133219557 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133219558 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133219558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133219558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:20.529789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27444): Terminating (SIGTERM) 13:32:20.571223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27447): Terminating (SIGTERM) 13:32:20.613057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27450): Terminating (SIGTERM) 13:32:20.655620 --- ParallelTerminationStrategy: PID 27444 died... 13:32:20.675839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27444): Terminated: ok {rc=0} 13:32:20.722281 --- ParallelTerminationStrategy: PID 27447 died... 13:32:20.742201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27447): Terminated: ok {rc=0} 13:32:20.788487 --- ParallelTerminationStrategy: PID 27450 died... 13:32:20.808336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27450): Terminated: ok {rc=0} 13:32:20.895916 bus /sierra_3: Setting Powered False 13:32:21.993761 bus /sierra_3: Setting Powered False 13:32:23.110694 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 13:32:24.196540 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:24.208015 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 13:32:24.257559 tst emergency_preemptive_call.py: using LAC 41238 13:32:24.381073 tst emergency_preemptive_call.py: using RAC 183 13:32:24.497414 tst emergency_preemptive_call.py: using CellId 41238 13:32:24.616769 tst emergency_preemptive_call.py: using BVCI 41239 13:32:24.724288 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:24.735026 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:24.745787 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:24.756209 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:24.766914 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 13:32:24.777517 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:32:24.891892 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:32:25.011531 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:32:25.126161 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 13:32:25.239304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:25.702518 run create_hlr_db(pid=27453): Launched 13:32:25.831083 bus /sierra_2: Setting Powered False 13:32:26.894423 run create_hlr_db(pid=27453): Terminated: ok {rc=0} 13:32:27.340604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27455): Launched 13:32:27.660870 run osmo-hlr_10.42.42.2(pid=27456): Launched 13:32:27.782861 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:28.335065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27458): Launched 13:32:28.655474 run osmo-stp_10.42.42.5(pid=27459): Launched 13:32:28.786321 tst emergency_preemptive_call.py: using MSISDN 8709 13:32:28.953915 run osmo-msc_10.42.42.6: Starting osmo-msc 13:32:29.527193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27461): Launched 13:32:29.845840 run osmo-msc_10.42.42.6(pid=27462): Launched 13:32:30.023416 run osmo-stp_10.42.42.5(pid=27459): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27459)] 13:32:30.163813 run osmo-stp_10.42.42.5(pid=27459): stdout: | (launched: 2022-12-14_13:32:28.597096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:30.296233 run osmo-stp_10.42.42.5(pid=27459): stderr: | 20221214133228790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133228790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133228790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133228791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133228791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133228791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133228791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:30.429827 run osmo-stp_10.42.42.5(pid=27459): stdout: | (launched: 2022-12-14_13:32:28.597096) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:30.557078 run osmo-stp_10.42.42.5(pid=27459): stderr: | 20221214133228790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133228790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133228790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133228791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133228791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133228791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133228791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:30.709209 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=27459): Process ended prematurely: osmo-stp_10.42.42.5(pid=27459) [trial-2405↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27459)] [trial-2405↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 13:32:30.718107 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 13:32:30.745332 run osmo-hlr_10.42.42.2(pid=27456): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27456)] 13:32:30.795708 run osmo-hlr_10.42.42.2(pid=27456): stdout: | (launched: 2022-12-14_13:32:27.602589) 13:32:30.864562 run osmo-hlr_10.42.42.2(pid=27456): stderr: | 20221214133227801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133227801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133227801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133227801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133227801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133227801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133227816 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133227826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133227826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133227826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:30.955095 run osmo-msc_10.42.42.6(pid=27462): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=27462)] 13:32:31.006172 run osmo-msc_10.42.42.6(pid=27462): stdout: | (launched: 2022-12-14_13:32:29.787552) 13:32:31.067337 run osmo-msc_10.42.42.6(pid=27462): stderr: | 20221214133230110 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133230110 DLGLOBAL DEBUG validating counter group 0x7f8a7ace3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133230110 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133230110 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133230110 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133230110 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133230112 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133230112 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133230113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133230113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:32:31.128736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27455): Terminating (SIGTERM) 13:32:31.179123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27458): Terminating (SIGTERM) 13:32:31.231075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27461): Terminating (SIGTERM) 13:32:31.285705 --- ParallelTerminationStrategy: PID 27455 died... 13:32:31.309702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27455): Terminated: ok {rc=0} 13:32:31.366277 --- ParallelTerminationStrategy: PID 27458 died... 13:32:31.390074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27458): Terminated: ok {rc=0} 13:32:31.444495 --- ParallelTerminationStrategy: PID 27461 died... 13:32:31.468516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=27461): Terminated: ok {rc=0} 13:32:31.564298 bus /sierra_9: Setting Powered False 13:32:32.663706 bus /sierra_9: Setting Powered False 13:32:33.780640 bus /sierra_8: Setting Powered False 13:32:34.879411 bus /sierra_8: Setting Powered False 13:32:35.996458 bus /sierra_3: Setting Powered False 13:32:37.094705 bus /sierra_3: Setting Powered False 13:32:38.208002 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx --------------------------------------------------------------------- 13:32:39.482856 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:32:39.488382 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 13:32:39.521088 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 13:32:39.560414 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 13:32:39.650939 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 13:32:39.683206 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 13:32:39.721607 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 13:32:40.312215 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 13:32:40.366129 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:40.376917 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:32:40.429255 tst cs_paging_gprs_active.py: using LAC 41239 13:32:40.548435 tst cs_paging_gprs_active.py: using RAC 184 13:32:40.666218 tst cs_paging_gprs_active.py: using CellId 41239 13:32:40.783200 tst cs_paging_gprs_active.py: using BVCI 41240 13:32:40.893174 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:40.903695 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:40.914095 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:40.924505 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:40.934816 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:40.945143 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:40.955539 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:40.965870 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:40.976222 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:32:41.090259 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:32:41.210318 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:32:41.432317 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:41.760496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27467): Launched 13:32:42.044064 run iperf3-srv_10.42.42.10(pid=27468): Launched 13:32:42.166861 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:32:42.387185 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:42.714355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27469): Launched 13:32:42.997473 run iperf3-srv_10.42.42.10(pid=27470): Launched 13:32:43.119153 tst cs_paging_gprs_active.py:38: start network... 13:32:43.340184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:43.845139 run create_hlr_db(pid=27471): Launched 13:32:43.969786 bus /sierra_2: Setting Powered False 13:32:45.034374 run create_hlr_db(pid=27471): Terminated: ok {rc=0} 13:32:45.470305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27473): Launched 13:32:45.773704 run osmo-hlr_10.42.42.2(pid=27474): Launched 13:32:45.953477 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:46.638565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27476): Launched 13:32:46.966027 run osmo-stp_10.42.42.5(pid=27477): Launched 13:32:47.094317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:32:47.776062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27479): Launched 13:32:47.899987 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:32:48.174803 run patchelf(pid=27480): Launched 13:32:48.355493 run osmo-stp_10.42.42.5(pid=27477): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27477)] 13:32:48.493360 run osmo-stp_10.42.42.5(pid=27477): stdout: | (launched: 2022-12-14_13:32:46.902103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:48.632880 run osmo-stp_10.42.42.5(pid=27477): stderr: | 20221214133247275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133247275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133247276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133247276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133247278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133247279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133247279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:48.773192 run osmo-stp_10.42.42.5(pid=27477): stdout: | (launched: 2022-12-14_13:32:46.902103) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:32:48.906631 run osmo-stp_10.42.42.5(pid=27477): stderr: | 20221214133247275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133247275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133247276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133247276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133247278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133247279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133247279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:32:49.064769 run patchelf(pid=27480): Terminating (SIGINT) 13:32:49.247327 run patchelf(pid=27480): Terminated: ok {rc=0} 13:32:49.378622 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27477): Process ended prematurely: osmo-stp_10.42.42.5(pid=27477) [trial-2405↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27477)] [trial-2405↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 13:32:49.388640 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 13:32:49.417138 run osmo-hlr_10.42.42.2(pid=27474): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27474)] 13:32:49.467542 run osmo-hlr_10.42.42.2(pid=27474): stdout: | (launched: 2022-12-14_13:32:45.718255) 13:32:49.519869 run osmo-hlr_10.42.42.2(pid=27474): stderr: | 20221214133246009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133246009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133246009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133246010 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133246010 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133246010 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133246023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133246035 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133246035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133246035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:32:49.572445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27467): Terminating (SIGTERM) 13:32:49.614264 run iperf3-srv_10.42.42.10(pid=27468): Terminating (SIGTERM) 13:32:49.656197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27469): Terminating (SIGTERM) 13:32:49.698969 run iperf3-srv_10.42.42.10(pid=27470): Terminating (SIGTERM) 13:32:49.741154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27473): Terminating (SIGTERM) 13:32:49.783230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27476): Terminating (SIGTERM) 13:32:49.825471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27479): Terminating (SIGTERM) 13:32:49.868300 --- ParallelTerminationStrategy: PID 27467 died... 13:32:49.888842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27467): Terminated: ok {rc=0} 13:32:49.935732 --- ParallelTerminationStrategy: PID 27468 died... 13:32:49.955782 run iperf3-srv_10.42.42.10(pid=27468): Terminated {rc=256} 13:32:50.002439 --- ParallelTerminationStrategy: PID 27469 died... 13:32:50.022549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27469): Terminated: ok {rc=0} 13:32:50.069318 --- ParallelTerminationStrategy: PID 27470 died... 13:32:50.089402 run iperf3-srv_10.42.42.10(pid=27470): Terminated {rc=256} 13:32:50.136171 --- ParallelTerminationStrategy: PID 27473 died... 13:32:50.156548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27473): Terminated: ok {rc=0} 13:32:50.203362 --- ParallelTerminationStrategy: PID 27476 died... 13:32:50.223798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27476): Terminated: ok {rc=0} 13:32:50.271018 --- ParallelTerminationStrategy: PID 27479 died... 13:32:50.291156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27479): Terminated: ok {rc=0} 13:32:50.379645 bus /gobi_0: Setting Powered False 13:32:51.477993 bus /gobi_0: Setting Powered False 13:32:52.596195 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx iperf3.py ---------------------------------------------- 13:32:53.741829 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:53.753288 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:32:53.803902 tst iperf3.py: using LAC 41240 13:32:53.923462 tst iperf3.py: using RAC 185 13:32:54.044614 tst iperf3.py: using CellId 41240 13:32:54.165063 tst iperf3.py: using BVCI 41241 13:32:54.276662 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:54.287478 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:54.298119 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:54.308754 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:54.319388 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:54.329773 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:54.340610 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:54.351336 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:32:54.361911 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:32:54.476178 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:32:54.681201 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:32:54.987045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27481): Launched 13:32:55.251522 run iperf3-srv_10.42.42.10(pid=27482): Launched 13:32:55.365112 tst iperf3.py:8: start network... 13:32:55.568377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:32:56.035242 run create_hlr_db(pid=27483): Launched 13:32:56.158969 bus /gobi_6: Setting Powered False 13:32:57.219606 run create_hlr_db(pid=27483): Terminated: ok {rc=0} 13:32:57.664909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27485): Launched 13:32:57.990551 run osmo-hlr_10.42.42.2(pid=27486): Launched 13:32:58.115399 run osmo-stp_10.42.42.5: Starting osmo-stp 13:32:58.679508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27488): Launched 13:32:59.005948 run osmo-stp_10.42.42.5(pid=27489): Launched 13:32:59.130018 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:32:59.690691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27491): Launched 13:32:59.815001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:00.090680 run patchelf(pid=27492): Launched 13:33:00.272769 run osmo-stp_10.42.42.5(pid=27489): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27489)] 13:33:00.410878 run osmo-stp_10.42.42.5(pid=27489): stdout: | (launched: 2022-12-14_13:32:58.946653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:00.550872 run osmo-stp_10.42.42.5(pid=27489): stderr: | 20221214133259139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133259139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133259140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133259140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133259141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133259141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133259141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:00.691216 run osmo-stp_10.42.42.5(pid=27489): stdout: | (launched: 2022-12-14_13:32:58.946653) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:00.825719 run osmo-stp_10.42.42.5(pid=27489): stderr: | 20221214133259139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133259139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133259140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133259140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133259141 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133259141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133259141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:01.012531 run patchelf(pid=27492): Terminating (SIGINT) 13:33:01.199084 run patchelf(pid=27492): Terminated: ok {rc=0} 13:33:01.334933 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27489): Process ended prematurely: osmo-stp_10.42.42.5(pid=27489) [trial-2405↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27489)] [trial-2405↪gprs:trx-umtrx↪iperf3.py:8] 13:33:01.346068 tst iperf3.py:8: Test FAILED (7.6 sec) 13:33:01.375945 run osmo-hlr_10.42.42.2(pid=27486): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27486)] 13:33:01.429669 run osmo-hlr_10.42.42.2(pid=27486): stdout: | (launched: 2022-12-14_13:32:57.931317) 13:33:01.483783 run osmo-hlr_10.42.42.2(pid=27486): stderr: | 20221214133258131 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133258131 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133258131 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133258131 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133258131 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133258131 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133258146 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133258154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133258154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133258154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:01.538423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27481): Terminating (SIGTERM) 13:33:01.582702 run iperf3-srv_10.42.42.10(pid=27482): Terminating (SIGTERM) 13:33:01.629887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27485): Terminating (SIGTERM) 13:33:01.674434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27488): Terminating (SIGTERM) 13:33:01.718927 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27491): Terminating (SIGTERM) 13:33:01.765035 --- ParallelTerminationStrategy: PID 27481 died... 13:33:01.786776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27481): Terminated: ok {rc=0} 13:33:01.835623 --- ParallelTerminationStrategy: PID 27482 died... 13:33:01.856905 run iperf3-srv_10.42.42.10(pid=27482): Terminated {rc=256} 13:33:01.905866 --- ParallelTerminationStrategy: PID 27485 died... 13:33:01.927073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27485): Terminated: ok {rc=0} 13:33:01.975754 --- ParallelTerminationStrategy: PID 27488 died... 13:33:01.997292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27488): Terminated: ok {rc=0} 13:33:02.045996 --- ParallelTerminationStrategy: PID 27491 died... 13:33:02.067406 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27491): Terminated: ok {rc=0} 13:33:02.159183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 13:33:03.313357 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:03.324876 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:33:03.377607 tst iperf3m4.py: using LAC 41241 13:33:03.499949 tst iperf3m4.py: using RAC 186 13:33:03.620545 tst iperf3m4.py: using CellId 41241 13:33:03.743262 tst iperf3m4.py: using BVCI 41242 13:33:03.855571 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:03.866404 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:03.877047 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:03.887712 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:03.898175 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:03.913248 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:03.924426 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:03.935688 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:03.947092 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:33:04.063200 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:33:04.189445 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:33:04.305120 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:33:04.426130 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:33:04.649371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:04.978449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27494): Launched 13:33:05.264166 run iperf3-srv_10.42.42.10(pid=27495): Launched 13:33:05.387714 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:33:05.609269 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:05.937732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27496): Launched 13:33:06.222991 run iperf3-srv_10.42.42.10(pid=27497): Launched 13:33:06.345953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:33:06.567480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:06.897508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27498): Launched 13:33:07.182465 run iperf3-srv_10.42.42.10(pid=27499): Launched 13:33:07.305248 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:33:07.525468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:07.852803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27500): Launched 13:33:08.136873 run iperf3-srv_10.42.42.10(pid=27501): Launched 13:33:08.259586 tst iperf3m4.py:8: start network... 13:33:08.480376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:08.986667 run create_hlr_db(pid=27502): Launched 13:33:09.112237 bus /gobi_6: Setting Powered False 13:33:10.177707 run create_hlr_db(pid=27502): Terminated: ok {rc=0} 13:33:10.614329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27504): Launched 13:33:10.919400 run osmo-hlr_10.42.42.2(pid=27505): Launched 13:33:11.035210 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:11.564114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27507): Launched 13:33:11.870446 run osmo-stp_10.42.42.5(pid=27508): Launched 13:33:11.986478 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:12.515047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27510): Launched 13:33:12.630535 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:12.886426 run patchelf(pid=27511): Launched 13:33:13.055871 run osmo-stp_10.42.42.5(pid=27508): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27508)] 13:33:13.184612 run osmo-stp_10.42.42.5(pid=27508): stdout: | (launched: 2022-12-14_13:33:11.812882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:13.314692 run osmo-stp_10.42.42.5(pid=27508): stderr: | 20221214133311983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133311983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133311984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133311984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133311984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133311985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133311985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:13.444540 run osmo-stp_10.42.42.5(pid=27508): stdout: | (launched: 2022-12-14_13:33:11.812882) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:13.568612 run osmo-stp_10.42.42.5(pid=27508): stderr: | 20221214133311983 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133311983 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133311984 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133311984 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133311984 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133311985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133311985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:13.716316 run patchelf(pid=27511): Terminating (SIGINT) 13:33:13.886739 run patchelf(pid=27511): Terminated: ok {rc=0} 13:33:14.009446 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27508): Process ended prematurely: osmo-stp_10.42.42.5(pid=27508) [trial-2405↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27508)] [trial-2405↪gprs:trx-umtrx↪iperf3m4.py:8] 13:33:14.018774 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:33:14.046062 run osmo-hlr_10.42.42.2(pid=27505): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27505)] 13:33:14.094047 run osmo-hlr_10.42.42.2(pid=27505): stdout: | (launched: 2022-12-14_13:33:10.862773) 13:33:14.143686 run osmo-hlr_10.42.42.2(pid=27505): stderr: | 20221214133311039 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133311039 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133311039 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133311039 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133311039 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133311039 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133311052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133311061 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133311061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133311061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:14.193661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27494): Terminating (SIGTERM) 13:33:14.233497 run iperf3-srv_10.42.42.10(pid=27495): Terminating (SIGTERM) 13:33:14.273390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27496): Terminating (SIGTERM) 13:33:14.313213 run iperf3-srv_10.42.42.10(pid=27497): Terminating (SIGTERM) 13:33:14.353336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27498): Terminating (SIGTERM) 13:33:14.393477 run iperf3-srv_10.42.42.10(pid=27499): Terminating (SIGTERM) 13:33:14.434698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27500): Terminating (SIGTERM) 13:33:14.475310 run iperf3-srv_10.42.42.10(pid=27501): Terminating (SIGTERM) 13:33:14.515048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27504): Terminating (SIGTERM) 13:33:14.554906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27507): Terminating (SIGTERM) 13:33:14.594605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27510): Terminating (SIGTERM) 13:33:14.634541 --- ParallelTerminationStrategy: PID 27494 died... 13:33:14.653798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27494): Terminated: ok {rc=0} 13:33:14.697808 --- ParallelTerminationStrategy: PID 27495 died... 13:33:14.716458 run iperf3-srv_10.42.42.10(pid=27495): Terminated {rc=256} 13:33:14.760193 --- ParallelTerminationStrategy: PID 27496 died... 13:33:14.778931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27496): Terminated: ok {rc=0} 13:33:14.822838 --- ParallelTerminationStrategy: PID 27497 died... 13:33:14.841567 run iperf3-srv_10.42.42.10(pid=27497): Terminated {rc=256} 13:33:14.885419 --- ParallelTerminationStrategy: PID 27498 died... 13:33:14.903979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27498): Terminated: ok {rc=0} 13:33:14.948649 --- ParallelTerminationStrategy: PID 27499 died... 13:33:14.967391 run iperf3-srv_10.42.42.10(pid=27499): Terminated {rc=256} 13:33:15.011050 --- ParallelTerminationStrategy: PID 27500 died... 13:33:15.029805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27500): Terminated: ok {rc=0} 13:33:15.073583 --- ParallelTerminationStrategy: PID 27501 died... 13:33:15.092050 run iperf3-srv_10.42.42.10(pid=27501): Terminated {rc=256} 13:33:15.135773 --- ParallelTerminationStrategy: PID 27504 died... 13:33:15.154355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27504): Terminated: ok {rc=0} 13:33:15.198135 --- ParallelTerminationStrategy: PID 27507 died... 13:33:15.216855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27507): Terminated: ok {rc=0} 13:33:15.260497 --- ParallelTerminationStrategy: PID 27510 died... 13:33:15.279090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27510): Terminated: ok {rc=0} 13:33:15.363979 bus /gobi_4: Setting Powered False 13:33:16.460529 bus /gobi_4: Setting Powered False 13:33:17.574711 bus /gobi_1: Setting Powered False 13:33:18.673427 bus /gobi_1: Setting Powered False 13:33:19.788343 bus /gobi_0: Setting Powered False 13:33:20.884634 bus /gobi_0: Setting Powered False 13:33:22.001517 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx ping.py ---------------------------------------------- 13:33:23.103348 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:23.115225 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:33:23.170081 tst ping.py: using LAC 41242 13:33:23.294579 tst ping.py: using RAC 187 13:33:23.418249 tst ping.py: using CellId 41242 13:33:23.534276 tst ping.py: using BVCI 41243 13:33:23.643029 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:23.653693 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:23.664193 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:23.674692 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:23.685010 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:23.698764 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:23.710005 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:23.721080 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:33:23.835697 tst ping.py:19: start network... 13:33:24.038399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:24.499970 run create_hlr_db(pid=27512): Launched 13:33:24.621026 bus /gobi_6: Setting Powered False 13:33:25.681248 run create_hlr_db(pid=27512): Terminated: ok {rc=0} 13:33:26.096895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27514): Launched 13:33:26.395121 run osmo-hlr_10.42.42.2(pid=27515): Launched 13:33:26.507895 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:27.021072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27517): Launched 13:33:27.321036 run osmo-stp_10.42.42.5(pid=27518): Launched 13:33:27.435392 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:27.951329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27520): Launched 13:33:28.064851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:28.316507 run patchelf(pid=27521): Launched 13:33:28.482152 run osmo-stp_10.42.42.5(pid=27518): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27518)] 13:33:28.607678 run osmo-stp_10.42.42.5(pid=27518): stdout: | (launched: 2022-12-14_13:33:27.265762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:28.734660 run osmo-stp_10.42.42.5(pid=27518): stderr: | 20221214133327438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133327438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133327438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133327439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133327439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133327439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133327439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:28.862231 run osmo-stp_10.42.42.5(pid=27518): stdout: | (launched: 2022-12-14_13:33:27.265762) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:28.984516 run osmo-stp_10.42.42.5(pid=27518): stderr: | 20221214133327438 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133327438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133327438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133327439 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133327439 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133327439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133327439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:29.129516 run patchelf(pid=27521): Terminating (SIGINT) 13:33:29.296477 run patchelf(pid=27521): Terminated: ok {rc=0} 13:33:29.416549 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27518): Process ended prematurely: osmo-stp_10.42.42.5(pid=27518) [trial-2405↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27518)] [trial-2405↪gprs:trx-umtrx↪ping.py:22] 13:33:29.425309 tst ping.py:22: Test FAILED (6.3 sec) 13:33:29.451998 run osmo-hlr_10.42.42.2(pid=27515): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27515)] 13:33:29.499609 run osmo-hlr_10.42.42.2(pid=27515): stdout: | (launched: 2022-12-14_13:33:26.340245) 13:33:29.548766 run osmo-hlr_10.42.42.2(pid=27515): stderr: | 20221214133326515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133326515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133326515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133326515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133326515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133326515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133326528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133326537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133326537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133326537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:29.598149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27514): Terminating (SIGTERM) 13:33:29.638114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27517): Terminating (SIGTERM) 13:33:29.677852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27520): Terminating (SIGTERM) 13:33:29.717831 --- ParallelTerminationStrategy: PID 27514 died... 13:33:29.737191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27514): Terminated: ok {rc=0} 13:33:29.781232 --- ParallelTerminationStrategy: PID 27517 died... 13:33:29.799952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27517): Terminated: ok {rc=0} 13:33:29.844164 --- ParallelTerminationStrategy: PID 27520 died... 13:33:29.862931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27520): Terminated: ok {rc=0} 13:33:29.948311 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 13:33:31.041746 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:31.055213 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 13:33:31.121119 tst ping_idle_ping.py: using LAC 41243 13:33:31.242482 tst ping_idle_ping.py: using RAC 188 13:33:31.407940 tst ping_idle_ping.py: using CellId 41243 13:33:31.561496 tst ping_idle_ping.py: using BVCI 41244 13:33:31.710058 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:31.720854 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:31.732931 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:31.744228 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:31.755772 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:31.767291 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:31.778845 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 13:33:31.790340 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 13:33:31.910004 tst ping_idle_ping.py:24: start network... 13:33:32.134394 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:32.644004 run create_hlr_db(pid=27522): Launched 13:33:32.769499 bus /gobi_6: Setting Powered False 13:33:33.833900 run create_hlr_db(pid=27522): Terminated: ok {rc=0} 13:33:34.282741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27524): Launched 13:33:34.605352 run osmo-hlr_10.42.42.2(pid=27525): Launched 13:33:34.728377 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:35.284678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27527): Launched 13:33:35.607538 run osmo-stp_10.42.42.5(pid=27528): Launched 13:33:35.730716 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:36.286304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27530): Launched 13:33:36.409710 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:36.680734 run patchelf(pid=27531): Launched 13:33:36.858715 run osmo-stp_10.42.42.5(pid=27528): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27528)] 13:33:36.994393 run osmo-stp_10.42.42.5(pid=27528): stdout: | (launched: 2022-12-14_13:33:35.548633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:37.131994 run osmo-stp_10.42.42.5(pid=27528): stderr: | 20221214133335742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133335742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133335742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133335742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133335743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133335743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133335743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:37.270813 run osmo-stp_10.42.42.5(pid=27528): stdout: | (launched: 2022-12-14_13:33:35.548633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:37.403056 run osmo-stp_10.42.42.5(pid=27528): stderr: | 20221214133335742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133335742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133335742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133335742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133335743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133335743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133335743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:37.559749 run patchelf(pid=27531): Terminating (SIGINT) 13:33:37.739352 run patchelf(pid=27531): Terminated: ok {rc=0} 13:33:37.868418 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27528): Process ended prematurely: osmo-stp_10.42.42.5(pid=27528) [trial-2405↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27528)] [trial-2405↪gprs:trx-umtrx↪ping_idle_ping.py:27] 13:33:37.878019 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:33:37.906000 run osmo-hlr_10.42.42.2(pid=27525): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27525)] 13:33:37.956907 run osmo-hlr_10.42.42.2(pid=27525): stdout: | (launched: 2022-12-14_13:33:34.546442) 13:33:38.008908 run osmo-hlr_10.42.42.2(pid=27525): stderr: | 20221214133334746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133334746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133334746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133334746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133334746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133334746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133334759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133334767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133334767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133334767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:38.061788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27524): Terminating (SIGTERM) 13:33:38.103697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27527): Terminating (SIGTERM) 13:33:38.145795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27530): Terminating (SIGTERM) 13:33:38.188895 --- ParallelTerminationStrategy: PID 27524 died... 13:33:38.209437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27524): Terminated: ok {rc=0} 13:33:38.256388 --- ParallelTerminationStrategy: PID 27527 died... 13:33:38.276449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27527): Terminated: ok {rc=0} 13:33:38.323275 --- ParallelTerminationStrategy: PID 27530 died... 13:33:38.343366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27530): Terminated: ok {rc=0} 13:33:38.432677 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 13:33:39.726841 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:33:39.732075 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:33:39.763834 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:33:39.802439 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:33:39.889770 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:33:39.922164 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:33:39.960353 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:33:40.549826 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:33:40.598884 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:40.609867 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:33:40.658979 tst cs_paging_gprs_active.py: using LAC 41244 13:33:40.780121 tst cs_paging_gprs_active.py: using RAC 189 13:33:40.900765 tst cs_paging_gprs_active.py: using CellId 41244 13:33:41.019994 tst cs_paging_gprs_active.py: using BVCI 41245 13:33:41.132399 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:41.143474 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:41.154213 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:41.164738 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:41.175271 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:41.185763 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:41.196916 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:41.207900 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:41.218835 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:41.332362 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:41.452004 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:33:41.674476 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:42.003170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27535): Launched 13:33:42.287656 run iperf3-srv_10.42.42.10(pid=27536): Launched 13:33:42.410270 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:33:42.631436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:42.959774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27537): Launched 13:33:43.244611 run iperf3-srv_10.42.42.10(pid=27538): Launched 13:33:43.367206 tst cs_paging_gprs_active.py:38: start network... 13:33:43.587750 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:44.092771 run create_hlr_db(pid=27539): Launched 13:33:44.218072 bus /gobi_6: Setting Powered False 13:33:45.283743 run create_hlr_db(pid=27539): Terminated: ok {rc=0} 13:33:45.719508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27541): Launched 13:33:46.069205 run osmo-hlr_10.42.42.2(pid=27542): Launched 13:33:46.380401 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:47.092149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27544): Launched 13:33:47.438502 run osmo-stp_10.42.42.5(pid=27545): Launched 13:33:47.566416 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:48.132939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27547): Launched 13:33:48.258788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:33:48.534002 run patchelf(pid=27548): Launched 13:33:48.714760 run osmo-stp_10.42.42.5(pid=27545): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27545)] 13:33:48.852513 run osmo-stp_10.42.42.5(pid=27545): stdout: | (launched: 2022-12-14_13:33:47.379200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:48.992026 run osmo-stp_10.42.42.5(pid=27545): stderr: | 20221214133347570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133347570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133347571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133347571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133347572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133347572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133347572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:49.131588 run osmo-stp_10.42.42.5(pid=27545): stdout: | (launched: 2022-12-14_13:33:47.379200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:33:49.266109 run osmo-stp_10.42.42.5(pid=27545): stderr: | 20221214133347570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133347570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133347571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133347571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133347572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133347572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133347572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:33:49.424532 run patchelf(pid=27548): Terminating (SIGINT) 13:33:49.607125 run patchelf(pid=27548): Terminated: ok {rc=0} 13:33:49.738701 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27545): Process ended prematurely: osmo-stp_10.42.42.5(pid=27545) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27545)] [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:33:49.748758 tst cs_paging_gprs_active.py:38: Test FAILED (9.2 sec) 13:33:49.777402 run osmo-hlr_10.42.42.2(pid=27542): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27542)] 13:33:49.827941 run osmo-hlr_10.42.42.2(pid=27542): stdout: | (launched: 2022-12-14_13:33:45.997802) 13:33:49.880006 run osmo-hlr_10.42.42.2(pid=27542): stderr: | 20221214133346402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133346402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133346402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133346403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133346403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133346403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133346426 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133346443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133346443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133346443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:33:49.931700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27535): Terminating (SIGTERM) 13:33:49.973783 run iperf3-srv_10.42.42.10(pid=27536): Terminating (SIGTERM) 13:33:50.015732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27537): Terminating (SIGTERM) 13:33:50.058239 run iperf3-srv_10.42.42.10(pid=27538): Terminating (SIGTERM) 13:33:50.100013 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27541): Terminating (SIGTERM) 13:33:50.142601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27544): Terminating (SIGTERM) 13:33:50.184555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27547): Terminating (SIGTERM) 13:33:50.226741 --- ParallelTerminationStrategy: PID 27535 died... 13:33:50.247191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27535): Terminated: ok {rc=0} 13:33:50.293679 --- ParallelTerminationStrategy: PID 27536 died... 13:33:50.313516 run iperf3-srv_10.42.42.10(pid=27536): Terminated {rc=256} 13:33:50.359783 --- ParallelTerminationStrategy: PID 27537 died... 13:33:50.379658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27537): Terminated: ok {rc=0} 13:33:50.425889 --- ParallelTerminationStrategy: PID 27538 died... 13:33:50.445556 run iperf3-srv_10.42.42.10(pid=27538): Terminated {rc=256} 13:33:50.491584 --- ParallelTerminationStrategy: PID 27541 died... 13:33:50.511474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27541): Terminated: ok {rc=0} 13:33:50.557606 --- ParallelTerminationStrategy: PID 27544 died... 13:33:50.577802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27544): Terminated: ok {rc=0} 13:33:50.623946 --- ParallelTerminationStrategy: PID 27547 died... 13:33:50.643727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27547): Terminated: ok {rc=0} 13:33:50.731280 bus /gobi_0: Setting Powered False 13:33:51.829550 bus /gobi_0: Setting Powered False 13:33:52.944661 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:33:54.093998 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:54.105890 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:33:54.159016 tst iperf3.py: using LAC 41245 13:33:54.288200 tst iperf3.py: using RAC 190 13:33:54.415416 tst iperf3.py: using CellId 41245 13:33:54.543930 tst iperf3.py: using BVCI 41246 13:33:54.662371 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:54.673759 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:54.684648 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:54.695741 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:54.707018 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:54.718292 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:54.729821 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:54.740942 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:33:54.752482 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:33:54.868233 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:33:55.071741 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:33:55.377363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27550): Launched 13:33:55.641729 run iperf3-srv_10.42.42.10(pid=27551): Launched 13:33:55.754896 tst iperf3.py:8: start network... 13:33:55.958509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:33:56.425771 run create_hlr_db(pid=27552): Launched 13:33:56.550362 bus /gobi_6: Setting Powered False 13:33:57.610638 run create_hlr_db(pid=27552): Terminated: ok {rc=0} 13:33:58.032758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27554): Launched 13:33:58.335287 run osmo-hlr_10.42.42.2(pid=27555): Launched 13:33:58.449629 run osmo-stp_10.42.42.5: Starting osmo-stp 13:33:58.990682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27557): Launched 13:33:59.294631 run osmo-stp_10.42.42.5(pid=27558): Launched 13:33:59.409590 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:33:59.950086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27560): Launched 13:34:00.065352 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:00.320538 run patchelf(pid=27561): Launched 13:34:00.488577 run osmo-stp_10.42.42.5(pid=27558): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27558)] 13:34:00.616261 run osmo-stp_10.42.42.5(pid=27558): stdout: | (launched: 2022-12-14_13:33:59.237658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:00.745907 run osmo-stp_10.42.42.5(pid=27558): stderr: | 20221214133359411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133359411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133359412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133359412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133359413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133359413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133359413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:00.888938 run osmo-stp_10.42.42.5(pid=27558): stdout: | (launched: 2022-12-14_13:33:59.237658) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:01.015720 run osmo-stp_10.42.42.5(pid=27558): stderr: | 20221214133359411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133359411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133359412 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133359412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133359413 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133359413 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133359413 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:01.164794 run patchelf(pid=27561): Terminating (SIGINT) 13:34:01.338718 run patchelf(pid=27561): Terminated: ok {rc=0} 13:34:01.464009 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27558): Process ended prematurely: osmo-stp_10.42.42.5(pid=27558) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27558)] [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 13:34:01.474660 tst iperf3.py:8: Test FAILED (7.4 sec) 13:34:01.502852 run osmo-hlr_10.42.42.2(pid=27555): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27555)] 13:34:01.551122 run osmo-hlr_10.42.42.2(pid=27555): stdout: | (launched: 2022-12-14_13:33:58.279885) 13:34:01.601370 run osmo-hlr_10.42.42.2(pid=27555): stderr: | 20221214133358457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133358457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133358457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133358457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133358457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133358457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133358470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133358478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133358479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133358479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:01.652486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27550): Terminating (SIGTERM) 13:34:01.692554 run iperf3-srv_10.42.42.10(pid=27551): Terminating (SIGTERM) 13:34:01.734318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27554): Terminating (SIGTERM) 13:34:01.775280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27557): Terminating (SIGTERM) 13:34:01.815732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27560): Terminating (SIGTERM) 13:34:01.858273 --- ParallelTerminationStrategy: PID 27550 died... 13:34:01.877442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27550): Terminated: ok {rc=0} 13:34:01.922552 --- ParallelTerminationStrategy: PID 27551 died... 13:34:01.941815 run iperf3-srv_10.42.42.10(pid=27551): Terminated {rc=256} 13:34:01.986474 --- ParallelTerminationStrategy: PID 27554 died... 13:34:02.005682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27554): Terminated: ok {rc=0} 13:34:02.050119 --- ParallelTerminationStrategy: PID 27557 died... 13:34:02.069413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27557): Terminated: ok {rc=0} 13:34:02.114153 --- ParallelTerminationStrategy: PID 27560 died... 13:34:02.133218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27560): Terminated: ok {rc=0} 13:34:02.217085 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:34:03.367172 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:03.379084 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:34:03.430108 tst iperf3m4.py: using LAC 41246 13:34:03.552777 tst iperf3m4.py: using RAC 191 13:34:03.671548 tst iperf3m4.py: using CellId 41246 13:34:03.789213 tst iperf3m4.py: using BVCI 41247 13:34:03.898868 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:03.909712 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:03.920205 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:03.930767 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:03.941303 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:03.951718 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:03.962368 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:03.972685 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:03.983380 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:34:04.103597 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:34:04.220724 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:34:04.340910 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:34:04.461161 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:34:04.683087 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:05.010192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27562): Launched 13:34:05.294733 run iperf3-srv_10.42.42.10(pid=27563): Launched 13:34:05.417777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:34:05.638942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:05.966119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27564): Launched 13:34:06.250205 run iperf3-srv_10.42.42.10(pid=27565): Launched 13:34:06.372730 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:34:06.592890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:06.919803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27566): Launched 13:34:07.203467 run iperf3-srv_10.42.42.10(pid=27567): Launched 13:34:07.326367 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:34:07.546911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:07.873383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27568): Launched 13:34:08.156037 run iperf3-srv_10.42.42.10(pid=27569): Launched 13:34:08.278961 tst iperf3m4.py:8: start network... 13:34:08.498735 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:09.003629 run create_hlr_db(pid=27570): Launched 13:34:09.127782 bus /gobi_6: Setting Powered False 13:34:10.192379 run create_hlr_db(pid=27570): Terminated: ok {rc=0} 13:34:10.644103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27572): Launched 13:34:10.969256 run osmo-hlr_10.42.42.2(pid=27573): Launched 13:34:11.093825 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:11.653940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27575): Launched 13:34:11.978861 run osmo-stp_10.42.42.5(pid=27576): Launched 13:34:12.103317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:12.664815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27578): Launched 13:34:12.789814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:13.065825 run patchelf(pid=27579): Launched 13:34:13.246764 run osmo-stp_10.42.42.5(pid=27576): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27576)] 13:34:13.384375 run osmo-stp_10.42.42.5(pid=27576): stdout: | (launched: 2022-12-14_13:34:11.919598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:13.523814 run osmo-stp_10.42.42.5(pid=27576): stderr: | 20221214133412111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133412111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133412111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133412112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133412112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133412112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133412112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:13.663069 run osmo-stp_10.42.42.5(pid=27576): stdout: | (launched: 2022-12-14_13:34:11.919598) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:13.796147 run osmo-stp_10.42.42.5(pid=27576): stderr: | 20221214133412111 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133412111 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133412111 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133412112 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133412112 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133412112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133412112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:13.954467 run patchelf(pid=27579): Terminating (SIGINT) 13:34:14.136418 run patchelf(pid=27579): Terminated: ok {rc=0} 13:34:14.268878 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27576): Process ended prematurely: osmo-stp_10.42.42.5(pid=27576) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27576)] [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 13:34:14.279259 tst iperf3m4.py:8: Test FAILED (11.0 sec) 13:34:14.307867 run osmo-hlr_10.42.42.2(pid=27573): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27573)] 13:34:14.358353 run osmo-hlr_10.42.42.2(pid=27573): stdout: | (launched: 2022-12-14_13:34:10.909985) 13:34:14.410081 run osmo-hlr_10.42.42.2(pid=27573): stderr: | 20221214133411107 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133411107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133411107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133411107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133411107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133411107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133411120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133411128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133411128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133411128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:14.462576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27562): Terminating (SIGTERM) 13:34:14.504144 run iperf3-srv_10.42.42.10(pid=27563): Terminating (SIGTERM) 13:34:14.546246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27564): Terminating (SIGTERM) 13:34:14.588476 run iperf3-srv_10.42.42.10(pid=27565): Terminating (SIGTERM) 13:34:14.630401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27566): Terminating (SIGTERM) 13:34:14.672566 run iperf3-srv_10.42.42.10(pid=27567): Terminating (SIGTERM) 13:34:14.714564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27568): Terminating (SIGTERM) 13:34:14.756691 run iperf3-srv_10.42.42.10(pid=27569): Terminating (SIGTERM) 13:34:14.798628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27572): Terminating (SIGTERM) 13:34:14.841176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27575): Terminating (SIGTERM) 13:34:14.883386 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27578): Terminating (SIGTERM) 13:34:14.925742 --- ParallelTerminationStrategy: PID 27562 died... 13:34:14.945888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27562): Terminated: ok {rc=0} 13:34:14.992474 --- ParallelTerminationStrategy: PID 27563 died... 13:34:15.012451 run iperf3-srv_10.42.42.10(pid=27563): Terminated {rc=256} 13:34:15.058866 --- ParallelTerminationStrategy: PID 27564 died... 13:34:15.078788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27564): Terminated: ok {rc=0} 13:34:15.125408 --- ParallelTerminationStrategy: PID 27565 died... 13:34:15.145193 run iperf3-srv_10.42.42.10(pid=27565): Terminated {rc=256} 13:34:15.192177 --- ParallelTerminationStrategy: PID 27566 died... 13:34:15.212059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27566): Terminated: ok {rc=0} 13:34:15.258909 --- ParallelTerminationStrategy: PID 27567 died... 13:34:15.278922 run iperf3-srv_10.42.42.10(pid=27567): Terminated {rc=256} 13:34:15.325377 --- ParallelTerminationStrategy: PID 27568 died... 13:34:15.345442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27568): Terminated: ok {rc=0} 13:34:15.392040 --- ParallelTerminationStrategy: PID 27569 died... 13:34:15.412183 run iperf3-srv_10.42.42.10(pid=27569): Terminated {rc=256} 13:34:15.458772 --- ParallelTerminationStrategy: PID 27572 died... 13:34:15.478864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27572): Terminated: ok {rc=0} 13:34:15.525639 --- ParallelTerminationStrategy: PID 27575 died... 13:34:15.545718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27575): Terminated: ok {rc=0} 13:34:15.592440 --- ParallelTerminationStrategy: PID 27578 died... 13:34:15.612396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27578): Terminated: ok {rc=0} 13:34:15.699635 bus /gobi_4: Setting Powered False 13:34:16.797701 bus /gobi_4: Setting Powered False 13:34:17.916354 bus /gobi_1: Setting Powered False 13:34:19.015513 bus /gobi_1: Setting Powered False 13:34:20.130986 bus /gobi_0: Setting Powered False 13:34:21.228654 bus /gobi_0: Setting Powered False 13:34:22.345375 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 13:34:23.447080 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:23.459203 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:34:23.510483 tst ping.py: using LAC 41247 13:34:23.638743 tst ping.py: using RAC 192 13:34:23.768327 tst ping.py: using CellId 41247 13:34:23.894775 tst ping.py: using BVCI 41248 13:34:24.003666 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:24.014657 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:24.025447 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:24.036116 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:24.047179 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:24.058435 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:24.069685 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:24.080758 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:34:24.194993 tst ping.py:19: start network... 13:34:24.394540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:24.856463 run create_hlr_db(pid=27580): Launched 13:34:24.979862 bus /gobi_6: Setting Powered False 13:34:26.039243 run create_hlr_db(pid=27580): Terminated: ok {rc=0} 13:34:26.476905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27582): Launched 13:34:26.796832 run osmo-hlr_10.42.42.2(pid=27583): Launched 13:34:26.918959 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:27.473810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27585): Launched 13:34:27.792626 run osmo-stp_10.42.42.5(pid=27586): Launched 13:34:27.914486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:28.464940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27588): Launched 13:34:28.586972 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:28.856778 run patchelf(pid=27589): Launched 13:34:29.033607 run osmo-stp_10.42.42.5(pid=27586): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27586)] 13:34:29.168596 run osmo-stp_10.42.42.5(pid=27586): stdout: | (launched: 2022-12-14_13:34:27.734034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:29.305277 run osmo-stp_10.42.42.5(pid=27586): stderr: | 20221214133427928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133427928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133427929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133427929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133427929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133427930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133427930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:29.442116 run osmo-stp_10.42.42.5(pid=27586): stdout: | (launched: 2022-12-14_13:34:27.734034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:29.573905 run osmo-stp_10.42.42.5(pid=27586): stderr: | 20221214133427928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133427928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133427929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133427929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133427929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133427930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133427930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:29.729370 run patchelf(pid=27589): Terminating (SIGINT) 13:34:29.907724 run patchelf(pid=27589): Terminated: ok {rc=0} 13:34:30.036300 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=27586): Process ended prematurely: osmo-stp_10.42.42.5(pid=27586) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27586)] [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 13:34:30.045773 tst ping.py:22: Test FAILED (6.6 sec) 13:34:30.073601 run osmo-hlr_10.42.42.2(pid=27583): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27583)] 13:34:30.123960 run osmo-hlr_10.42.42.2(pid=27583): stdout: | (launched: 2022-12-14_13:34:26.738545) 13:34:30.175708 run osmo-hlr_10.42.42.2(pid=27583): stderr: | 20221214133426940 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133426940 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133426940 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133426940 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133426940 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133426940 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133426953 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133426961 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133426961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133426961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:30.228737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27582): Terminating (SIGTERM) 13:34:30.270263 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27585): Terminating (SIGTERM) 13:34:30.312073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27588): Terminating (SIGTERM) 13:34:30.354571 --- ParallelTerminationStrategy: PID 27582 died... 13:34:30.375081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27582): Terminated: ok {rc=0} 13:34:30.421480 --- ParallelTerminationStrategy: PID 27585 died... 13:34:30.441417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27585): Terminated: ok {rc=0} 13:34:30.487584 --- ParallelTerminationStrategy: PID 27588 died... 13:34:30.507511 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27588): Terminated: ok {rc=0} 13:34:30.595285 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:34:31.696598 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:31.720106 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:34:31.797411 tst ping_idle_ping.py: using LAC 41248 13:34:31.961287 tst ping_idle_ping.py: using RAC 193 13:34:32.089274 tst ping_idle_ping.py: using CellId 41248 13:34:32.235304 tst ping_idle_ping.py: using BVCI 41249 13:34:32.345311 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:32.356303 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:32.367129 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:32.377704 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:32.388290 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:32.398945 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:32.409838 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:34:32.420393 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:34:32.536228 tst ping_idle_ping.py:24: start network... 13:34:32.737127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:33.203119 run create_hlr_db(pid=27590): Launched 13:34:33.327298 bus /gobi_6: Setting Powered False 13:34:34.387480 run create_hlr_db(pid=27590): Terminated: ok {rc=0} 13:34:34.827315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27592): Launched 13:34:35.150418 run osmo-hlr_10.42.42.2(pid=27593): Launched 13:34:35.274323 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:35.830110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27595): Launched 13:34:36.152316 run osmo-stp_10.42.42.5(pid=27596): Launched 13:34:36.275450 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:36.830965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27598): Launched 13:34:36.954540 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:37.226353 run patchelf(pid=27599): Launched 13:34:37.405840 run osmo-stp_10.42.42.5(pid=27596): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27596)] 13:34:37.542035 run osmo-stp_10.42.42.5(pid=27596): stdout: | (launched: 2022-12-14_13:34:36.093523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:37.680408 run osmo-stp_10.42.42.5(pid=27596): stderr: | 20221214133436285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133436285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133436285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133436286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133436288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133436288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133436288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:37.818166 run osmo-stp_10.42.42.5(pid=27596): stdout: | (launched: 2022-12-14_13:34:36.093523) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:37.950525 run osmo-stp_10.42.42.5(pid=27596): stderr: | 20221214133436285 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133436285 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133436285 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133436286 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133436288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133436288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133436288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:38.107033 run patchelf(pid=27599): Terminating (SIGINT) 13:34:38.287926 run patchelf(pid=27599): Terminated: ok {rc=0} 13:34:38.417617 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=27596): Process ended prematurely: osmo-stp_10.42.42.5(pid=27596) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27596)] [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 13:34:38.427150 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:34:38.455230 run osmo-hlr_10.42.42.2(pid=27593): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27593)] 13:34:38.505983 run osmo-hlr_10.42.42.2(pid=27593): stdout: | (launched: 2022-12-14_13:34:35.091309) 13:34:38.558807 run osmo-hlr_10.42.42.2(pid=27593): stderr: | 20221214133435290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133435290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133435290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133435290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133435290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133435290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133435303 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133435311 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133435311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133435311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:38.611598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27592): Terminating (SIGTERM) 13:34:38.653730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27595): Terminating (SIGTERM) 13:34:38.696558 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27598): Terminating (SIGTERM) 13:34:38.739428 --- ParallelTerminationStrategy: PID 27592 died... 13:34:38.760537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27592): Terminated: ok {rc=0} 13:34:38.807682 --- ParallelTerminationStrategy: PID 27595 died... 13:34:38.827680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27595): Terminated: ok {rc=0} 13:34:38.874664 --- ParallelTerminationStrategy: PID 27598 died... 13:34:38.894846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27598): Terminated: ok {rc=0} 13:34:38.984187 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:34:40.287674 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:34:40.294058 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:34:40.326963 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:34:40.367168 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:34:40.454964 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:34:40.487941 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:34:40.527093 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:34:41.121778 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:34:41.174761 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:41.186033 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:34:41.256367 tst cs_paging_gprs_active.py: using LAC 41249 13:34:41.384519 tst cs_paging_gprs_active.py: using RAC 194 13:34:41.513299 tst cs_paging_gprs_active.py: using CellId 41249 13:34:41.642293 tst cs_paging_gprs_active.py: using BVCI 41250 13:34:41.762181 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:41.773481 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:41.784475 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:41.795569 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:41.806918 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:41.818271 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:41.829697 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:41.840867 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:41.852450 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:41.971167 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:42.090450 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:34:42.312505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:42.640070 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27604): Launched 13:34:42.924468 run iperf3-srv_10.42.42.10(pid=27605): Launched 13:34:43.047393 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:34:43.269062 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:43.598035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27606): Launched 13:34:43.882834 run iperf3-srv_10.42.42.10(pid=27607): Launched 13:34:44.004938 tst cs_paging_gprs_active.py:38: start network... 13:34:44.225325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:44.729861 run create_hlr_db(pid=27608): Launched 13:34:44.852865 bus /gobi_6: Setting Powered False 13:34:45.932346 run create_hlr_db(pid=27608): Terminated: ok {rc=0} 13:34:46.441702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27610): Launched 13:34:46.786154 run osmo-hlr_10.42.42.2(pid=27611): Launched 13:34:47.008877 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:47.603324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27613): Launched 13:34:47.929179 run osmo-stp_10.42.42.5(pid=27614): Launched 13:34:48.054341 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:34:48.617280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27616): Launched 13:34:48.741904 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:34:49.023937 run patchelf(pid=27617): Launched 13:34:49.205828 run osmo-stp_10.42.42.5(pid=27614): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27614)] 13:34:49.343573 run osmo-stp_10.42.42.5(pid=27614): stdout: | (launched: 2022-12-14_13:34:47.869694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:49.483291 run osmo-stp_10.42.42.5(pid=27614): stderr: | 20221214133448061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133448061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133448062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133448062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133448062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133448062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133448062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:49.623096 run osmo-stp_10.42.42.5(pid=27614): stdout: | (launched: 2022-12-14_13:34:47.869694) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:34:49.757408 run osmo-stp_10.42.42.5(pid=27614): stderr: | 20221214133448061 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133448061 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133448062 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133448062 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133448062 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133448062 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133448062 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:34:49.916131 run patchelf(pid=27617): Terminating (SIGINT) 13:34:50.098878 run patchelf(pid=27617): Terminated: ok {rc=0} 13:34:50.230832 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=27614): Process ended prematurely: osmo-stp_10.42.42.5(pid=27614) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27614)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:34:50.240848 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 13:34:50.269439 run osmo-hlr_10.42.42.2(pid=27611): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27611)] 13:34:50.319881 run osmo-hlr_10.42.42.2(pid=27611): stdout: | (launched: 2022-12-14_13:34:46.722195) 13:34:50.371480 run osmo-hlr_10.42.42.2(pid=27611): stderr: | 20221214133447061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133447061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133447061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133447061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133447061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133447061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133447073 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133447087 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133447087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133447087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:34:50.423517 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27604): Terminating (SIGTERM) 13:34:50.465319 run iperf3-srv_10.42.42.10(pid=27605): Terminating (SIGTERM) 13:34:50.507084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27606): Terminating (SIGTERM) 13:34:50.548931 run iperf3-srv_10.42.42.10(pid=27607): Terminating (SIGTERM) 13:34:50.591487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27610): Terminating (SIGTERM) 13:34:50.633511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27613): Terminating (SIGTERM) 13:34:50.675625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27616): Terminating (SIGTERM) 13:34:50.717867 --- ParallelTerminationStrategy: PID 27604 died... 13:34:50.738373 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27604): Terminated: ok {rc=0} 13:34:50.784870 --- ParallelTerminationStrategy: PID 27605 died... 13:34:50.804866 run iperf3-srv_10.42.42.10(pid=27605): Terminated {rc=256} 13:34:50.851104 --- ParallelTerminationStrategy: PID 27606 died... 13:34:50.871167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27606): Terminated: ok {rc=0} 13:34:50.917570 --- ParallelTerminationStrategy: PID 27607 died... 13:34:50.937584 run iperf3-srv_10.42.42.10(pid=27607): Terminated {rc=256} 13:34:50.983980 --- ParallelTerminationStrategy: PID 27610 died... 13:34:51.004074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27610): Terminated: ok {rc=0} 13:34:51.050716 --- ParallelTerminationStrategy: PID 27613 died... 13:34:51.070856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27613): Terminated: ok {rc=0} 13:34:51.117403 --- ParallelTerminationStrategy: PID 27616 died... 13:34:51.137479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27616): Terminated: ok {rc=0} 13:34:51.225939 bus /gobi_0: Setting Powered False 13:34:52.323701 bus /gobi_0: Setting Powered False 13:34:53.439829 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:34:54.590104 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:54.602277 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:34:54.673369 tst iperf3.py: using LAC 41250 13:34:54.800163 tst iperf3.py: using RAC 195 13:34:54.926840 tst iperf3.py: using CellId 41250 13:34:55.054318 tst iperf3.py: using BVCI 41251 13:34:55.164735 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:55.175714 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:55.186660 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:55.197457 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:55.207928 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:55.218769 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:55.229529 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:55.239902 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:34:55.250626 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:34:55.370284 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:34:55.584598 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:34:55.889168 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27619): Launched 13:34:56.153811 run iperf3-srv_10.42.42.10(pid=27620): Launched 13:34:56.267764 tst iperf3.py:8: start network... 13:34:56.470619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:34:56.939112 run create_hlr_db(pid=27621): Launched 13:34:57.062685 bus /gobi_6: Setting Powered False 13:34:58.123079 run create_hlr_db(pid=27621): Terminated: ok {rc=0} 13:34:58.544645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27623): Launched 13:34:58.848325 run osmo-hlr_10.42.42.2(pid=27624): Launched 13:34:58.963300 run osmo-stp_10.42.42.5: Starting osmo-stp 13:34:59.588277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27626): Launched 13:34:59.885898 run osmo-stp_10.42.42.5(pid=27627): Launched 13:34:59.998573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:00.511722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27629): Launched 13:35:00.625564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:00.913801 run patchelf(pid=27630): Launched 13:35:01.090550 run osmo-stp_10.42.42.5(pid=27627): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27627)] 13:35:01.219449 run osmo-stp_10.42.42.5(pid=27627): stdout: | (launched: 2022-12-14_13:34:59.831623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:01.349851 run osmo-stp_10.42.42.5(pid=27627): stderr: | 20221214133500003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133500004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133500004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133500004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133500006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133500007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133500007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:01.481249 run osmo-stp_10.42.42.5(pid=27627): stdout: | (launched: 2022-12-14_13:34:59.831623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:01.605977 run osmo-stp_10.42.42.5(pid=27627): stderr: | 20221214133500003 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133500004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133500004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133500004 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133500006 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133500007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133500007 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:01.764711 run patchelf(pid=27630): Terminating (SIGINT) 13:35:01.974570 run patchelf(pid=27630): Terminated: ok {rc=0} 13:35:02.099978 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27627): Process ended prematurely: osmo-stp_10.42.42.5(pid=27627) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27627)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 13:35:02.110665 tst iperf3.py:8: Test FAILED (7.6 sec) 13:35:02.139306 run osmo-hlr_10.42.42.2(pid=27624): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27624)] 13:35:02.188082 run osmo-hlr_10.42.42.2(pid=27624): stdout: | (launched: 2022-12-14_13:34:58.792320) 13:35:02.238404 run osmo-hlr_10.42.42.2(pid=27624): stderr: | 20221214133458972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133458972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133458972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133458973 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133458973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133458973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133458985 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133458994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133458994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133458994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:02.288813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27619): Terminating (SIGTERM) 13:35:02.330051 run iperf3-srv_10.42.42.10(pid=27620): Terminating (SIGTERM) 13:35:02.372270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27623): Terminating (SIGTERM) 13:35:02.413524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27626): Terminating (SIGTERM) 13:35:02.456188 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27629): Terminating (SIGTERM) 13:35:02.498380 --- ParallelTerminationStrategy: PID 27619 died... 13:35:02.519360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27619): Terminated: ok {rc=0} 13:35:02.565448 --- ParallelTerminationStrategy: PID 27620 died... 13:35:02.584716 run iperf3-srv_10.42.42.10(pid=27620): Terminated {rc=256} 13:35:02.629280 --- ParallelTerminationStrategy: PID 27623 died... 13:35:02.648641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27623): Terminated: ok {rc=0} 13:35:02.693370 --- ParallelTerminationStrategy: PID 27626 died... 13:35:02.712561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27626): Terminated: ok {rc=0} 13:35:02.756470 --- ParallelTerminationStrategy: PID 27629 died... 13:35:02.775055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27629): Terminated: ok {rc=0} 13:35:02.860304 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:35:04.006703 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:04.018284 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:35:04.087359 tst iperf3m4.py: using LAC 41251 13:35:04.205810 tst iperf3m4.py: using RAC 196 13:35:04.323225 tst iperf3m4.py: using CellId 41251 13:35:04.455330 tst iperf3m4.py: using BVCI 41252 13:35:04.573523 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:04.584849 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:04.595996 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:04.606947 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:04.618846 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:04.630788 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:04.642640 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:04.654393 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:04.666278 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:35:04.786400 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:35:04.907711 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:35:05.022801 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:35:05.140574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:35:05.357702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:05.678176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27641): Launched 13:35:05.956099 run iperf3-srv_10.42.42.10(pid=27642): Launched 13:35:06.076156 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:35:06.292942 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:06.613666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27643): Launched 13:35:06.891424 run iperf3-srv_10.42.42.10(pid=27644): Launched 13:35:07.011010 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:35:07.226914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:07.547076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27645): Launched 13:35:07.825792 run iperf3-srv_10.42.42.10(pid=27646): Launched 13:35:07.946062 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:35:08.161545 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:08.482696 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27647): Launched 13:35:08.761328 run iperf3-srv_10.42.42.10(pid=27648): Launched 13:35:08.880748 tst iperf3m4.py:8: start network... 13:35:09.096125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:09.593765 run create_hlr_db(pid=27649): Launched 13:35:09.716024 bus /gobi_6: Setting Powered False 13:35:10.780311 run create_hlr_db(pid=27649): Terminated: ok {rc=0} 13:35:11.209189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27651): Launched 13:35:11.507374 run osmo-hlr_10.42.42.2(pid=27652): Launched 13:35:11.622185 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:12.135027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27654): Launched 13:35:12.432212 run osmo-stp_10.42.42.5(pid=27655): Launched 13:35:12.546383 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:13.077854 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27668): Launched 13:35:13.200776 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:13.461741 run patchelf(pid=27748): Launched 13:35:13.652128 run osmo-stp_10.42.42.5(pid=27655): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27655)] 13:35:13.794038 run osmo-stp_10.42.42.5(pid=27655): stdout: | (launched: 2022-12-14_13:35:12.377711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:13.938428 run osmo-stp_10.42.42.5(pid=27655): stderr: | 20221214133512547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133512547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133512547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133512548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133512548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133512548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133512548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:14.080602 run osmo-stp_10.42.42.5(pid=27655): stdout: | (launched: 2022-12-14_13:35:12.377711) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:14.217345 run osmo-stp_10.42.42.5(pid=27655): stderr: | 20221214133512547 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133512547 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133512547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133512548 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133512548 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133512548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133512548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:14.381397 run patchelf(pid=27748): Terminating (SIGINT) 13:35:14.566820 run patchelf(pid=27748): Terminated: ok {rc=0} 13:35:14.701608 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=27655): Process ended prematurely: osmo-stp_10.42.42.5(pid=27655) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27655)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:35:14.712900 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:35:14.743215 run osmo-hlr_10.42.42.2(pid=27652): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=27652)] 13:35:14.798479 run osmo-hlr_10.42.42.2(pid=27652): stdout: | (launched: 2022-12-14_13:35:11.452384) 13:35:14.854676 run osmo-hlr_10.42.42.2(pid=27652): stderr: | 20221214133511625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133511625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133511625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133511625 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133511625 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133511625 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133511652 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133511661 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133511662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133511662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:14.911326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27641): Terminating (SIGTERM) 13:35:14.956174 run iperf3-srv_10.42.42.10(pid=27642): Terminating (SIGTERM) 13:35:15.000386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27643): Terminating (SIGTERM) 13:35:15.043584 run iperf3-srv_10.42.42.10(pid=27644): Terminating (SIGTERM) 13:35:15.086855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27645): Terminating (SIGTERM) 13:35:15.130226 run iperf3-srv_10.42.42.10(pid=27646): Terminating (SIGTERM) 13:35:15.173118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27647): Terminating (SIGTERM) 13:35:15.216772 run iperf3-srv_10.42.42.10(pid=27648): Terminating (SIGTERM) 13:35:15.259859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27651): Terminating (SIGTERM) 13:35:15.303036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27654): Terminating (SIGTERM) 13:35:15.345758 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27668): Terminating (SIGTERM) 13:35:15.388757 --- ParallelTerminationStrategy: PID 27641 died... 13:35:15.408826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27641): Terminated: ok {rc=0} 13:35:15.456063 --- ParallelTerminationStrategy: PID 27642 died... 13:35:15.476170 run iperf3-srv_10.42.42.10(pid=27642): Terminated {rc=256} 13:35:15.522757 --- ParallelTerminationStrategy: PID 27643 died... 13:35:15.542758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27643): Terminated: ok {rc=0} 13:35:15.589739 --- ParallelTerminationStrategy: PID 27644 died... 13:35:15.609626 run iperf3-srv_10.42.42.10(pid=27644): Terminated {rc=256} 13:35:15.656525 --- ParallelTerminationStrategy: PID 27645 died... 13:35:15.676724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27645): Terminated: ok {rc=0} 13:35:15.723699 --- ParallelTerminationStrategy: PID 27646 died... 13:35:15.743819 run iperf3-srv_10.42.42.10(pid=27646): Terminated {rc=256} 13:35:15.790995 --- ParallelTerminationStrategy: PID 27647 died... 13:35:15.811089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=27647): Terminated: ok {rc=0} 13:35:15.872368 --- ParallelTerminationStrategy: PID 27648 died... 13:35:15.893558 run iperf3-srv_10.42.42.10(pid=27648): Terminated {rc=256} 13:35:15.947670 --- ParallelTerminationStrategy: PID 27651 died... 13:35:15.967396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=27651): Terminated: ok {rc=0} 13:35:16.014013 --- ParallelTerminationStrategy: PID 27654 died... 13:35:16.034858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=27654): Terminated: ok {rc=0} 13:35:16.081601 --- ParallelTerminationStrategy: PID 27668 died... 13:35:16.103414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=27668): Terminated: ok {rc=0} 13:35:16.192742 bus /gobi_4: Setting Powered False 13:35:17.294355 bus /gobi_4: Setting Powered False 13:35:18.414004 bus /gobi_1: Setting Powered False 13:35:19.513901 bus /gobi_1: Setting Powered False 13:35:20.630412 bus /gobi_0: Setting Powered False 13:35:21.729221 bus /gobi_0: Setting Powered False 13:35:22.847078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:35:23.952243 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:23.965969 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:35:24.037687 tst ping.py: using LAC 41252 13:35:24.164524 tst ping.py: using RAC 197 13:35:24.284194 tst ping.py: using CellId 41252 13:35:24.403712 tst ping.py: using BVCI 41253 13:35:24.517240 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:24.528642 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:24.539678 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:24.550683 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:24.562259 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:24.573600 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:24.584726 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:24.595924 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:35:24.710987 tst ping.py:19: start network... 13:35:24.910788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:25.424330 run create_hlr_db(pid=28185): Launched 13:35:25.550779 bus /gobi_6: Setting Powered False 13:35:26.614435 run create_hlr_db(pid=28185): Terminated: ok {rc=0} 13:35:27.070489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28187): Launched 13:35:27.410439 run osmo-hlr_10.42.42.2(pid=28188): Launched 13:35:27.658930 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:28.323699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28190): Launched 13:35:28.668375 run osmo-stp_10.42.42.5(pid=28191): Launched 13:35:28.916269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:29.559552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28194): Launched 13:35:29.681723 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:29.951299 run patchelf(pid=28195): Launched 13:35:30.128316 run osmo-stp_10.42.42.5(pid=28191): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28191)] 13:35:30.263601 run osmo-stp_10.42.42.5(pid=28191): stdout: | (launched: 2022-12-14_13:35:28.603490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:30.401039 run osmo-stp_10.42.42.5(pid=28191): stderr: | 20221214133528902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133528903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133528903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133528903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133528904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133528904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133528904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:30.537594 run osmo-stp_10.42.42.5(pid=28191): stdout: | (launched: 2022-12-14_13:35:28.603490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:30.668683 run osmo-stp_10.42.42.5(pid=28191): stderr: | 20221214133528902 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133528903 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133528903 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133528903 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133528904 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133528904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133528904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:30.823348 run patchelf(pid=28195): Terminating (SIGINT) 13:35:31.025302 run patchelf(pid=28195): Terminated: ok {rc=0} 13:35:31.171477 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28191): Process ended prematurely: osmo-stp_10.42.42.5(pid=28191) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28191)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 13:35:31.180523 tst ping.py:22: Test FAILED (7.2 sec) 13:35:31.207538 run osmo-hlr_10.42.42.2(pid=28188): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28188)] 13:35:31.256916 run osmo-hlr_10.42.42.2(pid=28188): stdout: | (launched: 2022-12-14_13:35:27.347217) 13:35:31.308099 run osmo-hlr_10.42.42.2(pid=28188): stderr: | 20221214133527654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133527654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133527654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133527654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133527654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133527654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133527669 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133527681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133527681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133527681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:31.359493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28187): Terminating (SIGTERM) 13:35:31.400885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28190): Terminating (SIGTERM) 13:35:31.445042 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28194): Terminating (SIGTERM) 13:35:31.488563 --- ParallelTerminationStrategy: PID 28187 died... 13:35:31.508134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28187): Terminated: ok {rc=0} 13:35:31.555156 --- ParallelTerminationStrategy: PID 28190 died... 13:35:31.575137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28190): Terminated: ok {rc=0} 13:35:31.620262 --- ParallelTerminationStrategy: PID 28194 died... 13:35:31.639625 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28194): Terminated: ok {rc=0} 13:35:31.725812 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:35:32.812413 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:32.824584 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:35:32.895978 tst ping_idle_ping.py: using LAC 41253 13:35:33.012578 tst ping_idle_ping.py: using RAC 198 13:35:33.128748 tst ping_idle_ping.py: using CellId 41253 13:35:33.255030 tst ping_idle_ping.py: using BVCI 41254 13:35:33.370829 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:33.382288 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:33.393474 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:33.404418 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:33.416358 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:33.428242 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:33.440214 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:35:33.452208 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:35:33.568911 tst ping_idle_ping.py:24: start network... 13:35:33.769282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:34.232213 run create_hlr_db(pid=28196): Launched 13:35:34.354537 bus /gobi_6: Setting Powered False 13:35:35.414536 run create_hlr_db(pid=28196): Terminated: ok {rc=0} 13:35:35.850227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28198): Launched 13:35:36.172298 run osmo-hlr_10.42.42.2(pid=28199): Launched 13:35:36.294791 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:36.845357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28201): Launched 13:35:37.165499 run osmo-stp_10.42.42.5(pid=28202): Launched 13:35:37.287563 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:37.807381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28204): Launched 13:35:37.921067 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:38.173750 run patchelf(pid=28205): Launched 13:35:38.339056 run osmo-stp_10.42.42.5(pid=28202): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28202)] 13:35:38.465142 run osmo-stp_10.42.42.5(pid=28202): stdout: | (launched: 2022-12-14_13:35:37.106451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:38.592657 run osmo-stp_10.42.42.5(pid=28202): stderr: | 20221214133537300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133537300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133537301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133537301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133537301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133537302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133537302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:38.720341 run osmo-stp_10.42.42.5(pid=28202): stdout: | (launched: 2022-12-14_13:35:37.106451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:38.843273 run osmo-stp_10.42.42.5(pid=28202): stderr: | 20221214133537300 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133537300 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133537301 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133537301 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133537301 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133537302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133537302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:38.988231 run patchelf(pid=28205): Terminating (SIGINT) 13:35:39.155039 run patchelf(pid=28205): Terminated: ok {rc=0} 13:35:39.275579 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28202): Process ended prematurely: osmo-stp_10.42.42.5(pid=28202) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28202)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:35:39.284466 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:35:39.310958 run osmo-hlr_10.42.42.2(pid=28199): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28199)] 13:35:39.358323 run osmo-hlr_10.42.42.2(pid=28199): stdout: | (launched: 2022-12-14_13:35:36.113579) 13:35:39.407467 run osmo-hlr_10.42.42.2(pid=28199): stderr: | 20221214133536312 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133536312 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133536312 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133536312 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133536312 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133536312 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133536325 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133536333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133536333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133536333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:39.457152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28198): Terminating (SIGTERM) 13:35:39.497127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28201): Terminating (SIGTERM) 13:35:39.536909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28204): Terminating (SIGTERM) 13:35:39.576828 --- ParallelTerminationStrategy: PID 28198 died... 13:35:39.596103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28198): Terminated: ok {rc=0} 13:35:39.640264 --- ParallelTerminationStrategy: PID 28201 died... 13:35:39.658962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28201): Terminated: ok {rc=0} 13:35:39.702801 --- ParallelTerminationStrategy: PID 28204 died... 13:35:39.721423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28204): Terminated: ok {rc=0} 13:35:39.804798 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:35:41.113167 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:35:41.119987 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:35:41.153708 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:35:41.194800 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:35:41.284202 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:35:41.316921 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:35:41.356568 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:35:41.953181 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:35:42.006534 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:42.017825 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:35:42.088278 tst cs_paging_gprs_active.py: using LAC 41254 13:35:42.219757 tst cs_paging_gprs_active.py: using RAC 199 13:35:42.346427 tst cs_paging_gprs_active.py: using CellId 41254 13:35:42.465819 tst cs_paging_gprs_active.py: using BVCI 41255 13:35:42.577519 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:42.588291 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:42.598912 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:42.609611 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:42.620133 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:42.631234 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:42.641927 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:42.652448 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:42.663232 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:42.782729 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:42.901510 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:35:43.106120 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:43.412064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28210): Launched 13:35:43.677642 run iperf3-srv_10.42.42.10(pid=28211): Launched 13:35:43.791188 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:35:43.994512 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:44.300736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28212): Launched 13:35:44.564894 run iperf3-srv_10.42.42.10(pid=28213): Launched 13:35:44.677874 tst cs_paging_gprs_active.py:38: start network... 13:35:44.881186 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:45.350899 run create_hlr_db(pid=28214): Launched 13:35:45.474641 bus /gobi_6: Setting Powered False 13:35:46.534095 run create_hlr_db(pid=28214): Terminated: ok {rc=0} 13:35:46.975372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28216): Launched 13:35:47.290017 run osmo-hlr_10.42.42.2(pid=28217): Launched 13:35:47.404705 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:47.924203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28219): Launched 13:35:48.227193 run osmo-stp_10.42.42.5(pid=28220): Launched 13:35:48.342120 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:35:48.862713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28222): Launched 13:35:48.977741 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:35:49.235253 run patchelf(pid=28223): Launched 13:35:49.403066 run osmo-stp_10.42.42.5(pid=28220): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28220)] 13:35:49.530474 run osmo-stp_10.42.42.5(pid=28220): stdout: | (launched: 2022-12-14_13:35:48.171440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:49.659634 run osmo-stp_10.42.42.5(pid=28220): stderr: | 20221214133548343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133548343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133548343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133548344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133548344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133548344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133548344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:49.789290 run osmo-stp_10.42.42.5(pid=28220): stdout: | (launched: 2022-12-14_13:35:48.171440) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:35:49.912664 run osmo-stp_10.42.42.5(pid=28220): stderr: | 20221214133548343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133548343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133548343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133548344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133548344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133548344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133548344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:35:50.058932 run patchelf(pid=28223): Terminating (SIGINT) 13:35:50.229142 run patchelf(pid=28223): Terminated: ok {rc=0} 13:35:50.351685 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28220): Process ended prematurely: osmo-stp_10.42.42.5(pid=28220) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28220)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:35:50.361103 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 13:35:50.387954 run osmo-hlr_10.42.42.2(pid=28217): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28217)] 13:35:50.435341 run osmo-hlr_10.42.42.2(pid=28217): stdout: | (launched: 2022-12-14_13:35:47.233769) 13:35:50.484391 run osmo-hlr_10.42.42.2(pid=28217): stderr: | 20221214133547412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133547412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133547412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133547412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133547412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133547412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133547424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133547433 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133547433 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133547433 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:35:50.533752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28210): Terminating (SIGTERM) 13:35:50.573176 run iperf3-srv_10.42.42.10(pid=28211): Terminating (SIGTERM) 13:35:50.612438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28212): Terminating (SIGTERM) 13:35:50.651781 run iperf3-srv_10.42.42.10(pid=28213): Terminating (SIGTERM) 13:35:50.690867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28216): Terminating (SIGTERM) 13:35:50.730085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28219): Terminating (SIGTERM) 13:35:50.769252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28222): Terminating (SIGTERM) 13:35:50.809434 --- ParallelTerminationStrategy: PID 28210 died... 13:35:50.828224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28210): Terminated: ok {rc=0} 13:35:50.871752 --- ParallelTerminationStrategy: PID 28211 died... 13:35:50.890087 run iperf3-srv_10.42.42.10(pid=28211): Terminated {rc=256} 13:35:50.933484 --- ParallelTerminationStrategy: PID 28212 died... 13:35:50.951764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28212): Terminated: ok {rc=0} 13:35:50.994953 --- ParallelTerminationStrategy: PID 28213 died... 13:35:51.013180 run iperf3-srv_10.42.42.10(pid=28213): Terminated {rc=256} 13:35:51.056280 --- ParallelTerminationStrategy: PID 28216 died... 13:35:51.074636 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28216): Terminated: ok {rc=0} 13:35:51.117816 --- ParallelTerminationStrategy: PID 28219 died... 13:35:51.136014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28219): Terminated: ok {rc=0} 13:35:51.179395 --- ParallelTerminationStrategy: PID 28222 died... 13:35:51.197719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28222): Terminated: ok {rc=0} 13:35:51.280321 bus /gobi_0: Setting Powered False 13:35:52.378357 bus /gobi_0: Setting Powered False 13:35:53.493888 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:35:54.643864 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:54.655923 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:35:54.728272 tst iperf3.py: using LAC 41255 13:35:54.855995 tst iperf3.py: using RAC 200 13:35:54.981701 tst iperf3.py: using CellId 41255 13:35:55.110334 tst iperf3.py: using BVCI 41256 13:35:55.229572 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:55.241317 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:55.252359 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:55.263549 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:55.274979 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:55.286630 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:55.298231 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:55.309667 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:35:55.321318 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:35:55.439485 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:35:55.659977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:35:55.985539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28224): Launched 13:35:56.267812 run iperf3-srv_10.42.42.10(pid=28225): Launched 13:35:56.389188 tst iperf3.py:8: start network... 13:35:56.608228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:35:57.110104 run create_hlr_db(pid=28226): Launched 13:35:57.233180 bus /gobi_6: Setting Powered False 13:35:58.297261 run create_hlr_db(pid=28226): Terminated: ok {rc=0} 13:35:58.731496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Launched 13:35:59.034091 run osmo-hlr_10.42.42.2(pid=28229): Launched 13:35:59.148583 run osmo-stp_10.42.42.5: Starting osmo-stp 13:35:59.670005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Launched 13:35:59.972441 run osmo-stp_10.42.42.5(pid=28232): Launched 13:36:00.087553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:00.609489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28234): Launched 13:36:00.724599 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:01.019153 run patchelf(pid=28235): Launched 13:36:01.204458 run osmo-stp_10.42.42.5(pid=28232): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] 13:36:01.335054 run osmo-stp_10.42.42.5(pid=28232): stdout: | (launched: 2022-12-14_13:35:59.916611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:01.467614 run osmo-stp_10.42.42.5(pid=28232): stderr: | 20221214133600088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133600088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133600088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133600088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133600089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133600089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133600089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:01.600248 run osmo-stp_10.42.42.5(pid=28232): stdout: | (launched: 2022-12-14_13:35:59.916611) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:01.726476 run osmo-stp_10.42.42.5(pid=28232): stderr: | 20221214133600088 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133600088 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133600088 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133600088 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133600089 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133600089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133600089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:01.878212 run patchelf(pid=28235): Terminating (SIGINT) 13:36:02.052755 run patchelf(pid=28235): Terminated: ok {rc=0} 13:36:02.177992 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28232): Process ended prematurely: osmo-stp_10.42.42.5(pid=28232) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 13:36:02.188043 tst iperf3.py:8: Test FAILED (7.6 sec) 13:36:02.215762 run osmo-hlr_10.42.42.2(pid=28229): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28229)] 13:36:02.264699 run osmo-hlr_10.42.42.2(pid=28229): stdout: | (launched: 2022-12-14_13:35:58.977877) 13:36:02.314349 run osmo-hlr_10.42.42.2(pid=28229): stderr: | 20221214133559154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133559154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133559154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133559154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133559154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133559154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133559166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133559175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133559175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133559175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:02.363587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28224): Terminating (SIGTERM) 13:36:02.403057 run iperf3-srv_10.42.42.10(pid=28225): Terminating (SIGTERM) 13:36:02.442306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Terminating (SIGTERM) 13:36:02.481452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Terminating (SIGTERM) 13:36:02.520821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28234): Terminating (SIGTERM) 13:36:02.560507 --- ParallelTerminationStrategy: PID 28224 died... 13:36:02.579554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28224): Terminated: ok {rc=0} 13:36:02.623397 --- ParallelTerminationStrategy: PID 28225 died... 13:36:02.641879 run iperf3-srv_10.42.42.10(pid=28225): Terminated {rc=256} 13:36:02.686000 --- ParallelTerminationStrategy: PID 28228 died... 13:36:02.704462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28228): Terminated: ok {rc=0} 13:36:02.748144 --- ParallelTerminationStrategy: PID 28231 died... 13:36:02.766692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28231): Terminated: ok {rc=0} 13:36:02.810482 --- ParallelTerminationStrategy: PID 28234 died... 13:36:02.829195 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28234): Terminated: ok {rc=0} 13:36:02.916064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:36:04.063707 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:04.075189 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:36:04.147475 tst iperf3m4.py: using LAC 41256 13:36:04.267236 tst iperf3m4.py: using RAC 201 13:36:04.388422 tst iperf3m4.py: using CellId 41256 13:36:04.508388 tst iperf3m4.py: using BVCI 41257 13:36:04.618010 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:04.628898 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:04.639689 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:04.650747 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:04.661432 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:04.672166 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:04.683096 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:04.693735 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:04.704530 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:36:04.818162 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:36:04.938908 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:36:05.054478 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:36:05.169595 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:36:05.372551 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:05.675590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28236): Launched 13:36:05.938719 run iperf3-srv_10.42.42.10(pid=28237): Launched 13:36:06.053432 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:36:06.255896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:06.559275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28238): Launched 13:36:06.821709 run iperf3-srv_10.42.42.10(pid=28239): Launched 13:36:06.934535 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:36:07.137328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:07.441068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28240): Launched 13:36:07.704382 run iperf3-srv_10.42.42.10(pid=28241): Launched 13:36:07.817585 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:36:08.019105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:08.322817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28242): Launched 13:36:08.585999 run iperf3-srv_10.42.42.10(pid=28243): Launched 13:36:08.700147 tst iperf3m4.py:8: start network... 13:36:08.901388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:09.368251 run create_hlr_db(pid=28244): Launched 13:36:09.491734 bus /gobi_6: Setting Powered False 13:36:10.551874 run create_hlr_db(pid=28244): Terminated: ok {rc=0} 13:36:10.975558 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28246): Launched 13:36:11.278670 run osmo-hlr_10.42.42.2(pid=28247): Launched 13:36:11.394317 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:11.930564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28249): Launched 13:36:12.234613 run osmo-stp_10.42.42.5(pid=28250): Launched 13:36:12.351622 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:12.872756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28252): Launched 13:36:12.987933 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:13.243695 run patchelf(pid=28253): Launched 13:36:13.411205 run osmo-stp_10.42.42.5(pid=28250): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28250)] 13:36:13.538317 run osmo-stp_10.42.42.5(pid=28250): stdout: | (launched: 2022-12-14_13:36:12.178830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:13.667191 run osmo-stp_10.42.42.5(pid=28250): stderr: | 20221214133612352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133612353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133612353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133612353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133612354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133612354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133612354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:13.796422 run osmo-stp_10.42.42.5(pid=28250): stdout: | (launched: 2022-12-14_13:36:12.178830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:13.919854 run osmo-stp_10.42.42.5(pid=28250): stderr: | 20221214133612352 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133612353 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133612353 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133612353 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133612354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133612354 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133612354 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:14.066431 run patchelf(pid=28253): Terminating (SIGINT) 13:36:14.235525 run patchelf(pid=28253): Terminated: ok {rc=0} 13:36:14.357698 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28250): Process ended prematurely: osmo-stp_10.42.42.5(pid=28250) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28250)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:36:14.367290 tst iperf3m4.py:8: Test FAILED (10.3 sec) 13:36:14.394517 run osmo-hlr_10.42.42.2(pid=28247): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28247)] 13:36:14.441818 run osmo-hlr_10.42.42.2(pid=28247): stdout: | (launched: 2022-12-14_13:36:11.222280) 13:36:14.490888 run osmo-hlr_10.42.42.2(pid=28247): stderr: | 20221214133611402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133611402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133611402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133611402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133611402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133611403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133611415 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133611426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133611426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133611426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:14.540173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28236): Terminating (SIGTERM) 13:36:14.579701 run iperf3-srv_10.42.42.10(pid=28237): Terminating (SIGTERM) 13:36:14.619089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28238): Terminating (SIGTERM) 13:36:14.658587 run iperf3-srv_10.42.42.10(pid=28239): Terminating (SIGTERM) 13:36:14.697903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28240): Terminating (SIGTERM) 13:36:14.737324 run iperf3-srv_10.42.42.10(pid=28241): Terminating (SIGTERM) 13:36:14.776638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28242): Terminating (SIGTERM) 13:36:14.816114 run iperf3-srv_10.42.42.10(pid=28243): Terminating (SIGTERM) 13:36:14.855506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28246): Terminating (SIGTERM) 13:36:14.894889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28249): Terminating (SIGTERM) 13:36:14.934379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28252): Terminating (SIGTERM) 13:36:14.974406 --- ParallelTerminationStrategy: PID 28236 died... 13:36:14.993568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28236): Terminated: ok {rc=0} 13:36:15.037545 --- ParallelTerminationStrategy: PID 28237 died... 13:36:15.056057 run iperf3-srv_10.42.42.10(pid=28237): Terminated {rc=256} 13:36:15.099792 --- ParallelTerminationStrategy: PID 28238 died... 13:36:15.118462 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28238): Terminated: ok {rc=0} 13:36:15.162224 --- ParallelTerminationStrategy: PID 28239 died... 13:36:15.180712 run iperf3-srv_10.42.42.10(pid=28239): Terminated {rc=256} 13:36:15.224340 --- ParallelTerminationStrategy: PID 28240 died... 13:36:15.243001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28240): Terminated: ok {rc=0} 13:36:15.286811 --- ParallelTerminationStrategy: PID 28241 died... 13:36:15.305400 run iperf3-srv_10.42.42.10(pid=28241): Terminated {rc=256} 13:36:15.349374 --- ParallelTerminationStrategy: PID 28242 died... 13:36:15.367955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28242): Terminated: ok {rc=0} 13:36:15.411812 --- ParallelTerminationStrategy: PID 28243 died... 13:36:15.430496 run iperf3-srv_10.42.42.10(pid=28243): Terminated {rc=256} 13:36:15.474127 --- ParallelTerminationStrategy: PID 28246 died... 13:36:15.492610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28246): Terminated: ok {rc=0} 13:36:15.536015 --- ParallelTerminationStrategy: PID 28249 died... 13:36:15.554564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28249): Terminated: ok {rc=0} 13:36:15.598430 --- ParallelTerminationStrategy: PID 28252 died... 13:36:15.617184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28252): Terminated: ok {rc=0} 13:36:15.703295 bus /gobi_4: Setting Powered False 13:36:16.803765 bus /gobi_4: Setting Powered False 13:36:17.923213 bus /gobi_1: Setting Powered False 13:36:19.019543 bus /gobi_1: Setting Powered False 13:36:20.134653 bus /gobi_0: Setting Powered False 13:36:21.232834 bus /gobi_0: Setting Powered False 13:36:22.349769 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:36:23.453210 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:23.465622 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:36:23.538041 tst ping.py: using LAC 41257 13:36:23.663990 tst ping.py: using RAC 202 13:36:23.788530 tst ping.py: using CellId 41257 13:36:23.913413 tst ping.py: using BVCI 41258 13:36:24.029183 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:24.040547 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:24.051960 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:24.063279 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:24.074788 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:24.086341 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:24.097957 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:24.109493 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:36:24.225571 tst ping.py:19: start network... 13:36:24.426460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:24.890251 run create_hlr_db(pid=28255): Launched 13:36:25.015371 bus /gobi_6: Setting Powered False 13:36:26.075241 run create_hlr_db(pid=28255): Terminated: ok {rc=0} 13:36:26.513428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28257): Launched 13:36:26.834893 run osmo-hlr_10.42.42.2(pid=28258): Launched 13:36:26.957196 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:27.506605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28260): Launched 13:36:27.827313 run osmo-stp_10.42.42.5(pid=28261): Launched 13:36:27.949529 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:28.502182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28263): Launched 13:36:28.624191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:28.893895 run patchelf(pid=28264): Launched 13:36:29.070568 run osmo-stp_10.42.42.5(pid=28261): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28261)] 13:36:29.205640 run osmo-stp_10.42.42.5(pid=28261): stdout: | (launched: 2022-12-14_13:36:27.768335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:29.342668 run osmo-stp_10.42.42.5(pid=28261): stderr: | 20221214133627960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133627960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133627961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133627961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133627962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133627962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133627962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:29.479513 run osmo-stp_10.42.42.5(pid=28261): stdout: | (launched: 2022-12-14_13:36:27.768335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:29.610176 run osmo-stp_10.42.42.5(pid=28261): stderr: | 20221214133627960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133627960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133627961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133627961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133627962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133627962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133627962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:29.765241 run patchelf(pid=28264): Terminating (SIGINT) 13:36:29.943330 run patchelf(pid=28264): Terminated: ok {rc=0} 13:36:30.072004 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28261): Process ended prematurely: osmo-stp_10.42.42.5(pid=28261) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28261)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 13:36:30.081447 tst ping.py:22: Test FAILED (6.6 sec) 13:36:30.109551 run osmo-hlr_10.42.42.2(pid=28258): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28258)] 13:36:30.160312 run osmo-hlr_10.42.42.2(pid=28258): stdout: | (launched: 2022-12-14_13:36:26.776480) 13:36:30.212824 run osmo-hlr_10.42.42.2(pid=28258): stderr: | 20221214133626974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133626974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133626974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133626974 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133626974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133626974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133626987 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133626995 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133626995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133626995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:30.265941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28257): Terminating (SIGTERM) 13:36:30.308065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28260): Terminating (SIGTERM) 13:36:30.350840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28263): Terminating (SIGTERM) 13:36:30.393441 --- ParallelTerminationStrategy: PID 28257 died... 13:36:30.413856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28257): Terminated: ok {rc=0} 13:36:30.460803 --- ParallelTerminationStrategy: PID 28260 died... 13:36:30.481369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28260): Terminated: ok {rc=0} 13:36:30.528353 --- ParallelTerminationStrategy: PID 28263 died... 13:36:30.548673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28263): Terminated: ok {rc=0} 13:36:30.638084 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:36:31.723981 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:31.736191 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:36:31.811397 tst ping_idle_ping.py: using LAC 41258 13:36:31.932761 tst ping_idle_ping.py: using RAC 203 13:36:32.083324 tst ping_idle_ping.py: using CellId 41258 13:36:32.232255 tst ping_idle_ping.py: using BVCI 41259 13:36:32.341593 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:32.352428 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:32.363135 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:32.373835 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:32.384336 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:32.394963 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:32.405727 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:36:32.416363 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:36:32.535224 tst ping_idle_ping.py:24: start network... 13:36:32.751135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:33.247406 run create_hlr_db(pid=28265): Launched 13:36:33.370995 bus /gobi_6: Setting Powered False 13:36:34.433677 run create_hlr_db(pid=28265): Terminated: ok {rc=0} 13:36:34.879973 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28267): Launched 13:36:35.201113 run osmo-hlr_10.42.42.2(pid=28268): Launched 13:36:35.324079 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:35.874971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28270): Launched 13:36:36.196762 run osmo-stp_10.42.42.5(pid=28271): Launched 13:36:36.321173 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:36.874115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28273): Launched 13:36:36.998513 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:37.270082 run patchelf(pid=28274): Launched 13:36:37.449064 run osmo-stp_10.42.42.5(pid=28271): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28271)] 13:36:37.585713 run osmo-stp_10.42.42.5(pid=28271): stdout: | (launched: 2022-12-14_13:36:36.138058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:37.723359 run osmo-stp_10.42.42.5(pid=28271): stderr: | 20221214133636331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133636331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133636331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133636331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133636332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133636332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133636332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:37.861265 run osmo-stp_10.42.42.5(pid=28271): stdout: | (launched: 2022-12-14_13:36:36.138058) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:37.993726 run osmo-stp_10.42.42.5(pid=28271): stderr: | 20221214133636331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133636331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133636331 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133636331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133636332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133636332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133636332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:38.150706 run patchelf(pid=28274): Terminating (SIGINT) 13:36:38.330890 run patchelf(pid=28274): Terminated: ok {rc=0} 13:36:38.460038 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28271): Process ended prematurely: osmo-stp_10.42.42.5(pid=28271) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28271)] [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:36:38.469635 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 13:36:38.497461 run osmo-hlr_10.42.42.2(pid=28268): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28268)] 13:36:38.548689 run osmo-hlr_10.42.42.2(pid=28268): stdout: | (launched: 2022-12-14_13:36:35.142388) 13:36:38.600843 run osmo-hlr_10.42.42.2(pid=28268): stderr: | 20221214133635342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133635342 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133635342 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133635342 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133635342 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133635342 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133635355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133635363 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133635364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133635364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:38.653697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28267): Terminating (SIGTERM) 13:36:38.695482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28270): Terminating (SIGTERM) 13:36:38.737712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28273): Terminating (SIGTERM) 13:36:38.780171 --- ParallelTerminationStrategy: PID 28267 died... 13:36:38.801032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28267): Terminated: ok {rc=0} 13:36:38.848085 --- ParallelTerminationStrategy: PID 28270 died... 13:36:38.868361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28270): Terminated: ok {rc=0} 13:36:38.915469 --- ParallelTerminationStrategy: PID 28273 died... 13:36:38.935106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28273): Terminated: ok {rc=0} 13:36:39.025837 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 13:36:40.334572 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:36:40.341540 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 13:36:40.374598 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 13:36:40.416432 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 13:36:40.506941 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 13:36:40.541309 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 13:36:40.581099 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 13:36:41.181433 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 13:36:41.232688 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:41.244228 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:36:41.297423 tst cs_paging_gprs_active.py: using LAC 41259 13:36:41.418367 tst cs_paging_gprs_active.py: using RAC 204 13:36:41.543404 tst cs_paging_gprs_active.py: using CellId 41259 13:36:41.663410 tst cs_paging_gprs_active.py: using BVCI 41260 13:36:41.775387 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:41.786579 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:41.797615 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:41.808617 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:41.820058 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:41.831424 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:41.842968 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:41.854354 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:41.866011 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:36:41.986487 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:36:42.105179 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:36:42.326884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:42.654891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28278): Launched 13:36:42.940521 run iperf3-srv_10.42.42.10(pid=28279): Launched 13:36:43.062780 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:36:43.283457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:43.610576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28280): Launched 13:36:43.896844 run iperf3-srv_10.42.42.10(pid=28281): Launched 13:36:44.018812 tst cs_paging_gprs_active.py:38: start network... 13:36:44.238895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:44.744397 run create_hlr_db(pid=28282): Launched 13:36:44.868703 bus /gobi_6: Setting Powered False 13:36:45.946866 run create_hlr_db(pid=28282): Terminated: ok {rc=0} 13:36:46.401770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28284): Launched 13:36:46.733357 run osmo-hlr_10.42.42.2(pid=28285): Launched 13:36:47.001904 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:47.581018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28287): Launched 13:36:47.906781 run osmo-stp_10.42.42.5(pid=28288): Launched 13:36:48.031231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:36:48.593788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28290): Launched 13:36:48.718901 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:36:48.993947 run patchelf(pid=28291): Launched 13:36:49.174407 run osmo-stp_10.42.42.5(pid=28288): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28288)] 13:36:49.312486 run osmo-stp_10.42.42.5(pid=28288): stdout: | (launched: 2022-12-14_13:36:47.847252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:49.451699 run osmo-stp_10.42.42.5(pid=28288): stderr: | 20221214133648041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133648041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133648041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133648042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133648042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133648042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133648042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:49.590771 run osmo-stp_10.42.42.5(pid=28288): stdout: | (launched: 2022-12-14_13:36:47.847252) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:36:49.724509 run osmo-stp_10.42.42.5(pid=28288): stderr: | 20221214133648041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133648041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133648041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133648042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133648042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133648042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133648042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:36:49.882543 run patchelf(pid=28291): Terminating (SIGINT) 13:36:50.064354 run patchelf(pid=28291): Terminated: ok {rc=0} 13:36:50.195786 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28288): Process ended prematurely: osmo-stp_10.42.42.5(pid=28288) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28288)] [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 13:36:50.205970 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 13:36:50.234375 run osmo-hlr_10.42.42.2(pid=28285): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28285)] 13:36:50.285465 run osmo-hlr_10.42.42.2(pid=28285): stdout: | (launched: 2022-12-14_13:36:46.666040) 13:36:50.337970 run osmo-hlr_10.42.42.2(pid=28285): stderr: | 20221214133646946 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133646946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133646946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133646946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133646946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133646946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133646959 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133646971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133646972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133646972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:36:50.390648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28278): Terminating (SIGTERM) 13:36:50.432692 run iperf3-srv_10.42.42.10(pid=28279): Terminating (SIGTERM) 13:36:50.474923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28280): Terminating (SIGTERM) 13:36:50.517332 run iperf3-srv_10.42.42.10(pid=28281): Terminating (SIGTERM) 13:36:50.559610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28284): Terminating (SIGTERM) 13:36:50.601925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28287): Terminating (SIGTERM) 13:36:50.644106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28290): Terminating (SIGTERM) 13:36:50.686816 --- ParallelTerminationStrategy: PID 28278 died... 13:36:50.707187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28278): Terminated: ok {rc=0} 13:36:50.754029 --- ParallelTerminationStrategy: PID 28279 died... 13:36:50.774034 run iperf3-srv_10.42.42.10(pid=28279): Terminated {rc=256} 13:36:50.820459 --- ParallelTerminationStrategy: PID 28280 died... 13:36:50.840222 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28280): Terminated: ok {rc=0} 13:36:50.886668 --- ParallelTerminationStrategy: PID 28281 died... 13:36:50.906668 run iperf3-srv_10.42.42.10(pid=28281): Terminated {rc=256} 13:36:50.953151 --- ParallelTerminationStrategy: PID 28284 died... 13:36:50.973126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28284): Terminated: ok {rc=0} 13:36:51.019569 --- ParallelTerminationStrategy: PID 28287 died... 13:36:51.039598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28287): Terminated: ok {rc=0} 13:36:51.086399 --- ParallelTerminationStrategy: PID 28290 died... 13:36:51.106251 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28290): Terminated: ok {rc=0} 13:36:51.194731 bus /gobi_0: Setting Powered False 13:36:52.294487 bus /gobi_0: Setting Powered False 13:36:53.410347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 13:36:54.558912 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:54.571226 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:36:54.628208 tst iperf3.py: using LAC 41260 13:36:54.749577 tst iperf3.py: using RAC 205 13:36:54.870226 tst iperf3.py: using CellId 41260 13:36:54.990501 tst iperf3.py: using BVCI 41261 13:36:55.102682 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:55.114345 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:55.125721 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:55.136841 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:55.148084 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:55.159254 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:55.170566 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:55.181694 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:36:55.193082 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:36:55.306740 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:36:55.509874 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:36:55.813436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28292): Launched 13:36:56.077152 run iperf3-srv_10.42.42.10(pid=28293): Launched 13:36:56.190099 tst iperf3.py:8: start network... 13:36:56.391827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:36:56.859561 run create_hlr_db(pid=28294): Launched 13:36:56.982989 bus /gobi_6: Setting Powered False 13:36:58.042841 run create_hlr_db(pid=28294): Terminated: ok {rc=0} 13:36:58.465241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28296): Launched 13:36:58.768844 run osmo-hlr_10.42.42.2(pid=28297): Launched 13:36:58.883877 run osmo-stp_10.42.42.5: Starting osmo-stp 13:36:59.405250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28299): Launched 13:36:59.707173 run osmo-stp_10.42.42.5(pid=28300): Launched 13:36:59.821937 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:00.343943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28302): Launched 13:37:00.459351 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:00.714890 run patchelf(pid=28303): Launched 13:37:00.918777 run osmo-stp_10.42.42.5(pid=28300): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28300)] 13:37:01.062346 run osmo-stp_10.42.42.5(pid=28300): stdout: | (launched: 2022-12-14_13:36:59.651144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:01.205784 run osmo-stp_10.42.42.5(pid=28300): stderr: | 20221214133659822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133659822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133659822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133659822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133659823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133659823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133659823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:01.351018 run osmo-stp_10.42.42.5(pid=28300): stdout: | (launched: 2022-12-14_13:36:59.651144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:01.488751 run osmo-stp_10.42.42.5(pid=28300): stderr: | 20221214133659822 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133659822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133659822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133659822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133659823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133659823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133659823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:01.653887 run patchelf(pid=28303): Terminating (SIGINT) 13:37:01.842337 run patchelf(pid=28303): Terminated: ok {rc=0} 13:37:01.979436 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28300): Process ended prematurely: osmo-stp_10.42.42.5(pid=28300) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28300)] [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 13:37:01.990787 tst iperf3.py:8: Test FAILED (7.5 sec) 13:37:02.021496 run osmo-hlr_10.42.42.2(pid=28297): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28297)] 13:37:02.075982 run osmo-hlr_10.42.42.2(pid=28297): stdout: | (launched: 2022-12-14_13:36:58.712298) 13:37:02.131221 run osmo-hlr_10.42.42.2(pid=28297): stderr: | 20221214133658890 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133658890 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133658890 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133658891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133658891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133658891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133658902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133658911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133658912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133658912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:02.184035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28292): Terminating (SIGTERM) 13:37:02.226002 run iperf3-srv_10.42.42.10(pid=28293): Terminating (SIGTERM) 13:37:02.268371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28296): Terminating (SIGTERM) 13:37:02.310904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28299): Terminating (SIGTERM) 13:37:02.353772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28302): Terminating (SIGTERM) 13:37:02.396727 --- ParallelTerminationStrategy: PID 28292 died... 13:37:02.417358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28292): Terminated: ok {rc=0} 13:37:02.464413 --- ParallelTerminationStrategy: PID 28293 died... 13:37:02.484553 run iperf3-srv_10.42.42.10(pid=28293): Terminated {rc=256} 13:37:02.531266 --- ParallelTerminationStrategy: PID 28296 died... 13:37:02.551372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28296): Terminated: ok {rc=0} 13:37:02.598141 --- ParallelTerminationStrategy: PID 28299 died... 13:37:02.618165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28299): Terminated: ok {rc=0} 13:37:02.665262 --- ParallelTerminationStrategy: PID 28302 died... 13:37:02.685522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28302): Terminated: ok {rc=0} 13:37:02.775010 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 13:37:03.920297 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:03.932317 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:37:03.983813 tst iperf3m4.py: using LAC 41261 13:37:04.104804 tst iperf3m4.py: using RAC 206 13:37:04.225457 tst iperf3m4.py: using CellId 41261 13:37:04.354931 tst iperf3m4.py: using BVCI 41262 13:37:04.474473 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:04.486453 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:04.498245 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:04.510036 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:04.522114 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:04.533916 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:04.545885 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:04.557699 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:04.570464 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:37:04.687086 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:37:04.805324 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:37:04.921585 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:37:05.036711 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:37:05.239542 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:05.542926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28304): Launched 13:37:05.806114 run iperf3-srv_10.42.42.10(pid=28305): Launched 13:37:05.921082 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:37:06.122885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:06.425986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28306): Launched 13:37:06.688647 run iperf3-srv_10.42.42.10(pid=28307): Launched 13:37:06.802289 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:37:07.004296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:07.307649 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28308): Launched 13:37:07.570419 run iperf3-srv_10.42.42.10(pid=28309): Launched 13:37:07.686094 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:37:07.887535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:37:08.190102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28310): Launched 13:37:08.456062 run iperf3-srv_10.42.42.10(pid=28311): Launched 13:37:08.569065 tst iperf3m4.py:8: start network... 13:37:08.771273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:09.240823 run create_hlr_db(pid=28312): Launched 13:37:09.365234 bus /gobi_6: Setting Powered False 13:37:10.425839 run create_hlr_db(pid=28312): Terminated: ok {rc=0} 13:37:10.850426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28314): Launched 13:37:11.154012 run osmo-hlr_10.42.42.2(pid=28315): Launched 13:37:11.268259 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:11.789690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28317): Launched 13:37:12.092409 run osmo-stp_10.42.42.5(pid=28318): Launched 13:37:12.207628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:12.729634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28321): Launched 13:37:12.845823 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:13.101843 run patchelf(pid=28322): Launched 13:37:13.270030 run osmo-stp_10.42.42.5(pid=28318): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28318)] 13:37:13.397704 run osmo-stp_10.42.42.5(pid=28318): stdout: | (launched: 2022-12-14_13:37:12.036553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:13.526997 run osmo-stp_10.42.42.5(pid=28318): stderr: | 20221214133712206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133712206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133712207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133712207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133712209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133712210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133712210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:13.656424 run osmo-stp_10.42.42.5(pid=28318): stdout: | (launched: 2022-12-14_13:37:12.036553) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:13.780186 run osmo-stp_10.42.42.5(pid=28318): stderr: | 20221214133712206 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133712206 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133712207 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133712207 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133712209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133712210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133712210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:13.927006 run patchelf(pid=28322): Terminating (SIGINT) 13:37:14.097128 run patchelf(pid=28322): Terminated: ok {rc=0} 13:37:14.219508 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28318): Process ended prematurely: osmo-stp_10.42.42.5(pid=28318) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28318)] [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 13:37:14.228856 tst iperf3m4.py:8: Test FAILED (10.3 sec) 13:37:14.256164 run osmo-hlr_10.42.42.2(pid=28315): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28315)] 13:37:14.303900 run osmo-hlr_10.42.42.2(pid=28315): stdout: | (launched: 2022-12-14_13:37:11.097831) 13:37:14.353492 run osmo-hlr_10.42.42.2(pid=28315): stderr: | 20221214133711274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133711274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133711275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133711275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133711275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133711275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133711287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133711297 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133711297 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133711297 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:14.403122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28304): Terminating (SIGTERM) 13:37:14.442831 run iperf3-srv_10.42.42.10(pid=28305): Terminating (SIGTERM) 13:37:14.482379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28306): Terminating (SIGTERM) 13:37:14.521809 run iperf3-srv_10.42.42.10(pid=28307): Terminating (SIGTERM) 13:37:14.561763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28308): Terminating (SIGTERM) 13:37:14.601480 run iperf3-srv_10.42.42.10(pid=28309): Terminating (SIGTERM) 13:37:14.640937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28310): Terminating (SIGTERM) 13:37:14.680585 run iperf3-srv_10.42.42.10(pid=28311): Terminating (SIGTERM) 13:37:14.720098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28314): Terminating (SIGTERM) 13:37:14.759639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28317): Terminating (SIGTERM) 13:37:14.799064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28321): Terminating (SIGTERM) 13:37:14.839557 --- ParallelTerminationStrategy: PID 28304 died... 13:37:14.858809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28304): Terminated: ok {rc=0} 13:37:14.902721 --- ParallelTerminationStrategy: PID 28305 died... 13:37:14.921223 run iperf3-srv_10.42.42.10(pid=28305): Terminated {rc=256} 13:37:14.964937 --- ParallelTerminationStrategy: PID 28306 died... 13:37:14.983632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28306): Terminated: ok {rc=0} 13:37:15.027417 --- ParallelTerminationStrategy: PID 28307 died... 13:37:15.046009 run iperf3-srv_10.42.42.10(pid=28307): Terminated {rc=256} 13:37:15.089611 --- ParallelTerminationStrategy: PID 28308 died... 13:37:15.108235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28308): Terminated: ok {rc=0} 13:37:15.152005 --- ParallelTerminationStrategy: PID 28309 died... 13:37:15.170545 run iperf3-srv_10.42.42.10(pid=28309): Terminated {rc=256} 13:37:15.214122 --- ParallelTerminationStrategy: PID 28310 died... 13:37:15.232669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28310): Terminated: ok {rc=0} 13:37:15.276541 --- ParallelTerminationStrategy: PID 28311 died... 13:37:15.295129 run iperf3-srv_10.42.42.10(pid=28311): Terminated {rc=256} 13:37:15.338837 --- ParallelTerminationStrategy: PID 28314 died... 13:37:15.357617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28314): Terminated: ok {rc=0} 13:37:15.401250 --- ParallelTerminationStrategy: PID 28317 died... 13:37:15.419728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28317): Terminated: ok {rc=0} 13:37:15.463633 --- ParallelTerminationStrategy: PID 28321 died... 13:37:15.482323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28321): Terminated: ok {rc=0} 13:37:15.567770 bus /gobi_4: Setting Powered False 13:37:16.672854 bus /gobi_4: Setting Powered False 13:37:17.787457 bus /gobi_1: Setting Powered False 13:37:18.886040 bus /gobi_1: Setting Powered False 13:37:20.004231 bus /gobi_0: Setting Powered False 13:37:21.102792 bus /gobi_0: Setting Powered False 13:37:22.219237 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 13:37:23.322375 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:23.334905 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:37:23.389463 tst ping.py: using LAC 41262 13:37:23.515614 tst ping.py: using RAC 207 13:37:23.644249 tst ping.py: using CellId 41262 13:37:23.768678 tst ping.py: using BVCI 41263 13:37:23.883920 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:23.895684 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:23.907217 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:23.918803 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:23.930678 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:23.942571 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:23.954477 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:23.966297 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:37:24.081908 tst ping.py:19: start network... 13:37:24.281671 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:24.743017 run create_hlr_db(pid=28323): Launched 13:37:24.865605 bus /gobi_6: Setting Powered False 13:37:25.924875 run create_hlr_db(pid=28323): Terminated: ok {rc=0} 13:37:26.341684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28325): Launched 13:37:26.640387 run osmo-hlr_10.42.42.2(pid=28326): Launched 13:37:26.752654 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:27.285547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28328): Launched 13:37:27.584510 run osmo-stp_10.42.42.5(pid=28329): Launched 13:37:27.698182 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:28.232650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28331): Launched 13:37:28.347079 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:28.599618 run patchelf(pid=28332): Launched 13:37:28.764706 run osmo-stp_10.42.42.5(pid=28329): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28329)] 13:37:28.890707 run osmo-stp_10.42.42.5(pid=28329): stdout: | (launched: 2022-12-14_13:37:27.528812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:29.019024 run osmo-stp_10.42.42.5(pid=28329): stderr: | 20221214133727701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133727701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133727701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133727702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133727702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133727702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133727702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:29.147084 run osmo-stp_10.42.42.5(pid=28329): stdout: | (launched: 2022-12-14_13:37:27.528812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:29.269770 run osmo-stp_10.42.42.5(pid=28329): stderr: | 20221214133727701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133727701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133727701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133727702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133727702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133727702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133727702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:29.414831 run patchelf(pid=28332): Terminating (SIGINT) 13:37:29.581481 run patchelf(pid=28332): Terminated: ok {rc=0} 13:37:29.701570 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28329): Process ended prematurely: osmo-stp_10.42.42.5(pid=28329) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28329)] [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 13:37:29.710413 tst ping.py:22: Test FAILED (6.4 sec) 13:37:29.736906 run osmo-hlr_10.42.42.2(pid=28326): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28326)] 13:37:29.784925 run osmo-hlr_10.42.42.2(pid=28326): stdout: | (launched: 2022-12-14_13:37:26.585432) 13:37:29.834369 run osmo-hlr_10.42.42.2(pid=28326): stderr: | 20221214133726761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133726761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133726761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133726761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133726761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133726761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133726773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133726782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133726782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133726782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:29.884053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28325): Terminating (SIGTERM) 13:37:29.924040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28328): Terminating (SIGTERM) 13:37:29.964136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28331): Terminating (SIGTERM) 13:37:30.004436 --- ParallelTerminationStrategy: PID 28325 died... 13:37:30.023782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28325): Terminated: ok {rc=0} 13:37:30.068103 --- ParallelTerminationStrategy: PID 28328 died... 13:37:30.086680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28328): Terminated: ok {rc=0} 13:37:30.130822 --- ParallelTerminationStrategy: PID 28331 died... 13:37:30.149587 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28331): Terminated: ok {rc=0} 13:37:30.235680 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 13:37:31.323234 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:31.336877 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 13:37:31.394237 tst ping_idle_ping.py: using LAC 41263 13:37:31.545905 tst ping_idle_ping.py: using RAC 208 13:37:31.680328 tst ping_idle_ping.py: using CellId 41263 13:37:31.814210 tst ping_idle_ping.py: using BVCI 41264 13:37:31.958986 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:31.971841 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:31.984501 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:31.997369 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:32.010873 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:32.026633 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:32.040349 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 13:37:32.053997 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 13:37:32.184648 tst ping_idle_ping.py:24: start network... 13:37:32.405067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:32.905446 run create_hlr_db(pid=28333): Launched 13:37:33.028293 bus /gobi_6: Setting Powered False 13:37:34.091151 run create_hlr_db(pid=28333): Terminated: ok {rc=0} 13:37:34.537617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28335): Launched 13:37:34.856712 run osmo-hlr_10.42.42.2(pid=28336): Launched 13:37:34.980711 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:35.533552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28338): Launched 13:37:35.855798 run osmo-stp_10.42.42.5(pid=28339): Launched 13:37:35.978965 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:36.533246 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28341): Launched 13:37:36.655507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:36.926115 run patchelf(pid=28342): Launched 13:37:37.105419 run osmo-stp_10.42.42.5(pid=28339): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28339)] 13:37:37.241370 run osmo-stp_10.42.42.5(pid=28339): stdout: | (launched: 2022-12-14_13:37:35.796931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:37.379342 run osmo-stp_10.42.42.5(pid=28339): stderr: | 20221214133735988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133735988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133735989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133735989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133735991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133735991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133735991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:37.517107 run osmo-stp_10.42.42.5(pid=28339): stdout: | (launched: 2022-12-14_13:37:35.796931) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:37.648899 run osmo-stp_10.42.42.5(pid=28339): stderr: | 20221214133735988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133735988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133735989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133735989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133735991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133735991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133735991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:37.805152 run patchelf(pid=28342): Terminating (SIGINT) 13:37:37.984121 run patchelf(pid=28342): Terminated: ok {rc=0} 13:37:38.113120 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28339): Process ended prematurely: osmo-stp_10.42.42.5(pid=28339) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28339)] [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 13:37:38.122771 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 13:37:38.150818 run osmo-hlr_10.42.42.2(pid=28336): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28336)] 13:37:38.201803 run osmo-hlr_10.42.42.2(pid=28336): stdout: | (launched: 2022-12-14_13:37:34.798328) 13:37:38.253946 run osmo-hlr_10.42.42.2(pid=28336): stderr: | 20221214133734997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133734997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133734997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133734997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133734997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133734997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133735012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133735023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133735023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133735024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:38.307258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28335): Terminating (SIGTERM) 13:37:38.349628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28338): Terminating (SIGTERM) 13:37:38.392147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28341): Terminating (SIGTERM) 13:37:38.434761 --- ParallelTerminationStrategy: PID 28335 died... 13:37:38.455158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28335): Terminated: ok {rc=0} 13:37:38.502026 --- ParallelTerminationStrategy: PID 28338 died... 13:37:38.521946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28338): Terminated: ok {rc=0} 13:37:38.568448 --- ParallelTerminationStrategy: PID 28341 died... 13:37:38.588387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28341): Terminated: ok {rc=0} 13:37:38.676683 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:37:39.990789 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:39.997951 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:37:40.031066 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:37:40.067950 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:37:40.124860 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:37:40.158633 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:37:40.194466 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:37:40.757435 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:37:40.762898 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:37:40.774657 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:37:40.846930 tst switch_tch_pdch.py: using LAC 41264 13:37:40.971466 tst switch_tch_pdch.py: using RAC 209 13:37:41.096119 tst switch_tch_pdch.py: using CellId 41264 13:37:41.222914 tst switch_tch_pdch.py: using BVCI 41265 13:37:41.331449 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:37:41.342747 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:37:41.354028 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:37:41.365125 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:37:41.376105 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:37:41.386905 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:37:41.397828 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:37:41.408701 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:37:41.528451 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:37:41.644679 tst switch_tch_pdch.py:51: start network... 13:37:41.845821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:42.309256 run create_hlr_db(pid=28346): Launched 13:37:42.431118 bus /gobi_6: Setting Powered False 13:37:43.490115 run create_hlr_db(pid=28346): Terminated: ok {rc=0} 13:37:43.906239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28348): Launched 13:37:44.204428 run osmo-hlr_10.42.42.2(pid=28349): Launched 13:37:44.317925 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:44.842897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28351): Launched 13:37:45.140216 run osmo-stp_10.42.42.5(pid=28352): Launched 13:37:45.253787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:45.768024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28354): Launched 13:37:45.913356 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:46.173672 run patchelf(pid=28355): Launched 13:37:46.390877 run osmo-stp_10.42.42.5(pid=28352): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28352)] 13:37:46.559717 run osmo-stp_10.42.42.5(pid=28352): stdout: | (launched: 2022-12-14_13:37:45.085311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:46.693051 run osmo-stp_10.42.42.5(pid=28352): stderr: | 20221214133745254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133745254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133745254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133745255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133745255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133745255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133745255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:46.823049 run osmo-stp_10.42.42.5(pid=28352): stdout: | (launched: 2022-12-14_13:37:45.085311) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:46.948258 run osmo-stp_10.42.42.5(pid=28352): stderr: | 20221214133745254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133745254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133745254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133745255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133745255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133745255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133745255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:47.096036 run patchelf(pid=28355): Terminating (SIGINT) 13:37:47.286364 run patchelf(pid=28355): Terminated: ok {rc=0} 13:37:47.416306 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28352): Process ended prematurely: osmo-stp_10.42.42.5(pid=28352) [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28352)] [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:37:47.426300 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 13:37:47.454530 run osmo-hlr_10.42.42.2(pid=28349): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28349)] 13:37:47.506384 run osmo-hlr_10.42.42.2(pid=28349): stdout: | (launched: 2022-12-14_13:37:44.149291) 13:37:47.559536 run osmo-hlr_10.42.42.2(pid=28349): stderr: | 20221214133744326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133744326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133744326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133744326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133744326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133744326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133744337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133744347 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133744347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133744347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:47.612863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28348): Terminating (SIGTERM) 13:37:47.654892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28351): Terminating (SIGTERM) 13:37:47.697924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28354): Terminating (SIGTERM) 13:37:47.740519 --- ParallelTerminationStrategy: PID 28348 died... 13:37:47.760934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28348): Terminated: ok {rc=0} 13:37:47.807745 --- ParallelTerminationStrategy: PID 28351 died... 13:37:47.827719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28351): Terminated: ok {rc=0} 13:37:47.874378 --- ParallelTerminationStrategy: PID 28354 died... 13:37:47.894380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28354): Terminated: ok {rc=0} 13:37:47.983103 bus /gobi_0: Setting Powered False 13:37:49.080276 bus /gobi_0: Setting Powered False 13:37:50.196403 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:37:51.450457 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:37:51.456695 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:37:51.489663 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:37:51.525730 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:37:51.579471 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:37:51.612133 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:37:51.647257 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:37:52.204565 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:37:52.209988 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:37:52.221249 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:37:52.291070 tst switch_tch_pdch.py: using LAC 41265 13:37:52.415333 tst switch_tch_pdch.py: using RAC 210 13:37:52.539566 tst switch_tch_pdch.py: using CellId 41265 13:37:52.665077 tst switch_tch_pdch.py: using BVCI 41266 13:37:52.780170 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:37:52.791555 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:37:52.802796 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:37:52.813973 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:37:52.825328 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:37:52.836682 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:37:52.848203 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:37:52.859655 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:37:52.974514 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:37:53.094677 tst switch_tch_pdch.py:51: start network... 13:37:53.310767 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:37:53.777388 run create_hlr_db(pid=28359): Launched 13:37:53.898977 bus /gobi_6: Setting Powered False 13:37:54.962408 run create_hlr_db(pid=28359): Terminated: ok {rc=0} 13:37:55.363946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28361): Launched 13:37:55.662468 run osmo-hlr_10.42.42.2(pid=28362): Launched 13:37:55.778061 run osmo-stp_10.42.42.5: Starting osmo-stp 13:37:56.264406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28364): Launched 13:37:56.562925 run osmo-stp_10.42.42.5(pid=28365): Launched 13:37:56.677492 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:37:57.165496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28367): Launched 13:37:57.279611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:37:57.532081 run patchelf(pid=28368): Launched 13:37:57.697292 run osmo-stp_10.42.42.5(pid=28365): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28365)] 13:37:57.823095 run osmo-stp_10.42.42.5(pid=28365): stdout: | (launched: 2022-12-14_13:37:56.507166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:57.950664 run osmo-stp_10.42.42.5(pid=28365): stderr: | 20221214133756678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133756679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133756679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133756679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133756680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133756680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133756680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:58.078028 run osmo-stp_10.42.42.5(pid=28365): stdout: | (launched: 2022-12-14_13:37:56.507166) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:37:58.200187 run osmo-stp_10.42.42.5(pid=28365): stderr: | 20221214133756678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133756679 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133756679 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133756679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133756680 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133756680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133756680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:37:58.345017 run patchelf(pid=28368): Terminating (SIGINT) 13:37:58.511021 run patchelf(pid=28368): Terminated: ok {rc=0} 13:37:58.630956 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=28365): Process ended prematurely: osmo-stp_10.42.42.5(pid=28365) [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28365)] [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:37:58.639708 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 13:37:58.665931 run osmo-hlr_10.42.42.2(pid=28362): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28362)] 13:37:58.713804 run osmo-hlr_10.42.42.2(pid=28362): stdout: | (launched: 2022-12-14_13:37:55.607594) 13:37:58.762808 run osmo-hlr_10.42.42.2(pid=28362): stderr: | 20221214133755785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133755785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133755785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133755785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133755785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133755785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133755797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133755806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133755806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133755806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:37:58.812273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28361): Terminating (SIGTERM) 13:37:58.852240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28364): Terminating (SIGTERM) 13:37:58.892012 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28367): Terminating (SIGTERM) 13:37:58.931867 --- ParallelTerminationStrategy: PID 28361 died... 13:37:58.951117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28361): Terminated: ok {rc=0} 13:37:58.995133 --- ParallelTerminationStrategy: PID 28364 died... 13:37:59.013923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28364): Terminated: ok {rc=0} 13:37:59.057720 --- ParallelTerminationStrategy: PID 28367 died... 13:37:59.076449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28367): Terminated: ok {rc=0} 13:37:59.162583 bus /gobi_0: Setting Powered False 13:38:00.259999 bus /gobi_0: Setting Powered False 13:38:01.379204 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_sms:trx-lms --------------------------------------------------------------------- 13:38:02.630473 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:02.634747 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 13:38:02.668396 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 13:38:02.676704 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 13:38:02.731160 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 13:38:02.764684 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 13:38:02.771748 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 13:38:03.308645 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 13:38:03.313961 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 13:38:03.324917 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 13:38:03.374574 tst mo_mt_sms.py: using LAC 41266 13:38:03.491783 tst mo_mt_sms.py: using RAC 211 13:38:03.620781 tst mo_mt_sms.py: using CellId 41266 13:38:03.746577 tst mo_mt_sms.py: using BVCI 41267 13:38:03.862209 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 13:38:03.976303 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 13:38:04.088769 tst mo_mt_sms.py:9: start nitb and bts... 13:38:04.288831 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:38:04.894555 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28372): Launched 13:38:05.193264 run osmo-nitb_10.42.42.2(pid=28373): Launched 13:38:05.358729 run osmo-nitb_10.42.42.2(pid=28373): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28373)] 13:38:05.491856 run osmo-nitb_10.42.42.2(pid=28373): stdout: | (launched: 2022-12-14_13:38:05.138393) 13:38:05.626451 run osmo-nitb_10.42.42.2(pid=28373): stderr: | (launched: 2022-12-14_13:38:05.182952) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:38:05.761086 run osmo-nitb_10.42.42.2(pid=28373): stdout: | (launched: 2022-12-14_13:38:05.138393) 13:38:05.889999 run osmo-nitb_10.42.42.2(pid=28373): stderr: | (launched: 2022-12-14_13:38:05.182952) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28373): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28373) [trial-2405↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28373)] 13:38:06.306432 tst osmo-nitb_10.42.42.2(pid=28373): stdout: | (launched: 2022-12-14_13:38:05.138393) 13:38:06.427367 tst osmo-nitb_10.42.42.2(pid=28373): stderr: | (launched: 2022-12-14_13:38:05.182952) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:38:06.569814 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=28373): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28373) [trial-2405↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28373)] [trial-2405↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 13:38:06.578097 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:38:06.584675 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28372): Terminating (SIGTERM) 13:38:06.793724 --- ParallelTerminationStrategy: PID 28372 died... 13:38:06.814610 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28372): Terminated: ok {rc=0} 13:38:06.900858 bus /sierra_3: Setting Powered False 13:38:08.000803 bus /sierra_3: Setting Powered False 13:38:09.116134 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 sms:trx-lms --------------------------------------------------------------------- 13:38:10.313306 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:10.317331 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 13:38:10.349724 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:38:10.376310 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 13:38:10.428011 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 13:38:10.461623 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:38:10.489161 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 13:38:11.035159 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 13:38:11.040608 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:11.051586 tst sms:trx-lms: Using 1 x bts (candidates: 1) 13:38:11.104063 tst mo_mt_sms.py: using LAC 41267 13:38:11.228186 tst mo_mt_sms.py: using RAC 212 13:38:11.352925 tst mo_mt_sms.py: using CellId 41267 13:38:11.477788 tst mo_mt_sms.py: using BVCI 41268 13:38:11.594836 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:11.605974 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:11.616878 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:11.627974 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:11.639027 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:11.650384 tst sms:trx-lms: Using 1 x modem (candidates: 2) 13:38:11.766699 tst sms:trx-lms: Using 1 x modem (candidates: 2) 13:38:11.887930 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:12.382330 run create_hlr_db(pid=28377): Launched 13:38:12.505973 bus /sierra_2: Setting Powered False 13:38:13.569466 run create_hlr_db(pid=28377): Terminated: ok {rc=0} 13:38:13.995543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28379): Launched 13:38:14.294325 run osmo-hlr_10.42.42.2(pid=28380): Launched 13:38:14.407919 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:14.958401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28382): Launched 13:38:15.278596 run osmo-stp_10.42.42.5(pid=28383): Launched 13:38:15.401589 run osmo-msc_10.42.42.6: Starting osmo-msc 13:38:16.023436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28385): Launched 13:38:16.336524 run osmo-msc_10.42.42.6(pid=28386): Launched 13:38:16.788416 run osmo-stp_10.42.42.5(pid=28383): ERR: Terminated: ERROR {rc=1} [trial-2405↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28383)] 13:38:17.173854 run osmo-stp_10.42.42.5(pid=28383): stdout: | (launched: 2022-12-14_13:38:15.219989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:17.323846 run osmo-stp_10.42.42.5(pid=28383): stderr: | 20221214133815414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133815414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133815415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133815415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133815415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133815415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133815415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:17.459344 run osmo-stp_10.42.42.5(pid=28383): stdout: | (launched: 2022-12-14_13:38:15.219989) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:17.589183 run osmo-stp_10.42.42.5(pid=28383): stderr: | 20221214133815414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133815414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133815415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133815415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133815415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133815415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133815415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:17.742754 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=28383): Process ended prematurely: osmo-stp_10.42.42.5(pid=28383) [trial-2405↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28383)] [trial-2405↪sms:trx-lms↪mo_mt_sms.py:16] 13:38:17.751715 tst mo_mt_sms.py:16: Test FAILED (6.7 sec) 13:38:17.779287 run osmo-hlr_10.42.42.2(pid=28380): ERR: Terminated: ERROR {rc=237} [trial-2405↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28380)] 13:38:17.831348 run osmo-hlr_10.42.42.2(pid=28380): stdout: | (launched: 2022-12-14_13:38:14.239600) 13:38:17.883630 run osmo-hlr_10.42.42.2(pid=28380): stderr: | 20221214133814415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133814415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133814415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133814415 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133814415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133814415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133814427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133814435 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133814435 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133814435 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:17.957382 run osmo-msc_10.42.42.6(pid=28386): ERR: Terminated: ERROR {rc=2} [trial-2405↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28386)] 13:38:18.007367 run osmo-msc_10.42.42.6(pid=28386): stdout: | (launched: 2022-12-14_13:38:16.277227) 13:38:18.060372 run osmo-msc_10.42.42.6(pid=28386): stderr: | 20221214133816718 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133816718 DLGLOBAL DEBUG validating counter group 0x7f450ba3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133816718 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133816718 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133816718 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133816720 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133816725 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133816728 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133816729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133816729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:38:18.112827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28379): Terminating (SIGTERM) 13:38:18.155500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28382): Terminating (SIGTERM) 13:38:18.198203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28385): Terminating (SIGTERM) 13:38:18.241978 --- ParallelTerminationStrategy: PID 28379 died... 13:38:18.262845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28379): Terminated: ok {rc=0} 13:38:18.309731 --- ParallelTerminationStrategy: PID 28382 died... 13:38:18.329609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28382): Terminated: ok {rc=0} 13:38:18.376432 --- ParallelTerminationStrategy: PID 28385 died... 13:38:18.396313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28385): Terminated: ok {rc=0} 13:38:18.484426 bus /sierra_3: Setting Powered False 13:38:19.582498 bus /sierra_3: Setting Powered False 13:38:20.696661 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-lms --------------------------------------------------------------------- 13:38:21.928752 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:21.932870 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 13:38:21.966465 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 13:38:21.974886 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 13:38:22.011084 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 13:38:22.045251 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 13:38:22.052359 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 13:38:22.570783 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 13:38:22.576245 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 13:38:22.587464 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 13:38:22.636036 tst assert_extension.py: using LAC 41268 13:38:22.760813 tst assert_extension.py: using RAC 213 13:38:22.888679 tst assert_extension.py: using CellId 41268 13:38:23.014009 tst assert_extension.py: using BVCI 41269 13:38:23.123823 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 13:38:23.241080 tst assert_extension.py:10: start nitb and bts... 13:38:23.457899 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:38:24.111278 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28391): Launched 13:38:24.431178 run osmo-nitb_10.42.42.2(pid=28392): Launched 13:38:24.609379 run osmo-nitb_10.42.42.2(pid=28392): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28392)] 13:38:24.752186 run osmo-nitb_10.42.42.2(pid=28392): stdout: | (launched: 2022-12-14_13:38:24.372806) 13:38:24.896549 run osmo-nitb_10.42.42.2(pid=28392): stderr: | (launched: 2022-12-14_13:38:24.420351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:38:25.041098 run osmo-nitb_10.42.42.2(pid=28392): stdout: | (launched: 2022-12-14_13:38:24.372806) 13:38:25.179546 run osmo-nitb_10.42.42.2(pid=28392): stderr: | (launched: 2022-12-14_13:38:24.420351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=28392): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28392) [trial-2405↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28392)] 13:38:25.553494 tst osmo-nitb_10.42.42.2(pid=28392): stdout: | (launched: 2022-12-14_13:38:24.372806) 13:38:25.682585 tst osmo-nitb_10.42.42.2(pid=28392): stderr: | (launched: 2022-12-14_13:38:24.420351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:38:25.835111 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=28392): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28392) [trial-2405↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28392)] [trial-2405↪nitb_ussd:trx-lms↪assert_extension.py:12] 13:38:25.843990 tst assert_extension.py:12: Test FAILED (3.3 sec) 13:38:25.851061 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28391): Terminating (SIGTERM) 13:38:26.062972 --- ParallelTerminationStrategy: PID 28391 died... 13:38:26.084666 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=28391): Terminated: ok {rc=0} 13:38:26.174781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 ussd:trx-lms --------------------------------------------------------------------- 13:38:27.351323 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:27.355595 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 13:38:27.388552 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:38:27.416378 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 13:38:27.451432 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 13:38:27.484120 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:38:27.510688 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 13:38:28.039082 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 ussd:trx-lms assert_extension.py ---------------------------------------------- 13:38:28.044392 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:28.055053 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 13:38:28.102702 tst assert_extension.py: using LAC 41269 13:38:28.221344 tst assert_extension.py: using RAC 214 13:38:28.338020 tst assert_extension.py: using CellId 41269 13:38:28.454083 tst assert_extension.py: using BVCI 41270 13:38:28.563064 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:28.573623 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:28.584027 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:28.594381 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:28.604682 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 13:38:28.615413 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 13:38:28.733388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:29.196214 run create_hlr_db(pid=28396): Launched 13:38:29.318853 bus /sierra_2: Setting Powered False 13:38:30.378516 run create_hlr_db(pid=28396): Terminated: ok {rc=0} 13:38:30.816519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28398): Launched 13:38:31.155911 run osmo-hlr_10.42.42.2(pid=28399): Launched 13:38:31.319294 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:32.010988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28401): Launched 13:38:32.437693 run osmo-stp_10.42.42.5(pid=28402): Launched 13:38:32.570438 run osmo-msc_10.42.42.6: Starting osmo-msc 13:38:33.155187 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28404): Launched 13:38:33.475730 run osmo-msc_10.42.42.6(pid=28405): Launched 13:38:33.654451 run osmo-stp_10.42.42.5(pid=28402): ERR: Terminated: ERROR {rc=1} [trial-2405↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28402)] 13:38:33.790590 run osmo-stp_10.42.42.5(pid=28402): stdout: | (launched: 2022-12-14_13:38:32.369918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:33.926584 run osmo-stp_10.42.42.5(pid=28402): stderr: | 20221214133832579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133832580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133832580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133832580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133832581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133832581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133832581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:34.061669 run osmo-stp_10.42.42.5(pid=28402): stdout: | (launched: 2022-12-14_13:38:32.369918) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:34.190153 run osmo-stp_10.42.42.5(pid=28402): stderr: | 20221214133832579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133832580 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133832580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133832580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133832581 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133832581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133832581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:34.343613 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=28402): Process ended prematurely: osmo-stp_10.42.42.5(pid=28402) [trial-2405↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28402)] [trial-2405↪ussd:trx-lms↪assert_extension.py:17] 13:38:34.352340 tst assert_extension.py:17: Test FAILED (6.3 sec) 13:38:34.379666 run osmo-hlr_10.42.42.2(pid=28399): ERR: Terminated: ERROR {rc=237} [trial-2405↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28399)] 13:38:34.430122 run osmo-hlr_10.42.42.2(pid=28399): stdout: | (launched: 2022-12-14_13:38:31.097331) 13:38:34.482240 run osmo-hlr_10.42.42.2(pid=28399): stderr: | 20221214133831448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133831448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133831448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133831448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133831448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133831448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133831463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133831479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133831479 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133831479 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:34.554392 run osmo-msc_10.42.42.6(pid=28405): ERR: Terminated: ERROR {rc=2} [trial-2405↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28405)] 13:38:34.604118 run osmo-msc_10.42.42.6(pid=28405): stdout: | (launched: 2022-12-14_13:38:33.417170) 13:38:34.655844 run osmo-msc_10.42.42.6(pid=28405): stderr: | 20221214133833737 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133833738 DLGLOBAL DEBUG validating counter group 0x7fa25e99dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133833738 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133833738 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133833738 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133833738 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133833740 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133833740 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133833740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133833740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:38:34.708142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28398): Terminating (SIGTERM) 13:38:34.749849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28401): Terminating (SIGTERM) 13:38:34.791617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28404): Terminating (SIGTERM) 13:38:34.834095 --- ParallelTerminationStrategy: PID 28398 died... 13:38:34.854422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28398): Terminated: ok {rc=0} 13:38:34.901296 --- ParallelTerminationStrategy: PID 28401 died... 13:38:34.921192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28401): Terminated: ok {rc=0} 13:38:34.967681 --- ParallelTerminationStrategy: PID 28404 died... 13:38:34.987576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28404): Terminated: ok {rc=0} 13:38:35.076117 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:38:36.285032 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:36.291886 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:38:36.324637 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:38:36.351375 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:38:36.402886 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:38:36.437121 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:38:36.465693 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:38:37.011354 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:38:37.061504 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:37.072687 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:38:37.141390 tst mo_mt_call.py: using LAC 41270 13:38:37.261198 tst mo_mt_call.py: using RAC 215 13:38:37.385650 tst mo_mt_call.py: using CellId 41270 13:38:37.503591 tst mo_mt_call.py: using BVCI 41271 13:38:37.622499 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:37.634232 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:37.645737 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:37.657274 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:37.669136 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:37.680679 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:38:37.801034 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:38:37.918632 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:38.423051 run create_hlr_db(pid=28410): Launched 13:38:38.547436 bus /sierra_2: Setting Powered False 13:38:39.611693 run create_hlr_db(pid=28410): Terminated: ok {rc=0} 13:38:40.065663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28412): Launched 13:38:40.390855 run osmo-hlr_10.42.42.2(pid=28413): Launched 13:38:40.514158 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:41.075134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28415): Launched 13:38:41.398711 run osmo-stp_10.42.42.5(pid=28416): Launched 13:38:41.523403 run osmo-msc_10.42.42.6: Starting osmo-msc 13:38:42.109445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28418): Launched 13:38:42.433991 run osmo-msc_10.42.42.6(pid=28419): Launched 13:38:42.615536 run osmo-stp_10.42.42.5(pid=28416): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28416)] 13:38:42.752084 run osmo-stp_10.42.42.5(pid=28416): stdout: | (launched: 2022-12-14_13:38:41.339781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:42.889429 run osmo-stp_10.42.42.5(pid=28416): stderr: | 20221214133841532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133841532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133841533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133841533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133841533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133841534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133841534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:43.025808 run osmo-stp_10.42.42.5(pid=28416): stdout: | (launched: 2022-12-14_13:38:41.339781) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:43.155209 run osmo-stp_10.42.42.5(pid=28416): stderr: | 20221214133841532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133841532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133841533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133841533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133841533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133841534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133841534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:43.310115 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28416): Process ended prematurely: osmo-stp_10.42.42.5(pid=28416) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28416)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:38:43.319880 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:38:43.347948 run osmo-hlr_10.42.42.2(pid=28413): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28413)] 13:38:43.398571 run osmo-hlr_10.42.42.2(pid=28413): stdout: | (launched: 2022-12-14_13:38:40.331219) 13:38:43.450538 run osmo-hlr_10.42.42.2(pid=28413): stderr: | 20221214133840529 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133840529 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133840530 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133840530 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133840530 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133840530 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133840541 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133840549 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133840550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133840550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:43.522192 run osmo-msc_10.42.42.6(pid=28419): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28419)] 13:38:43.572055 run osmo-msc_10.42.42.6(pid=28419): stdout: | (launched: 2022-12-14_13:38:42.374860) 13:38:43.624106 run osmo-msc_10.42.42.6(pid=28419): stderr: | 20221214133842696 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133842696 DLGLOBAL DEBUG validating counter group 0x7f44aa863c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133842696 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133842696 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133842696 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133842696 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133842698 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133842699 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133842699 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133842699 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:38:43.676154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28412): Terminating (SIGTERM) 13:38:43.717854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28415): Terminating (SIGTERM) 13:38:43.760134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28418): Terminating (SIGTERM) 13:38:43.802191 --- ParallelTerminationStrategy: PID 28412 died... 13:38:43.822396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28412): Terminated: ok {rc=0} 13:38:43.868514 --- ParallelTerminationStrategy: PID 28415 died... 13:38:43.888279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28415): Terminated: ok {rc=0} 13:38:43.934836 --- ParallelTerminationStrategy: PID 28418 died... 13:38:43.954715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28418): Terminated: ok {rc=0} 13:38:44.043212 bus /sierra_3: Setting Powered False 13:38:45.141927 bus /sierra_3: Setting Powered False 13:38:46.262256 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:38:47.416564 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:47.428325 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:38:47.501790 tst mo_mt_call_osmux.py: using LAC 41271 13:38:47.621776 tst mo_mt_call_osmux.py: using RAC 216 13:38:47.747804 tst mo_mt_call_osmux.py: using CellId 41271 13:38:47.873073 tst mo_mt_call_osmux.py: using BVCI 41272 13:38:47.983441 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:47.994534 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:48.005429 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:48.016226 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:48.027086 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:38:48.037923 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:38:48.158135 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:38:48.278185 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:48.748034 run create_hlr_db(pid=28421): Launched 13:38:48.872935 bus /sierra_2: Setting Powered False 13:38:49.933971 run create_hlr_db(pid=28421): Terminated: ok {rc=0} 13:38:50.358280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28423): Launched 13:38:50.661516 run osmo-hlr_10.42.42.2(pid=28424): Launched 13:38:50.776116 run osmo-stp_10.42.42.5: Starting osmo-stp 13:38:51.310062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28426): Launched 13:38:51.613864 run osmo-stp_10.42.42.5(pid=28427): Launched 13:38:51.729137 run osmo-msc_10.42.42.6: Starting osmo-msc 13:38:52.279525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28429): Launched 13:38:52.583952 run osmo-msc_10.42.42.6(pid=28430): Launched 13:38:52.753676 run osmo-stp_10.42.42.5(pid=28427): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28427)] 13:38:52.882277 run osmo-stp_10.42.42.5(pid=28427): stdout: | (launched: 2022-12-14_13:38:51.556693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:53.009898 run osmo-stp_10.42.42.5(pid=28427): stderr: | 20221214133851730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133851730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133851731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133851731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133851732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133851732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133851732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:53.136224 run osmo-stp_10.42.42.5(pid=28427): stdout: | (launched: 2022-12-14_13:38:51.556693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:38:53.256819 run osmo-stp_10.42.42.5(pid=28427): stderr: | 20221214133851730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133851730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133851731 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133851731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133851732 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133851732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133851732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:38:53.401452 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28427): Process ended prematurely: osmo-stp_10.42.42.5(pid=28427) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28427)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:38:53.410246 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:38:53.436566 run osmo-hlr_10.42.42.2(pid=28424): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28424)] 13:38:53.484329 run osmo-hlr_10.42.42.2(pid=28424): stdout: | (launched: 2022-12-14_13:38:50.605973) 13:38:53.533747 run osmo-hlr_10.42.42.2(pid=28424): stderr: | 20221214133850782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133850782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133850782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133850782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133850782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133850782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133850795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133850804 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133850804 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133850804 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:38:53.602967 run osmo-msc_10.42.42.6(pid=28430): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28430)] 13:38:53.651441 run osmo-msc_10.42.42.6(pid=28430): stdout: | (launched: 2022-12-14_13:38:52.527252) 13:38:53.700778 run osmo-msc_10.42.42.6(pid=28430): stderr: | 20221214133852800 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133852800 DLGLOBAL DEBUG validating counter group 0x7f4601f2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133852800 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133852800 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133852801 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133852801 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133852803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133852803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133852803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133852803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:38:53.750606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28423): Terminating (SIGTERM) 13:38:53.790197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28426): Terminating (SIGTERM) 13:38:53.830110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28429): Terminating (SIGTERM) 13:38:53.869896 --- ParallelTerminationStrategy: PID 28423 died... 13:38:53.889063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28423): Terminated: ok {rc=0} 13:38:53.933132 --- ParallelTerminationStrategy: PID 28426 died... 13:38:53.951672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28426): Terminated: ok {rc=0} 13:38:53.995463 --- ParallelTerminationStrategy: PID 28429 died... 13:38:54.014041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28429): Terminated: ok {rc=0} 13:38:54.097315 bus /sierra_3: Setting Powered False 13:38:55.195315 bus /sierra_3: Setting Powered False 13:38:56.310980 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:38:57.560164 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:38:57.566614 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:38:57.599151 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:38:57.625883 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:38:57.677608 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:38:57.710330 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:38:57.736789 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:38:58.287118 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:38:58.335528 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:58.346616 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:38:58.415257 tst mo_mt_call.py: using LAC 41272 13:38:58.533771 tst mo_mt_call.py: using RAC 217 13:38:58.654086 tst mo_mt_call.py: using CellId 41272 13:38:58.772578 tst mo_mt_call.py: using BVCI 41273 13:38:58.892073 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:58.903817 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:58.915493 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:58.926952 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:58.939090 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:38:58.950785 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:38:59.067084 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:38:59.185665 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:38:59.690048 run create_hlr_db(pid=28436): Launched 13:38:59.813608 bus /sierra_2: Setting Powered False 13:39:00.889283 run create_hlr_db(pid=28436): Terminated: ok {rc=0} 13:39:01.338427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28438): Launched 13:39:01.658999 run osmo-hlr_10.42.42.2(pid=28439): Launched 13:39:01.966740 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:02.802460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28489): Launched 13:39:03.184202 run osmo-stp_10.42.42.5(pid=28512): Launched 13:39:03.479538 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:04.273041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28648): Launched 13:39:04.696427 run osmo-msc_10.42.42.6(pid=28703): Launched 13:39:05.092166 run osmo-stp_10.42.42.5(pid=28512): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28512)] 13:39:05.296301 run osmo-stp_10.42.42.5(pid=28512): stdout: | (launched: 2022-12-14_13:39:03.104522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:05.426965 run osmo-stp_10.42.42.5(pid=28512): stderr: | 20221214133903454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133903454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133903455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133903455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133903455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133903456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133903456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:05.555928 run osmo-stp_10.42.42.5(pid=28512): stdout: | (launched: 2022-12-14_13:39:03.104522) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:05.678974 run osmo-stp_10.42.42.5(pid=28512): stderr: | 20221214133903454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133903454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133903455 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133903455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133903455 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133903456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133903456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:05.827914 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28512): Process ended prematurely: osmo-stp_10.42.42.5(pid=28512) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28512)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:39:05.836888 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 13:39:05.863650 run osmo-hlr_10.42.42.2(pid=28439): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28439)] 13:39:05.912052 run osmo-hlr_10.42.42.2(pid=28439): stdout: | (launched: 2022-12-14_13:39:01.602355) 13:39:05.961952 run osmo-hlr_10.42.42.2(pid=28439): stderr: | 20221214133901912 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133901912 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133901912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133901912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133901912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133901912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133901936 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133901948 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133901948 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133901953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:06.033652 run osmo-msc_10.42.42.6(pid=28703): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28703)] 13:39:06.082731 run osmo-msc_10.42.42.6(pid=28703): stdout: | (launched: 2022-12-14_13:39:04.625202) 13:39:06.133292 run osmo-msc_10.42.42.6(pid=28703): stderr: | 20221214133905086 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133905086 DLGLOBAL DEBUG validating counter group 0x7f3b7d29ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133905086 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133905086 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133905086 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133905087 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133905096 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133905101 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133905101 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133905101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:06.184648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28438): Terminating (SIGTERM) 13:39:06.226222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28489): Terminating (SIGTERM) 13:39:06.269935 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28648): Terminating (SIGTERM) 13:39:06.313831 --- ParallelTerminationStrategy: PID 28438 died... 13:39:06.333809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28438): Terminated: ok {rc=0} 13:39:06.381567 --- ParallelTerminationStrategy: PID 28489 died... 13:39:06.402259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28489): Terminated: ok {rc=0} 13:39:06.448368 --- ParallelTerminationStrategy: PID 28648 died... 13:39:06.469472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28648): Terminated: ok {rc=0} 13:39:06.559280 bus /sierra_3: Setting Powered False 13:39:07.659081 bus /sierra_3: Setting Powered False 13:39:08.775334 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:39:09.923838 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:09.937488 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:39:10.007862 tst mo_mt_call_osmux.py: using LAC 41273 13:39:10.129028 tst mo_mt_call_osmux.py: using RAC 218 13:39:10.256009 tst mo_mt_call_osmux.py: using CellId 41273 13:39:10.381143 tst mo_mt_call_osmux.py: using BVCI 41274 13:39:10.493478 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:10.507660 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:10.519933 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:10.533275 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:10.545545 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:39:10.557945 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:39:10.677176 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:39:10.796353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:11.284051 run create_hlr_db(pid=28718): Launched 13:39:11.447378 bus /sierra_2: Setting Powered False 13:39:12.509380 run create_hlr_db(pid=28718): Terminated: ok {rc=0} 13:39:12.952001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28720): Launched 13:39:13.289760 run osmo-hlr_10.42.42.2(pid=28721): Launched 13:39:13.526187 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:14.182388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28723): Launched 13:39:14.524824 run osmo-stp_10.42.42.5(pid=28724): Launched 13:39:14.774732 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:15.457958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28726): Launched 13:39:15.803771 run osmo-msc_10.42.42.6(pid=28727): Launched 13:39:16.169381 run osmo-stp_10.42.42.5(pid=28724): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28724)] 13:39:16.455672 run osmo-stp_10.42.42.5(pid=28724): stdout: | (launched: 2022-12-14_13:39:14.465292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:16.615561 run osmo-stp_10.42.42.5(pid=28724): stderr: | 20221214133914763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133914763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133914763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133914763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133914764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133914764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133914764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:16.756838 run osmo-stp_10.42.42.5(pid=28724): stdout: | (launched: 2022-12-14_13:39:14.465292) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:16.892265 run osmo-stp_10.42.42.5(pid=28724): stderr: | 20221214133914763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133914763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133914763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133914763 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133914764 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133914764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133914764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:17.053628 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28724): Process ended prematurely: osmo-stp_10.42.42.5(pid=28724) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28724)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:39:17.064341 tst mo_mt_call_osmux.py:8: Test FAILED (7.2 sec) 13:39:17.093950 run osmo-hlr_10.42.42.2(pid=28721): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28721)] 13:39:17.149498 run osmo-hlr_10.42.42.2(pid=28721): stdout: | (launched: 2022-12-14_13:39:13.218839) 13:39:17.204769 run osmo-hlr_10.42.42.2(pid=28721): stderr: | 20221214133913565 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133913565 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133913566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133913566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133913566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133913566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133913633 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133913641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133913641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133913641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:17.282065 run osmo-msc_10.42.42.6(pid=28727): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28727)] 13:39:17.336233 run osmo-msc_10.42.42.6(pid=28727): stdout: | (launched: 2022-12-14_13:39:15.740840) 13:39:17.391717 run osmo-msc_10.42.42.6(pid=28727): stderr: | 20221214133916246 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133916246 DLGLOBAL DEBUG validating counter group 0x7f0fb6d2ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133916246 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133916246 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133916246 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133916246 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133916248 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133916248 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133916249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133916249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:17.447954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28720): Terminating (SIGTERM) 13:39:17.491944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28723): Terminating (SIGTERM) 13:39:17.537868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28726): Terminating (SIGTERM) 13:39:17.584255 --- ParallelTerminationStrategy: PID 28720 died... 13:39:17.607575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28720): Terminated: ok {rc=0} 13:39:17.658600 --- ParallelTerminationStrategy: PID 28723 died... 13:39:17.680646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28723): Terminated: ok {rc=0} 13:39:17.730706 --- ParallelTerminationStrategy: PID 28726 died... 13:39:17.752814 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28726): Terminated: ok {rc=0} 13:39:17.857555 bus /sierra_3: Setting Powered False 13:39:18.979855 bus /sierra_3: Setting Powered False 13:39:20.100519 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:39:21.368116 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:21.376559 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:39:21.414687 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:39:21.444478 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:39:21.500623 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:39:21.535872 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:39:21.567046 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:39:22.117294 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:39:22.175453 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:22.188533 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:39:22.262936 tst mo_mt_call.py: using LAC 41274 13:39:22.396208 tst mo_mt_call.py: using RAC 219 13:39:22.534463 tst mo_mt_call.py: using CellId 41274 13:39:22.667153 tst mo_mt_call.py: using BVCI 41275 13:39:22.790751 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:22.803464 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:22.816157 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:22.828693 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:22.842744 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:22.856188 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:39:22.985120 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:39:23.115195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:23.642045 run create_hlr_db(pid=28732): Launched 13:39:23.809869 bus /sierra_2: Setting Powered False 13:39:24.877532 run create_hlr_db(pid=28732): Terminated: ok {rc=0} 13:39:25.354133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28734): Launched 13:39:25.706138 run osmo-hlr_10.42.42.2(pid=28735): Launched 13:39:25.833244 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:26.393581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28737): Launched 13:39:26.718470 run osmo-stp_10.42.42.5(pid=28738): Launched 13:39:26.842318 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:27.431164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28740): Launched 13:39:27.757431 run osmo-msc_10.42.42.6(pid=28741): Launched 13:39:27.937709 run osmo-stp_10.42.42.5(pid=28738): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28738)] 13:39:28.075241 run osmo-stp_10.42.42.5(pid=28738): stdout: | (launched: 2022-12-14_13:39:26.659106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:28.213496 run osmo-stp_10.42.42.5(pid=28738): stderr: | 20221214133926852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133926852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133926852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133926853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133926853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133926853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133926853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:28.351085 run osmo-stp_10.42.42.5(pid=28738): stdout: | (launched: 2022-12-14_13:39:26.659106) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:28.481229 run osmo-stp_10.42.42.5(pid=28738): stderr: | 20221214133926852 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133926852 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133926852 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133926853 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133926853 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133926853 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133926853 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:28.636268 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28738): Process ended prematurely: osmo-stp_10.42.42.5(pid=28738) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28738)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:39:28.645917 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:39:28.673680 run osmo-hlr_10.42.42.2(pid=28735): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28735)] 13:39:28.724431 run osmo-hlr_10.42.42.2(pid=28735): stdout: | (launched: 2022-12-14_13:39:25.646257) 13:39:28.777230 run osmo-hlr_10.42.42.2(pid=28735): stderr: | 20221214133925844 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133925844 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133925844 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133925845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133925845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133925845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133925858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133925867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133925868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133925868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:28.849194 run osmo-msc_10.42.42.6(pid=28741): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28741)] 13:39:28.898748 run osmo-msc_10.42.42.6(pid=28741): stdout: | (launched: 2022-12-14_13:39:27.697657) 13:39:28.950567 run osmo-msc_10.42.42.6(pid=28741): stderr: | 20221214133928021 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133928022 DLGLOBAL DEBUG validating counter group 0x7efd350f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133928022 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133928022 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133928022 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133928022 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133928024 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133928024 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133928024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133928024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:29.002592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28734): Terminating (SIGTERM) 13:39:29.044081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28737): Terminating (SIGTERM) 13:39:29.086043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28740): Terminating (SIGTERM) 13:39:29.128633 --- ParallelTerminationStrategy: PID 28734 died... 13:39:29.149056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28734): Terminated: ok {rc=0} 13:39:29.195303 --- ParallelTerminationStrategy: PID 28737 died... 13:39:29.215012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28737): Terminated: ok {rc=0} 13:39:29.261565 --- ParallelTerminationStrategy: PID 28740 died... 13:39:29.281461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28740): Terminated: ok {rc=0} 13:39:29.369123 bus /sierra_3: Setting Powered False 13:39:30.468855 bus /sierra_3: Setting Powered False 13:39:31.596081 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:39:32.760498 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:32.772761 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:39:32.843561 tst mo_mt_call_osmux.py: using LAC 41275 13:39:32.969741 tst mo_mt_call_osmux.py: using RAC 220 13:39:33.098760 tst mo_mt_call_osmux.py: using CellId 41275 13:39:33.225385 tst mo_mt_call_osmux.py: using BVCI 41276 13:39:33.335741 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:33.350849 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:33.362558 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:33.374092 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:33.386078 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:39:33.398081 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:39:33.518518 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:39:33.634553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:34.104463 run create_hlr_db(pid=28743): Launched 13:39:34.227752 bus /sierra_2: Setting Powered False 13:39:35.289182 run create_hlr_db(pid=28743): Terminated: ok {rc=0} 13:39:35.712455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28745): Launched 13:39:36.016207 run osmo-hlr_10.42.42.2(pid=28746): Launched 13:39:36.132413 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:36.652275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28748): Launched 13:39:36.954889 run osmo-stp_10.42.42.5(pid=28749): Launched 13:39:37.071405 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:37.618536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28751): Launched 13:39:37.923084 run osmo-msc_10.42.42.6(pid=28752): Launched 13:39:38.092025 run osmo-stp_10.42.42.5(pid=28749): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28749)] 13:39:38.219018 run osmo-stp_10.42.42.5(pid=28749): stdout: | (launched: 2022-12-14_13:39:36.899118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:38.346047 run osmo-stp_10.42.42.5(pid=28749): stderr: | 20221214133937069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133937070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133937070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133937070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133937071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133937071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133937071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:38.471987 run osmo-stp_10.42.42.5(pid=28749): stdout: | (launched: 2022-12-14_13:39:36.899118) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:38.592056 run osmo-stp_10.42.42.5(pid=28749): stderr: | 20221214133937069 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133937070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133937070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133937070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133937071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133937071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133937071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:38.735838 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28749): Process ended prematurely: osmo-stp_10.42.42.5(pid=28749) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28749)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:39:38.744931 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:39:38.771240 run osmo-hlr_10.42.42.2(pid=28746): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28746)] 13:39:38.818835 run osmo-hlr_10.42.42.2(pid=28746): stdout: | (launched: 2022-12-14_13:39:35.960000) 13:39:38.867900 run osmo-hlr_10.42.42.2(pid=28746): stderr: | 20221214133936141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133936141 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133936141 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133936141 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133936141 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133936141 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133936151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133936160 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133936161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133936161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:38.936589 run osmo-msc_10.42.42.6(pid=28752): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28752)] 13:39:38.984001 run osmo-msc_10.42.42.6(pid=28752): stdout: | (launched: 2022-12-14_13:39:37.867506) 13:39:39.032929 run osmo-msc_10.42.42.6(pid=28752): stderr: | 20221214133938140 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133938140 DLGLOBAL DEBUG validating counter group 0x7fdfab375c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133938140 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133938141 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133938141 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133938141 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133938143 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133938143 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133938143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133938143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:39.082368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28745): Terminating (SIGTERM) 13:39:39.121783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28748): Terminating (SIGTERM) 13:39:39.161194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28751): Terminating (SIGTERM) 13:39:39.200785 --- ParallelTerminationStrategy: PID 28745 died... 13:39:39.219868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28745): Terminated: ok {rc=0} 13:39:39.263771 --- ParallelTerminationStrategy: PID 28748 died... 13:39:39.282438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28748): Terminated: ok {rc=0} 13:39:39.325994 --- ParallelTerminationStrategy: PID 28751 died... 13:39:39.344461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28751): Terminated: ok {rc=0} 13:39:39.429410 bus /sierra_3: Setting Powered False 13:39:40.527645 bus /sierra_3: Setting Powered False 13:39:41.641392 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:39:42.890709 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:39:42.897358 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:39:42.929858 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:39:42.956303 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:39:43.008608 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:39:43.042728 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:39:43.070325 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:39:43.617898 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:39:43.666384 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:43.677431 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:39:43.745395 tst mo_mt_call.py: using LAC 41276 13:39:43.864266 tst mo_mt_call.py: using RAC 221 13:39:43.984789 tst mo_mt_call.py: using CellId 41276 13:39:44.106818 tst mo_mt_call.py: using BVCI 41277 13:39:44.218505 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:44.229667 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:44.240575 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:44.251454 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:44.262419 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:44.273350 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:39:44.388018 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:39:44.501811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:44.970978 run create_hlr_db(pid=28757): Launched 13:39:45.096431 bus /sierra_2: Setting Powered False 13:39:46.155354 run create_hlr_db(pid=28757): Terminated: ok {rc=0} 13:39:46.590760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28759): Launched 13:39:46.910946 run osmo-hlr_10.42.42.2(pid=28760): Launched 13:39:47.146952 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:47.713807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28762): Launched 13:39:48.037372 run osmo-stp_10.42.42.5(pid=28763): Launched 13:39:48.160637 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:48.746934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28765): Launched 13:39:49.070668 run osmo-msc_10.42.42.6(pid=28766): Launched 13:39:49.252553 run osmo-stp_10.42.42.5(pid=28763): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28763)] 13:39:49.389900 run osmo-stp_10.42.42.5(pid=28763): stdout: | (launched: 2022-12-14_13:39:47.978223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:49.527024 run osmo-stp_10.42.42.5(pid=28763): stderr: | 20221214133948174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133948174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133948174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133948175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133948175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133948175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133948175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:49.663480 run osmo-stp_10.42.42.5(pid=28763): stdout: | (launched: 2022-12-14_13:39:47.978223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:49.793348 run osmo-stp_10.42.42.5(pid=28763): stderr: | 20221214133948174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133948174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133948174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133948175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133948175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133948175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133948175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:49.948441 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28763): Process ended prematurely: osmo-stp_10.42.42.5(pid=28763) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28763)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:39:49.958007 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:39:49.985935 run osmo-hlr_10.42.42.2(pid=28760): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28760)] 13:39:50.036453 run osmo-hlr_10.42.42.2(pid=28760): stdout: | (launched: 2022-12-14_13:39:46.854186) 13:39:50.088834 run osmo-hlr_10.42.42.2(pid=28760): stderr: | 20221214133947174 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133947174 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133947175 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133947175 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133947175 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133947175 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133947187 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133947195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133947195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133947195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:39:50.161217 run osmo-msc_10.42.42.6(pid=28766): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28766)] 13:39:50.211053 run osmo-msc_10.42.42.6(pid=28766): stdout: | (launched: 2022-12-14_13:39:49.011615) 13:39:50.262964 run osmo-msc_10.42.42.6(pid=28766): stderr: | 20221214133949334 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133949335 DLGLOBAL DEBUG validating counter group 0x7f88507bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133949335 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133949335 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133949335 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133949335 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133949338 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133949338 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133949338 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133949338 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:39:50.316078 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28759): Terminating (SIGTERM) 13:39:50.358328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28762): Terminating (SIGTERM) 13:39:50.400693 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28765): Terminating (SIGTERM) 13:39:50.442780 --- ParallelTerminationStrategy: PID 28759 died... 13:39:50.463095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28759): Terminated: ok {rc=0} 13:39:50.509602 --- ParallelTerminationStrategy: PID 28762 died... 13:39:50.529520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28762): Terminated: ok {rc=0} 13:39:50.575813 --- ParallelTerminationStrategy: PID 28765 died... 13:39:50.595784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28765): Terminated: ok {rc=0} 13:39:50.684609 bus /sierra_3: Setting Powered False 13:39:51.784439 bus /sierra_3: Setting Powered False 13:39:52.902812 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:39:54.049173 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:54.061089 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:39:54.130739 tst mo_mt_call_osmux.py: using LAC 41277 13:39:54.260328 tst mo_mt_call_osmux.py: using RAC 222 13:39:54.392921 tst mo_mt_call_osmux.py: using CellId 41277 13:39:54.519795 tst mo_mt_call_osmux.py: using BVCI 41278 13:39:54.638030 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:54.649849 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:54.661388 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:54.672857 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:54.685271 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:39:54.697510 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:39:54.819700 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:39:54.936215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:39:55.407913 run create_hlr_db(pid=28768): Launched 13:39:55.532022 bus /sierra_2: Setting Powered False 13:39:56.592388 run create_hlr_db(pid=28768): Terminated: ok {rc=0} 13:39:57.038891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Launched 13:39:57.348492 run osmo-hlr_10.42.42.2(pid=28771): Launched 13:39:57.463585 run osmo-stp_10.42.42.5: Starting osmo-stp 13:39:57.987717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Launched 13:39:58.291789 run osmo-stp_10.42.42.5(pid=28774): Launched 13:39:58.408089 run osmo-msc_10.42.42.6: Starting osmo-msc 13:39:58.958590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Launched 13:39:59.263372 run osmo-msc_10.42.42.6(pid=28777): Launched 13:39:59.433751 run osmo-stp_10.42.42.5(pid=28774): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] 13:39:59.562088 run osmo-stp_10.42.42.5(pid=28774): stdout: | (launched: 2022-12-14_13:39:58.236094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:59.690108 run osmo-stp_10.42.42.5(pid=28774): stderr: | 20221214133958407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133958407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133958408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133958408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133958410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133958410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133958410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:39:59.816824 run osmo-stp_10.42.42.5(pid=28774): stdout: | (launched: 2022-12-14_13:39:58.236094) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:39:59.938125 run osmo-stp_10.42.42.5(pid=28774): stderr: | 20221214133958407 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214133958407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214133958408 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214133958408 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214133958410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214133958410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214133958410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:00.083460 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28774): Process ended prematurely: osmo-stp_10.42.42.5(pid=28774) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:40:00.092320 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:40:00.118722 run osmo-hlr_10.42.42.2(pid=28771): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28771)] 13:40:00.166608 run osmo-hlr_10.42.42.2(pid=28771): stdout: | (launched: 2022-12-14_13:39:57.292483) 13:40:00.216197 run osmo-hlr_10.42.42.2(pid=28771): stderr: | 20221214133957467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214133957467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214133957467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214133957467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214133957467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214133957467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214133957479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214133957488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214133957488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214133957488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:00.285264 run osmo-msc_10.42.42.6(pid=28777): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28777)] 13:40:00.333159 run osmo-msc_10.42.42.6(pid=28777): stdout: | (launched: 2022-12-14_13:39:59.207554) 13:40:00.382373 run osmo-msc_10.42.42.6(pid=28777): stderr: | 20221214133959479 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214133959479 DLGLOBAL DEBUG validating counter group 0x7f6a87497c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214133959480 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214133959480 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214133959480 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214133959480 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214133959483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214133959484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214133959484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214133959484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:00.432152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Terminating (SIGTERM) 13:40:00.472062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Terminating (SIGTERM) 13:40:00.511828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Terminating (SIGTERM) 13:40:00.551755 --- ParallelTerminationStrategy: PID 28770 died... 13:40:00.570926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28770): Terminated: ok {rc=0} 13:40:00.615114 --- ParallelTerminationStrategy: PID 28773 died... 13:40:00.633742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28773): Terminated: ok {rc=0} 13:40:00.677716 --- ParallelTerminationStrategy: PID 28776 died... 13:40:00.696368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28776): Terminated: ok {rc=0} 13:40:00.780043 bus /sierra_3: Setting Powered False 13:40:01.878291 bus /sierra_3: Setting Powered False 13:40:03.008852 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:40:04.269631 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:04.276625 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:40:04.311079 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:40:04.338510 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:40:04.392624 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:40:04.426592 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:40:04.454864 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:40:05.003837 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:40:05.057668 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:05.069201 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:40:05.141236 tst mo_mt_call.py: using LAC 41278 13:40:05.262541 tst mo_mt_call.py: using RAC 223 13:40:05.383577 tst mo_mt_call.py: using CellId 41278 13:40:05.502496 tst mo_mt_call.py: using BVCI 41279 13:40:05.622611 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:05.634264 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:05.645736 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:05.657148 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:05.669754 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:05.682057 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:40:05.799391 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:40:05.920578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:06.425982 run create_hlr_db(pid=28785): Launched 13:40:06.552572 bus /sierra_2: Setting Powered False 13:40:07.617073 run create_hlr_db(pid=28785): Terminated: ok {rc=0} 13:40:08.052808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28787): Launched 13:40:08.357569 run osmo-hlr_10.42.42.2(pid=28788): Launched 13:40:08.473372 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:08.995813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28790): Launched 13:40:09.299542 run osmo-stp_10.42.42.5(pid=28791): Launched 13:40:09.416141 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:09.963390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28793): Launched 13:40:10.266666 run osmo-msc_10.42.42.6(pid=28794): Launched 13:40:10.435463 run osmo-stp_10.42.42.5(pid=28791): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28791)] 13:40:10.562688 run osmo-stp_10.42.42.5(pid=28791): stdout: | (launched: 2022-12-14_13:40:09.244013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:10.689984 run osmo-stp_10.42.42.5(pid=28791): stderr: | 20221214134009415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134009416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134009416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134009416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134009417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134009417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134009417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:10.815737 run osmo-stp_10.42.42.5(pid=28791): stdout: | (launched: 2022-12-14_13:40:09.244013) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:10.936136 run osmo-stp_10.42.42.5(pid=28791): stderr: | 20221214134009415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134009416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134009416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134009416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134009417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134009417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134009417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:11.080042 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28791): Process ended prematurely: osmo-stp_10.42.42.5(pid=28791) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28791)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:40:11.088703 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:40:11.114749 run osmo-hlr_10.42.42.2(pid=28788): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28788)] 13:40:11.162588 run osmo-hlr_10.42.42.2(pid=28788): stdout: | (launched: 2022-12-14_13:40:08.302082) 13:40:11.211573 run osmo-hlr_10.42.42.2(pid=28788): stderr: | 20221214134008477 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134008477 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134008477 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134008477 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134008477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134008477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134008489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134008498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134008498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134008498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:11.279518 run osmo-msc_10.42.42.6(pid=28794): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28794)] 13:40:11.326852 run osmo-msc_10.42.42.6(pid=28794): stdout: | (launched: 2022-12-14_13:40:10.210352) 13:40:11.376351 run osmo-msc_10.42.42.6(pid=28794): stderr: | 20221214134010483 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134010483 DLGLOBAL DEBUG validating counter group 0x7fd0ec9f7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134010484 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134010484 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134010484 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134010484 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134010486 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134010486 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134010486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134010486 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:11.425698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28787): Terminating (SIGTERM) 13:40:11.465031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28790): Terminating (SIGTERM) 13:40:11.504562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28793): Terminating (SIGTERM) 13:40:11.544164 --- ParallelTerminationStrategy: PID 28787 died... 13:40:11.563172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28787): Terminated: ok {rc=0} 13:40:11.606797 --- ParallelTerminationStrategy: PID 28790 died... 13:40:11.625335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28790): Terminated: ok {rc=0} 13:40:11.668829 --- ParallelTerminationStrategy: PID 28793 died... 13:40:11.687293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28793): Terminated: ok {rc=0} 13:40:11.772102 bus /sierra_3: Setting Powered False 13:40:12.870798 bus /sierra_3: Setting Powered False 13:40:13.983258 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:40:15.131731 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:15.144106 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:40:15.215546 tst mo_mt_call_osmux.py: using LAC 41279 13:40:15.342081 tst mo_mt_call_osmux.py: using RAC 224 13:40:15.470752 tst mo_mt_call_osmux.py: using CellId 41279 13:40:15.597646 tst mo_mt_call_osmux.py: using BVCI 41280 13:40:15.717397 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:15.728813 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:15.740128 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:15.751387 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:15.763133 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:40:15.774774 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:40:15.926922 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:40:16.044929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:16.554399 run create_hlr_db(pid=28796): Launched 13:40:16.699940 bus /sierra_2: Setting Powered False 13:40:17.761544 run create_hlr_db(pid=28796): Terminated: ok {rc=0} 13:40:18.186523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28798): Launched 13:40:18.491667 run osmo-hlr_10.42.42.2(pid=28799): Launched 13:40:18.607448 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:19.129058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28801): Launched 13:40:19.432522 run osmo-stp_10.42.42.5(pid=28802): Launched 13:40:19.547163 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:20.095376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28804): Launched 13:40:20.399616 run osmo-msc_10.42.42.6(pid=28805): Launched 13:40:20.569811 run osmo-stp_10.42.42.5(pid=28802): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28802)] 13:40:20.698323 run osmo-stp_10.42.42.5(pid=28802): stdout: | (launched: 2022-12-14_13:40:19.376240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:20.826266 run osmo-stp_10.42.42.5(pid=28802): stderr: | 20221214134019549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134019549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134019549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134019549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134019552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134019552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134019552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:20.951976 run osmo-stp_10.42.42.5(pid=28802): stdout: | (launched: 2022-12-14_13:40:19.376240) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:21.072144 run osmo-stp_10.42.42.5(pid=28802): stderr: | 20221214134019549 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134019549 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134019549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134019549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134019552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134019552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134019552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:21.216132 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28802): Process ended prematurely: osmo-stp_10.42.42.5(pid=28802) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28802)] [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:40:21.224858 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:40:21.251115 run osmo-hlr_10.42.42.2(pid=28799): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28799)] 13:40:21.298694 run osmo-hlr_10.42.42.2(pid=28799): stdout: | (launched: 2022-12-14_13:40:18.436140) 13:40:21.348022 run osmo-hlr_10.42.42.2(pid=28799): stderr: | 20221214134018615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134018615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134018615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134018615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134018615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134018615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134018627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134018636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134018637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134018637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:21.416977 run osmo-msc_10.42.42.6(pid=28805): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28805)] 13:40:21.464514 run osmo-msc_10.42.42.6(pid=28805): stdout: | (launched: 2022-12-14_13:40:20.343584) 13:40:21.513791 run osmo-msc_10.42.42.6(pid=28805): stderr: | 20221214134020614 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134020615 DLGLOBAL DEBUG validating counter group 0x7ff672390c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134020615 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134020615 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134020615 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134020615 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134020617 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134020617 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134020617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134020618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:21.563179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28798): Terminating (SIGTERM) 13:40:21.602647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28801): Terminating (SIGTERM) 13:40:21.642041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28804): Terminating (SIGTERM) 13:40:21.681668 --- ParallelTerminationStrategy: PID 28798 died... 13:40:21.700649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28798): Terminated: ok {rc=0} 13:40:21.744393 --- ParallelTerminationStrategy: PID 28801 died... 13:40:21.762998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28801): Terminated: ok {rc=0} 13:40:21.806580 --- ParallelTerminationStrategy: PID 28804 died... 13:40:21.825147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28804): Terminated: ok {rc=0} 13:40:21.907841 bus /sierra_3: Setting Powered False 13:40:23.005551 bus /sierra_3: Setting Powered False 13:40:24.121532 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:40:25.373294 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:25.380381 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:40:25.413860 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:40:25.442650 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:40:25.495676 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:40:25.528529 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:40:25.555832 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:40:26.108367 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:40:26.162249 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:26.173908 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:40:26.250889 tst mo_mt_call.py: using LAC 41280 13:40:26.372930 tst mo_mt_call.py: using RAC 225 13:40:26.490580 tst mo_mt_call.py: using CellId 41280 13:40:26.608343 tst mo_mt_call.py: using BVCI 41281 13:40:26.718004 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:26.729255 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:26.740234 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:26.751110 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:26.762121 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:26.772898 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:40:26.887072 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:40:27.000150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:27.474308 run create_hlr_db(pid=28812): Launched 13:40:27.599698 bus /sierra_2: Setting Powered False 13:40:28.659961 run create_hlr_db(pid=28812): Terminated: ok {rc=0} 13:40:29.105516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28814): Launched 13:40:29.433293 run osmo-hlr_10.42.42.2(pid=28815): Launched 13:40:29.557566 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:30.118871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28817): Launched 13:40:30.446085 run osmo-stp_10.42.42.5(pid=28818): Launched 13:40:30.577445 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:31.176851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28820): Launched 13:40:31.500914 run osmo-msc_10.42.42.6(pid=28821): Launched 13:40:31.852689 run osmo-stp_10.42.42.5(pid=28818): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28818)] 13:40:32.121353 run osmo-stp_10.42.42.5(pid=28818): stdout: | (launched: 2022-12-14_13:40:30.386136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:32.309457 run osmo-stp_10.42.42.5(pid=28818): stderr: | 20221214134030582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134030582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134030583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134030583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134030583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134030583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134030583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:32.446557 run osmo-stp_10.42.42.5(pid=28818): stdout: | (launched: 2022-12-14_13:40:30.386136) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:32.576504 run osmo-stp_10.42.42.5(pid=28818): stderr: | 20221214134030582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134030582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134030583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134030583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134030583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134030583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134030583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:32.731895 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28818): Process ended prematurely: osmo-stp_10.42.42.5(pid=28818) [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28818)] [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:40:32.741424 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:40:32.768921 run osmo-hlr_10.42.42.2(pid=28815): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28815)] 13:40:32.819657 run osmo-hlr_10.42.42.2(pid=28815): stdout: | (launched: 2022-12-14_13:40:29.373518) 13:40:32.871950 run osmo-hlr_10.42.42.2(pid=28815): stderr: | 20221214134029574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134029574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134029574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134029574 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134029575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134029575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134029590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134029600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134029601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134029601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:32.944879 run osmo-msc_10.42.42.6(pid=28821): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28821)] 13:40:32.995069 run osmo-msc_10.42.42.6(pid=28821): stdout: | (launched: 2022-12-14_13:40:31.443908) 13:40:33.047104 run osmo-msc_10.42.42.6(pid=28821): stderr: | 20221214134032041 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134032041 DLGLOBAL DEBUG validating counter group 0x7fe3ff760c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134032041 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134032041 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134032042 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134032042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134032043 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134032044 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134032044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134032044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:33.099941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28814): Terminating (SIGTERM) 13:40:33.141541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28817): Terminating (SIGTERM) 13:40:33.183686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28820): Terminating (SIGTERM) 13:40:33.225811 --- ParallelTerminationStrategy: PID 28814 died... 13:40:33.246107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28814): Terminated: ok {rc=0} 13:40:33.292751 --- ParallelTerminationStrategy: PID 28817 died... 13:40:33.312628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28817): Terminated: ok {rc=0} 13:40:33.358970 --- ParallelTerminationStrategy: PID 28820 died... 13:40:33.379105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28820): Terminated: ok {rc=0} 13:40:33.466113 bus /sierra_3: Setting Powered False 13:40:34.564322 bus /sierra_3: Setting Powered False 13:40:35.677049 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:40:36.825712 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:36.838185 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:40:36.911250 tst mo_mt_call_osmux.py: using LAC 41281 13:40:37.039146 tst mo_mt_call_osmux.py: using RAC 226 13:40:37.166328 tst mo_mt_call_osmux.py: using CellId 41281 13:40:37.293396 tst mo_mt_call_osmux.py: using BVCI 41282 13:40:37.413243 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:37.425054 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:37.436481 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:37.447946 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:37.459808 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:40:37.471503 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:40:37.587491 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:40:37.706363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:38.210518 run create_hlr_db(pid=28823): Launched 13:40:38.335993 bus /sierra_2: Setting Powered False 13:40:39.401057 run create_hlr_db(pid=28823): Terminated: ok {rc=0} 13:40:39.855051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28825): Launched 13:40:40.182388 run osmo-hlr_10.42.42.2(pid=28826): Launched 13:40:40.308456 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:40.869879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28828): Launched 13:40:41.195287 run osmo-stp_10.42.42.5(pid=28829): Launched 13:40:41.319389 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:41.914796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28831): Launched 13:40:42.241406 run osmo-msc_10.42.42.6(pid=28832): Launched 13:40:42.423361 run osmo-stp_10.42.42.5(pid=28829): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28829)] 13:40:42.561304 run osmo-stp_10.42.42.5(pid=28829): stdout: | (launched: 2022-12-14_13:40:41.135844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:42.701669 run osmo-stp_10.42.42.5(pid=28829): stderr: | 20221214134041329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134041329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134041330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134041330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134041331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134041331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134041331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:42.838893 run osmo-stp_10.42.42.5(pid=28829): stdout: | (launched: 2022-12-14_13:40:41.135844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:42.969240 run osmo-stp_10.42.42.5(pid=28829): stderr: | 20221214134041329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134041329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134041330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134041330 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134041331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134041331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134041331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:43.125395 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28829): Process ended prematurely: osmo-stp_10.42.42.5(pid=28829) [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28829)] [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:40:43.134869 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 13:40:43.162755 run osmo-hlr_10.42.42.2(pid=28826): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28826)] 13:40:43.214149 run osmo-hlr_10.42.42.2(pid=28826): stdout: | (launched: 2022-12-14_13:40:40.123248) 13:40:43.266723 run osmo-hlr_10.42.42.2(pid=28826): stderr: | 20221214134040323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134040323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134040323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134040323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134040323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134040323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134040335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134040345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134040345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134040345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:43.339858 run osmo-msc_10.42.42.6(pid=28832): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28832)] 13:40:43.390049 run osmo-msc_10.42.42.6(pid=28832): stdout: | (launched: 2022-12-14_13:40:42.181699) 13:40:43.442073 run osmo-msc_10.42.42.6(pid=28832): stderr: | 20221214134042502 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134042502 DLGLOBAL DEBUG validating counter group 0x7f048e839c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134042502 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134042502 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134042502 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134042502 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134042504 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134042504 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134042504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134042504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:43.494272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28825): Terminating (SIGTERM) 13:40:43.536723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28828): Terminating (SIGTERM) 13:40:43.579409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28831): Terminating (SIGTERM) 13:40:43.622123 --- ParallelTerminationStrategy: PID 28825 died... 13:40:43.642791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28825): Terminated: ok {rc=0} 13:40:43.689482 --- ParallelTerminationStrategy: PID 28828 died... 13:40:43.709525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28828): Terminated: ok {rc=0} 13:40:43.756039 --- ParallelTerminationStrategy: PID 28831 died... 13:40:43.776080 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28831): Terminated: ok {rc=0} 13:40:43.863794 bus /sierra_3: Setting Powered False 13:40:44.961715 bus /sierra_3: Setting Powered False 13:40:46.087491 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:40:47.352252 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:40:47.359537 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:40:47.393785 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:40:47.421226 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:40:47.475935 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:40:47.510104 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:40:47.537511 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:40:48.086589 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:40:48.139363 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:48.150687 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:40:48.225780 tst mo_mt_call.py: using LAC 41282 13:40:48.356058 tst mo_mt_call.py: using RAC 227 13:40:48.482107 tst mo_mt_call.py: using CellId 41282 13:40:48.608350 tst mo_mt_call.py: using BVCI 41283 13:40:48.726143 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:48.737496 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:48.748901 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:48.759911 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:48.771258 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:48.782790 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:40:48.900053 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:40:49.019742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:49.524301 run create_hlr_db(pid=28837): Launched 13:40:49.648719 bus /sierra_2: Setting Powered False 13:40:50.712899 run create_hlr_db(pid=28837): Terminated: ok {rc=0} 13:40:51.166513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28839): Launched 13:40:51.493694 run osmo-hlr_10.42.42.2(pid=28840): Launched 13:40:51.619895 run osmo-stp_10.42.42.5: Starting osmo-stp 13:40:52.184264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28844): Launched 13:40:52.509851 run osmo-stp_10.42.42.5(pid=28845): Launched 13:40:52.634813 run osmo-msc_10.42.42.6: Starting osmo-msc 13:40:53.222813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28847): Launched 13:40:53.550626 run osmo-msc_10.42.42.6(pid=28848): Launched 13:40:53.733306 run osmo-stp_10.42.42.5(pid=28845): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28845)] 13:40:53.870959 run osmo-stp_10.42.42.5(pid=28845): stdout: | (launched: 2022-12-14_13:40:52.450170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:54.009077 run osmo-stp_10.42.42.5(pid=28845): stderr: | 20221214134052646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134052646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134052646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134052646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134052647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134052647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134052647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:54.146056 run osmo-stp_10.42.42.5(pid=28845): stdout: | (launched: 2022-12-14_13:40:52.450170) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:40:54.276296 run osmo-stp_10.42.42.5(pid=28845): stderr: | 20221214134052646 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134052646 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134052646 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134052646 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134052647 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134052647 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134052647 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:40:54.432731 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28845): Process ended prematurely: osmo-stp_10.42.42.5(pid=28845) [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28845)] [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:40:54.442304 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:40:54.469820 run osmo-hlr_10.42.42.2(pid=28840): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28840)] 13:40:54.520515 run osmo-hlr_10.42.42.2(pid=28840): stdout: | (launched: 2022-12-14_13:40:51.434596) 13:40:54.572045 run osmo-hlr_10.42.42.2(pid=28840): stderr: | 20221214134051633 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134051633 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134051633 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134051633 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134051633 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134051633 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134051646 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134051654 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134051654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134051654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:40:54.645082 run osmo-msc_10.42.42.6(pid=28848): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28848)] 13:40:54.694880 run osmo-msc_10.42.42.6(pid=28848): stdout: | (launched: 2022-12-14_13:40:53.491595) 13:40:54.746900 run osmo-msc_10.42.42.6(pid=28848): stderr: | 20221214134053813 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134053814 DLGLOBAL DEBUG validating counter group 0x7f031ab9fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134053814 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134053814 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134053814 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134053814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134053816 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134053816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134053816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134053816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:40:54.799143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28839): Terminating (SIGTERM) 13:40:54.840887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28844): Terminating (SIGTERM) 13:40:54.883398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28847): Terminating (SIGTERM) 13:40:54.925547 --- ParallelTerminationStrategy: PID 28839 died... 13:40:54.945840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28839): Terminated: ok {rc=0} 13:40:54.992242 --- ParallelTerminationStrategy: PID 28844 died... 13:40:55.012049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28844): Terminated: ok {rc=0} 13:40:55.058316 --- ParallelTerminationStrategy: PID 28847 died... 13:40:55.078123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28847): Terminated: ok {rc=0} 13:40:55.165630 bus /sierra_3: Setting Powered False 13:40:56.263821 bus /sierra_3: Setting Powered False 13:40:57.379256 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:40:58.526173 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:58.537819 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:40:58.606565 tst mo_mt_call_osmux.py: using LAC 41283 13:40:58.724202 tst mo_mt_call_osmux.py: using RAC 228 13:40:58.841733 tst mo_mt_call_osmux.py: using CellId 41283 13:40:58.958448 tst mo_mt_call_osmux.py: using BVCI 41284 13:40:59.067463 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:59.078409 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:59.089198 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:59.099834 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:59.110634 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:40:59.121417 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:40:59.235954 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:40:59.354477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:40:59.824177 run create_hlr_db(pid=28850): Launched 13:40:59.947493 bus /sierra_2: Setting Powered False 13:41:01.025095 run create_hlr_db(pid=28850): Terminated: ok {rc=0} 13:41:01.509317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Launched 13:41:01.851920 run osmo-hlr_10.42.42.2(pid=28853): Launched 13:41:02.071907 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:02.618457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Launched 13:41:02.922643 run osmo-stp_10.42.42.5(pid=28856): Launched 13:41:03.037248 run osmo-msc_10.42.42.6: Starting osmo-msc 13:41:03.605954 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Launched 13:41:03.910785 run osmo-msc_10.42.42.6(pid=28859): Launched 13:41:04.081289 run osmo-stp_10.42.42.5(pid=28856): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] 13:41:04.209665 run osmo-stp_10.42.42.5(pid=28856): stdout: | (launched: 2022-12-14_13:41:02.866363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:04.337597 run osmo-stp_10.42.42.5(pid=28856): stderr: | 20221214134103038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134103038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134103039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134103039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134103040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134103040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134103040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:04.463891 run osmo-stp_10.42.42.5(pid=28856): stdout: | (launched: 2022-12-14_13:41:02.866363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:04.584379 run osmo-stp_10.42.42.5(pid=28856): stderr: | 20221214134103038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134103038 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134103039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134103039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134103040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134103040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134103040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:04.729839 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28856): Process ended prematurely: osmo-stp_10.42.42.5(pid=28856) [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:41:04.738442 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:41:04.764796 run osmo-hlr_10.42.42.2(pid=28853): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28853)] 13:41:04.812475 run osmo-hlr_10.42.42.2(pid=28853): stdout: | (launched: 2022-12-14_13:41:01.792639) 13:41:04.861680 run osmo-hlr_10.42.42.2(pid=28853): stderr: | 20221214134102129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134102129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134102129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134102129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134102129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134102129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134102148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134102156 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134102157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134102157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:04.930274 run osmo-msc_10.42.42.6(pid=28859): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28859)] 13:41:04.977813 run osmo-msc_10.42.42.6(pid=28859): stdout: | (launched: 2022-12-14_13:41:03.854984) 13:41:05.026670 run osmo-msc_10.42.42.6(pid=28859): stderr: | 20221214134104125 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134104126 DLGLOBAL DEBUG validating counter group 0x7f6869091c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134104126 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134104126 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134104126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134104126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134104129 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134104130 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134104130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134104130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:41:05.076023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Terminating (SIGTERM) 13:41:05.115383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Terminating (SIGTERM) 13:41:05.154760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Terminating (SIGTERM) 13:41:05.194385 --- ParallelTerminationStrategy: PID 28852 died... 13:41:05.213347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28852): Terminated: ok {rc=0} 13:41:05.257216 --- ParallelTerminationStrategy: PID 28855 died... 13:41:05.275673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28855): Terminated: ok {rc=0} 13:41:05.319181 --- ParallelTerminationStrategy: PID 28858 died... 13:41:05.337835 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28858): Terminated: ok {rc=0} 13:41:05.423235 bus /sierra_3: Setting Powered False 13:41:06.522489 bus /sierra_3: Setting Powered False 13:41:07.638154 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 emergency:trx-lms --------------------------------------------------------------------- 13:41:08.885231 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:41:08.889884 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 13:41:08.922240 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 13:41:08.948546 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 13:41:09.034253 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 13:41:09.069856 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 13:41:09.098399 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 13:41:09.677178 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2405 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 13:41:09.682610 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:09.693841 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 13:41:09.747644 tst emergency_mo_mt_call.py: using LAC 41284 13:41:09.866657 tst emergency_mo_mt_call.py: using RAC 229 13:41:09.984585 tst emergency_mo_mt_call.py: using CellId 41284 13:41:10.100932 tst emergency_mo_mt_call.py: using BVCI 41285 13:41:10.208569 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:10.219217 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:10.229623 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:10.239999 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:10.250331 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:10.260535 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:41:10.375299 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:41:10.491036 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:10.953977 run create_hlr_db(pid=28864): Launched 13:41:11.078161 bus /sierra_2: Setting Powered False 13:41:12.139107 run create_hlr_db(pid=28864): Terminated: ok {rc=0} 13:41:12.554479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28866): Launched 13:41:12.852425 run osmo-hlr_10.42.42.2(pid=28867): Launched 13:41:12.965397 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:13.490597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28869): Launched 13:41:13.789879 run osmo-stp_10.42.42.5(pid=28870): Launched 13:41:13.913218 tst emergency_mo_mt_call.py: using MSISDN 8710 13:41:14.082194 run osmo-msc_10.42.42.6: Starting osmo-msc 13:41:14.617407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28872): Launched 13:41:14.917016 run osmo-msc_10.42.42.6(pid=28873): Launched 13:41:15.083924 run osmo-stp_10.42.42.5(pid=28870): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28870)] 13:41:15.210523 run osmo-stp_10.42.42.5(pid=28870): stdout: | (launched: 2022-12-14_13:41:13.733941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:15.336698 run osmo-stp_10.42.42.5(pid=28870): stderr: | 20221214134113907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134113907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134113907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134113907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134113908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134113908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134113908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:15.461082 run osmo-stp_10.42.42.5(pid=28870): stdout: | (launched: 2022-12-14_13:41:13.733941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:15.579599 run osmo-stp_10.42.42.5(pid=28870): stderr: | 20221214134113907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134113907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134113907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134113907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134113908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134113908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134113908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:15.721483 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=28870): Process ended prematurely: osmo-stp_10.42.42.5(pid=28870) [trial-2405↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28870)] [trial-2405↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 13:41:15.729713 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 13:41:15.755466 run osmo-hlr_10.42.42.2(pid=28867): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28867)] 13:41:15.803407 run osmo-hlr_10.42.42.2(pid=28867): stdout: | (launched: 2022-12-14_13:41:12.797540) 13:41:15.861931 run osmo-hlr_10.42.42.2(pid=28867): stderr: | 20221214134112972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134112972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134112972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134112972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134112972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134112973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134112984 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134112993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134112993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134112993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:15.931809 run osmo-msc_10.42.42.6(pid=28873): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28873)] 13:41:15.980405 run osmo-msc_10.42.42.6(pid=28873): stdout: | (launched: 2022-12-14_13:41:14.861815) 13:41:16.030894 run osmo-msc_10.42.42.6(pid=28873): stderr: | 20221214134115131 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134115131 DLGLOBAL DEBUG validating counter group 0x7f0c2a8c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134115131 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134115131 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134115132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134115132 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134115134 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134115134 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134115134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134115134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:41:16.081850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28866): Terminating (SIGTERM) 13:41:16.122747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28869): Terminating (SIGTERM) 13:41:16.163512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28872): Terminating (SIGTERM) 13:41:16.205664 --- ParallelTerminationStrategy: PID 28866 died... 13:41:16.225162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28866): Terminated: ok {rc=0} 13:41:16.271481 --- ParallelTerminationStrategy: PID 28869 died... 13:41:16.290724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28869): Terminated: ok {rc=0} 13:41:16.335164 --- ParallelTerminationStrategy: PID 28872 died... 13:41:16.354644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28872): Terminated: ok {rc=0} 13:41:16.442328 bus /sierra_3: Setting Powered False 13:41:17.537503 bus /sierra_3: Setting Powered False 13:41:18.651643 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 13:41:19.738558 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:19.750080 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 13:41:19.800291 tst emergency_preemptive_call.py: using LAC 41285 13:41:19.927422 tst emergency_preemptive_call.py: using RAC 230 13:41:20.054028 tst emergency_preemptive_call.py: using CellId 41285 13:41:20.180764 tst emergency_preemptive_call.py: using BVCI 41286 13:41:20.296686 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:20.307812 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:20.318787 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:20.329816 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:20.341140 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 13:41:20.352341 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:41:20.468411 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:41:20.589493 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:41:20.705506 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 13:41:20.823250 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:21.319693 run create_hlr_db(pid=28875): Launched 13:41:21.443951 bus /sierra_2: Setting Powered False 13:41:22.507707 run create_hlr_db(pid=28875): Terminated: ok {rc=0} 13:41:22.935851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Launched 13:41:23.233533 run osmo-hlr_10.42.42.2(pid=28878): Launched 13:41:23.346785 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:23.862868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Launched 13:41:24.161245 run osmo-stp_10.42.42.5(pid=28881): Launched 13:41:24.284149 tst emergency_preemptive_call.py: using MSISDN 8711 13:41:24.437364 run osmo-msc_10.42.42.6: Starting osmo-msc 13:41:24.973724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Launched 13:41:25.271452 run osmo-msc_10.42.42.6(pid=28884): Launched 13:41:25.438146 run osmo-stp_10.42.42.5(pid=28881): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] 13:41:25.564014 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-14_13:41:24.106174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:25.689344 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221214134124276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134124276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134124276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134124277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134124277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134124278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134124278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:25.813396 run osmo-stp_10.42.42.5(pid=28881): stdout: | (launched: 2022-12-14_13:41:24.106174) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:25.931417 run osmo-stp_10.42.42.5(pid=28881): stderr: | 20221214134124276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134124276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134124276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134124277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134124277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134124278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134124278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:26.073344 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2405↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] [trial-2405↪emergency:trx-lms↪emergency_preemptive_call.py:32] 13:41:26.081504 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 13:41:26.107371 run osmo-hlr_10.42.42.2(pid=28878): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28878)] 13:41:26.154940 run osmo-hlr_10.42.42.2(pid=28878): stdout: | (launched: 2022-12-14_13:41:23.178435) 13:41:26.204029 run osmo-hlr_10.42.42.2(pid=28878): stderr: | 20221214134123357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134123357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134123357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134123357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134123357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134123357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134123368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134123377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134123378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134123378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:26.272740 run osmo-msc_10.42.42.6(pid=28884): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=28884)] 13:41:26.320066 run osmo-msc_10.42.42.6(pid=28884): stdout: | (launched: 2022-12-14_13:41:25.216371) 13:41:26.369269 run osmo-msc_10.42.42.6(pid=28884): stderr: | 20221214134125486 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134125486 DLGLOBAL DEBUG validating counter group 0x7f98343d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134125487 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134125487 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134125487 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134125487 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134125489 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134125489 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134125489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134125490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:41:26.418849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminating (SIGTERM) 13:41:26.458161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminating (SIGTERM) 13:41:26.497465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Terminating (SIGTERM) 13:41:26.537448 --- ParallelTerminationStrategy: PID 28877 died... 13:41:26.556332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28877): Terminated: ok {rc=0} 13:41:26.599970 --- ParallelTerminationStrategy: PID 28880 died... 13:41:26.618544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28880): Terminated: ok {rc=0} 13:41:26.662029 --- ParallelTerminationStrategy: PID 28883 died... 13:41:26.680532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=28883): Terminated: ok {rc=0} 13:41:26.765286 bus /sierra_9: Setting Powered False 13:41:27.864072 bus /sierra_9: Setting Powered False 13:41:28.977774 bus /sierra_8: Setting Powered False 13:41:30.076129 bus /sierra_8: Setting Powered False 13:41:31.196146 bus /sierra_3: Setting Powered False 13:41:32.298613 bus /sierra_3: Setting Powered False 13:41:33.416717 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-lms --------------------------------------------------------------------- 13:41:34.701499 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:41:34.707627 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 13:41:34.741641 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 13:41:34.781786 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 13:41:34.868427 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 13:41:34.902227 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 13:41:34.941858 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 13:41:35.534750 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 13:41:35.587957 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:35.598849 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:41:35.645886 tst cs_paging_gprs_active.py: using LAC 41286 13:41:35.775601 tst cs_paging_gprs_active.py: using RAC 231 13:41:35.894383 tst cs_paging_gprs_active.py: using CellId 41286 13:41:36.012027 tst cs_paging_gprs_active.py: using BVCI 41287 13:41:36.122005 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:36.132605 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:36.143121 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:36.153448 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:36.163582 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:36.173859 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:36.184173 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:36.194380 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:36.204663 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:41:36.324352 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:41:36.442264 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:41:36.646723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:36.953202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28889): Launched 13:41:37.217923 run iperf3-srv_10.42.42.10(pid=28890): Launched 13:41:37.333287 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:41:37.536897 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:37.842309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28891): Launched 13:41:38.106555 run iperf3-srv_10.42.42.10(pid=28892): Launched 13:41:38.221834 tst cs_paging_gprs_active.py:38: start network... 13:41:38.424897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:38.895116 run create_hlr_db(pid=28893): Launched 13:41:39.018855 bus /sierra_2: Setting Powered False 13:41:40.079642 run create_hlr_db(pid=28893): Terminated: ok {rc=0} 13:41:40.503496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28895): Launched 13:41:40.807754 run osmo-hlr_10.42.42.2(pid=28896): Launched 13:41:40.923297 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:41.445198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28898): Launched 13:41:41.749497 run osmo-stp_10.42.42.5(pid=28899): Launched 13:41:41.865485 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:42.391037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28901): Launched 13:41:42.508940 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:42.765691 run patchelf(pid=28902): Launched 13:41:42.934495 run osmo-stp_10.42.42.5(pid=28899): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28899)] 13:41:43.062982 run osmo-stp_10.42.42.5(pid=28899): stdout: | (launched: 2022-12-14_13:41:41.692829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:43.192537 run osmo-stp_10.42.42.5(pid=28899): stderr: | 20221214134141862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134141862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134141863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134141863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134141865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134141865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134141865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:43.322336 run osmo-stp_10.42.42.5(pid=28899): stdout: | (launched: 2022-12-14_13:41:41.692829) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:43.446389 run osmo-stp_10.42.42.5(pid=28899): stderr: | 20221214134141862 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134141862 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134141863 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134141863 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134141865 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134141865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134141865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:43.593457 run patchelf(pid=28902): Terminating (SIGINT) 13:41:43.763280 run patchelf(pid=28902): Terminated: ok {rc=0} 13:41:43.886216 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28899): Process ended prematurely: osmo-stp_10.42.42.5(pid=28899) [trial-2405↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28899)] [trial-2405↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 13:41:43.895558 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 13:41:43.922458 run osmo-hlr_10.42.42.2(pid=28896): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28896)] 13:41:43.969672 run osmo-hlr_10.42.42.2(pid=28896): stdout: | (launched: 2022-12-14_13:41:40.751271) 13:41:44.018606 run osmo-hlr_10.42.42.2(pid=28896): stderr: | 20221214134140928 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134140928 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134140928 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134140929 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134140929 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134140929 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134140940 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134140949 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134140949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134140949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:44.068106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28889): Terminating (SIGTERM) 13:41:44.107489 run iperf3-srv_10.42.42.10(pid=28890): Terminating (SIGTERM) 13:41:44.147170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28891): Terminating (SIGTERM) 13:41:44.186441 run iperf3-srv_10.42.42.10(pid=28892): Terminating (SIGTERM) 13:41:44.225513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28895): Terminating (SIGTERM) 13:41:44.264687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28898): Terminating (SIGTERM) 13:41:44.303717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28901): Terminating (SIGTERM) 13:41:44.343106 --- ParallelTerminationStrategy: PID 28889 died... 13:41:44.362379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28889): Terminated: ok {rc=0} 13:41:44.406081 --- ParallelTerminationStrategy: PID 28890 died... 13:41:44.424548 run iperf3-srv_10.42.42.10(pid=28890): Terminated {rc=256} 13:41:44.468156 --- ParallelTerminationStrategy: PID 28891 died... 13:41:44.486763 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28891): Terminated: ok {rc=0} 13:41:44.530259 --- ParallelTerminationStrategy: PID 28892 died... 13:41:44.548619 run iperf3-srv_10.42.42.10(pid=28892): Terminated {rc=256} 13:41:44.592112 --- ParallelTerminationStrategy: PID 28895 died... 13:41:44.610578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28895): Terminated: ok {rc=0} 13:41:44.654449 --- ParallelTerminationStrategy: PID 28898 died... 13:41:44.672989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28898): Terminated: ok {rc=0} 13:41:44.716487 --- ParallelTerminationStrategy: PID 28901 died... 13:41:44.735048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28901): Terminated: ok {rc=0} 13:41:44.819934 bus /gobi_0: Setting Powered False 13:41:45.922391 bus /gobi_0: Setting Powered False 13:41:47.042921 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms iperf3.py ---------------------------------------------- 13:41:48.195701 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:48.207650 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:41:48.261137 tst iperf3.py: using LAC 41287 13:41:48.393457 tst iperf3.py: using RAC 232 13:41:48.520427 tst iperf3.py: using CellId 41287 13:41:48.646627 tst iperf3.py: using BVCI 41288 13:41:48.764754 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:48.775866 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:48.786674 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:48.797478 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:48.808531 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:48.819699 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:48.830931 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:48.842000 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:48.853225 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:41:48.971560 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:41:49.192133 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:49.519187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28903): Launched 13:41:49.804185 run iperf3-srv_10.42.42.10(pid=28904): Launched 13:41:49.926733 tst iperf3.py:8: start network... 13:41:50.146845 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:41:50.652174 run create_hlr_db(pid=28905): Launched 13:41:50.776774 bus /gobi_6: Setting Powered False 13:41:51.841264 run create_hlr_db(pid=28905): Terminated: ok {rc=0} 13:41:52.295615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28907): Launched 13:41:52.622161 run osmo-hlr_10.42.42.2(pid=28908): Launched 13:41:52.748725 run osmo-stp_10.42.42.5: Starting osmo-stp 13:41:53.312072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28910): Launched 13:41:53.640141 run osmo-stp_10.42.42.5(pid=28911): Launched 13:41:53.765068 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:41:54.326008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28913): Launched 13:41:54.452586 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:41:54.727553 run patchelf(pid=28914): Launched 13:41:54.909751 run osmo-stp_10.42.42.5(pid=28911): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28911)] 13:41:55.047670 run osmo-stp_10.42.42.5(pid=28911): stdout: | (launched: 2022-12-14_13:41:53.580335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:55.187188 run osmo-stp_10.42.42.5(pid=28911): stderr: | 20221214134153773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134153773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134153774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134153774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134153774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134153775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134153775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:55.326765 run osmo-stp_10.42.42.5(pid=28911): stdout: | (launched: 2022-12-14_13:41:53.580335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:41:55.461185 run osmo-stp_10.42.42.5(pid=28911): stderr: | 20221214134153773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134153773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134153774 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134153774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134153774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134153775 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134153775 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:41:55.619604 run patchelf(pid=28914): Terminating (SIGINT) 13:41:55.801532 run patchelf(pid=28914): Terminated: ok {rc=0} 13:41:55.932803 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28911): Process ended prematurely: osmo-stp_10.42.42.5(pid=28911) [trial-2405↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28911)] [trial-2405↪gprs:trx-lms↪iperf3.py:8] 13:41:55.942967 tst iperf3.py:8: Test FAILED (7.8 sec) 13:41:55.971205 run osmo-hlr_10.42.42.2(pid=28908): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28908)] 13:41:56.021813 run osmo-hlr_10.42.42.2(pid=28908): stdout: | (launched: 2022-12-14_13:41:52.563042) 13:41:56.074125 run osmo-hlr_10.42.42.2(pid=28908): stderr: | 20221214134152761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134152761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134152761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134152761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134152761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134152761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134152774 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134152782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134152782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134152782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:41:56.126264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28903): Terminating (SIGTERM) 13:41:56.167952 run iperf3-srv_10.42.42.10(pid=28904): Terminating (SIGTERM) 13:41:56.210248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28907): Terminating (SIGTERM) 13:41:56.252118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28910): Terminating (SIGTERM) 13:41:56.294383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28913): Terminating (SIGTERM) 13:41:56.336564 --- ParallelTerminationStrategy: PID 28903 died... 13:41:56.357049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28903): Terminated: ok {rc=0} 13:41:56.403493 --- ParallelTerminationStrategy: PID 28904 died... 13:41:56.423551 run iperf3-srv_10.42.42.10(pid=28904): Terminated {rc=256} 13:41:56.469823 --- ParallelTerminationStrategy: PID 28907 died... 13:41:56.489590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28907): Terminated: ok {rc=0} 13:41:56.535744 --- ParallelTerminationStrategy: PID 28910 died... 13:41:56.555569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28910): Terminated: ok {rc=0} 13:41:56.601746 --- ParallelTerminationStrategy: PID 28913 died... 13:41:56.621580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28913): Terminated: ok {rc=0} 13:41:56.709588 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms iperf3m4.py ---------------------------------------------- 13:41:57.858933 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:57.871086 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:41:57.921112 tst iperf3m4.py: using LAC 41288 13:41:58.041521 tst iperf3m4.py: using RAC 233 13:41:58.162869 tst iperf3m4.py: using CellId 41288 13:41:58.295280 tst iperf3m4.py: using BVCI 41289 13:41:58.415512 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:58.427019 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:58.437937 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:58.448642 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:58.459714 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:58.470985 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:58.482291 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:58.493360 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:41:58.504484 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:41:58.621898 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:41:58.747529 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:41:58.864108 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:41:58.983378 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:41:59.204749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:41:59.532489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28915): Launched 13:41:59.815315 run iperf3-srv_10.42.42.10(pid=28916): Launched 13:41:59.937159 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:42:00.156916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:00.483813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28917): Launched 13:42:00.769224 run iperf3-srv_10.42.42.10(pid=28918): Launched 13:42:00.949615 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:42:01.202702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:01.525645 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28925): Launched 13:42:01.814612 run iperf3-srv_10.42.42.10(pid=28926): Launched 13:42:01.951108 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:42:02.174319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:02.502441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28927): Launched 13:42:02.786173 run iperf3-srv_10.42.42.10(pid=28928): Launched 13:42:02.909097 tst iperf3m4.py:8: start network... 13:42:03.128791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:03.633939 run create_hlr_db(pid=28929): Launched 13:42:03.757917 bus /gobi_6: Setting Powered False 13:42:04.822729 run create_hlr_db(pid=28929): Terminated: ok {rc=0} 13:42:05.260378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28931): Launched 13:42:05.566278 run osmo-hlr_10.42.42.2(pid=28932): Launched 13:42:05.681897 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:06.209972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28934): Launched 13:42:06.513469 run osmo-stp_10.42.42.5(pid=28935): Launched 13:42:06.629379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:07.153384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28937): Launched 13:42:07.269152 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:07.526081 run patchelf(pid=28938): Launched 13:42:07.694520 run osmo-stp_10.42.42.5(pid=28935): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28935)] 13:42:07.822745 run osmo-stp_10.42.42.5(pid=28935): stdout: | (launched: 2022-12-14_13:42:06.457627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:07.952503 run osmo-stp_10.42.42.5(pid=28935): stderr: | 20221214134206628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134206628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134206629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134206629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134206630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134206630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134206630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:08.082494 run osmo-stp_10.42.42.5(pid=28935): stdout: | (launched: 2022-12-14_13:42:06.457627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:08.206868 run osmo-stp_10.42.42.5(pid=28935): stderr: | 20221214134206628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134206628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134206629 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134206629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134206630 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134206630 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134206630 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:08.354123 run patchelf(pid=28938): Terminating (SIGINT) 13:42:08.524609 run patchelf(pid=28938): Terminated: ok {rc=0} 13:42:08.647132 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28935): Process ended prematurely: osmo-stp_10.42.42.5(pid=28935) [trial-2405↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28935)] [trial-2405↪gprs:trx-lms↪iperf3m4.py:8] 13:42:08.656519 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:42:08.683764 run osmo-hlr_10.42.42.2(pid=28932): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28932)] 13:42:08.731307 run osmo-hlr_10.42.42.2(pid=28932): stdout: | (launched: 2022-12-14_13:42:05.509553) 13:42:08.780474 run osmo-hlr_10.42.42.2(pid=28932): stderr: | 20221214134205686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134205686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134205686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134205686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134205686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134205686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134205699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134205707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134205708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134205708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:08.829832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28915): Terminating (SIGTERM) 13:42:08.869529 run iperf3-srv_10.42.42.10(pid=28916): Terminating (SIGTERM) 13:42:08.909069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28917): Terminating (SIGTERM) 13:42:08.949110 run iperf3-srv_10.42.42.10(pid=28918): Terminating (SIGTERM) 13:42:08.988378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28925): Terminating (SIGTERM) 13:42:09.027697 run iperf3-srv_10.42.42.10(pid=28926): Terminating (SIGTERM) 13:42:09.066957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28927): Terminating (SIGTERM) 13:42:09.106321 run iperf3-srv_10.42.42.10(pid=28928): Terminating (SIGTERM) 13:42:09.145438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28931): Terminating (SIGTERM) 13:42:09.185355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28934): Terminating (SIGTERM) 13:42:09.224765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28937): Terminating (SIGTERM) 13:42:09.264309 --- ParallelTerminationStrategy: PID 28915 died... 13:42:09.283379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28915): Terminated: ok {rc=0} 13:42:09.327246 --- ParallelTerminationStrategy: PID 28916 died... 13:42:09.345784 run iperf3-srv_10.42.42.10(pid=28916): Terminated {rc=256} 13:42:09.389272 --- ParallelTerminationStrategy: PID 28917 died... 13:42:09.407736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28917): Terminated: ok {rc=0} 13:42:09.451311 --- ParallelTerminationStrategy: PID 28918 died... 13:42:09.469747 run iperf3-srv_10.42.42.10(pid=28918): Terminated {rc=256} 13:42:09.513291 --- ParallelTerminationStrategy: PID 28925 died... 13:42:09.531814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28925): Terminated: ok {rc=0} 13:42:09.575366 --- ParallelTerminationStrategy: PID 28926 died... 13:42:09.593874 run iperf3-srv_10.42.42.10(pid=28926): Terminated {rc=256} 13:42:09.637385 --- ParallelTerminationStrategy: PID 28927 died... 13:42:09.655856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28927): Terminated: ok {rc=0} 13:42:09.699378 --- ParallelTerminationStrategy: PID 28928 died... 13:42:09.718164 run iperf3-srv_10.42.42.10(pid=28928): Terminated {rc=256} 13:42:09.761887 --- ParallelTerminationStrategy: PID 28931 died... 13:42:09.780530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28931): Terminated: ok {rc=0} 13:42:09.824301 --- ParallelTerminationStrategy: PID 28934 died... 13:42:09.842969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28934): Terminated: ok {rc=0} 13:42:09.886647 --- ParallelTerminationStrategy: PID 28937 died... 13:42:09.905325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28937): Terminated: ok {rc=0} 13:42:09.990804 bus /gobi_4: Setting Powered False 13:42:11.089586 bus /gobi_4: Setting Powered False 13:42:12.202005 bus /gobi_1: Setting Powered False 13:42:13.297671 bus /gobi_1: Setting Powered False 13:42:14.410314 bus /gobi_0: Setting Powered False 13:42:15.507014 bus /gobi_0: Setting Powered False 13:42:16.625670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms ping.py ---------------------------------------------- 13:42:17.739354 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:17.751268 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:42:17.801615 tst ping.py: using LAC 41289 13:42:17.920435 tst ping.py: using RAC 234 13:42:18.037162 tst ping.py: using CellId 41289 13:42:18.154364 tst ping.py: using BVCI 41290 13:42:18.264099 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:18.274725 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:18.285225 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:18.295566 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:18.305902 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:18.317587 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:18.328636 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:18.339641 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:42:18.458675 tst ping.py:19: start network... 13:42:18.674989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:19.170257 run create_hlr_db(pid=28939): Launched 13:42:19.294111 bus /gobi_6: Setting Powered False 13:42:20.357513 run create_hlr_db(pid=28939): Terminated: ok {rc=0} 13:42:20.784925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28941): Launched 13:42:21.083150 run osmo-hlr_10.42.42.2(pid=28942): Launched 13:42:21.196522 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:21.713337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28944): Launched 13:42:22.013697 run osmo-stp_10.42.42.5(pid=28945): Launched 13:42:22.127677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:22.642634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28947): Launched 13:42:22.756566 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:23.009526 run patchelf(pid=28948): Launched 13:42:23.175375 run osmo-stp_10.42.42.5(pid=28945): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28945)] 13:42:23.302106 run osmo-stp_10.42.42.5(pid=28945): stdout: | (launched: 2022-12-14_13:42:21.957746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:23.429929 run osmo-stp_10.42.42.5(pid=28945): stderr: | 20221214134222129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134222129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134222129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134222130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134222130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134222130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134222130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:23.557698 run osmo-stp_10.42.42.5(pid=28945): stdout: | (launched: 2022-12-14_13:42:21.957746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:23.680094 run osmo-stp_10.42.42.5(pid=28945): stderr: | 20221214134222129 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134222129 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134222129 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134222130 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134222130 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134222130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134222130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:23.825857 run patchelf(pid=28948): Terminating (SIGINT) 13:42:23.993196 run patchelf(pid=28948): Terminated: ok {rc=0} 13:42:24.113909 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=28945): Process ended prematurely: osmo-stp_10.42.42.5(pid=28945) [trial-2405↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28945)] [trial-2405↪gprs:trx-lms↪ping.py:22] 13:42:24.122732 tst ping.py:22: Test FAILED (6.4 sec) 13:42:24.149295 run osmo-hlr_10.42.42.2(pid=28942): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28942)] 13:42:24.196430 run osmo-hlr_10.42.42.2(pid=28942): stdout: | (launched: 2022-12-14_13:42:21.028120) 13:42:24.245277 run osmo-hlr_10.42.42.2(pid=28942): stderr: | 20221214134221204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134221204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134221204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134221205 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134221205 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134221205 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134221217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134221226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134221226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134221226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:24.294431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28941): Terminating (SIGTERM) 13:42:24.333673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28944): Terminating (SIGTERM) 13:42:24.373683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28947): Terminating (SIGTERM) 13:42:24.413570 --- ParallelTerminationStrategy: PID 28941 died... 13:42:24.432674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28941): Terminated: ok {rc=0} 13:42:24.476366 --- ParallelTerminationStrategy: PID 28944 died... 13:42:24.495018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28944): Terminated: ok {rc=0} 13:42:24.538592 --- ParallelTerminationStrategy: PID 28947 died... 13:42:24.557007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28947): Terminated: ok {rc=0} 13:42:24.640301 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 13:42:25.724708 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:25.735982 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 13:42:25.786194 tst ping_idle_ping.py: using LAC 41290 13:42:25.910167 tst ping_idle_ping.py: using RAC 235 13:42:26.027266 tst ping_idle_ping.py: using CellId 41290 13:42:26.143320 tst ping_idle_ping.py: using BVCI 41291 13:42:26.252381 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:26.263153 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:26.273701 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:26.284038 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:26.294958 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:26.305324 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:26.316627 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 13:42:26.327727 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 13:42:26.441298 tst ping_idle_ping.py:24: start network... 13:42:26.641620 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:27.107991 run create_hlr_db(pid=28949): Launched 13:42:27.230779 bus /gobi_6: Setting Powered False 13:42:28.291211 run create_hlr_db(pid=28949): Terminated: ok {rc=0} 13:42:28.709943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28951): Launched 13:42:29.009843 run osmo-hlr_10.42.42.2(pid=28952): Launched 13:42:29.124318 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:29.655164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28954): Launched 13:42:29.955112 run osmo-stp_10.42.42.5(pid=28955): Launched 13:42:30.071162 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:30.588014 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28957): Launched 13:42:30.702314 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:30.957670 run patchelf(pid=28958): Launched 13:42:31.134617 run osmo-stp_10.42.42.5(pid=28955): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28955)] 13:42:31.263230 run osmo-stp_10.42.42.5(pid=28955): stdout: | (launched: 2022-12-14_13:42:29.899306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:31.394820 run osmo-stp_10.42.42.5(pid=28955): stderr: | 20221214134230071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134230071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134230071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134230072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134230072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134230072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134230072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:31.525286 run osmo-stp_10.42.42.5(pid=28955): stdout: | (launched: 2022-12-14_13:42:29.899306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:31.650636 run osmo-stp_10.42.42.5(pid=28955): stderr: | 20221214134230071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134230071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134230071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134230072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134230072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134230072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134230072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:31.799197 run patchelf(pid=28958): Terminating (SIGINT) 13:42:31.971356 run patchelf(pid=28958): Terminated: ok {rc=0} 13:42:32.094907 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=28955): Process ended prematurely: osmo-stp_10.42.42.5(pid=28955) [trial-2405↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28955)] [trial-2405↪gprs:trx-lms↪ping_idle_ping.py:27] 13:42:32.104362 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:42:32.132444 run osmo-hlr_10.42.42.2(pid=28952): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28952)] 13:42:32.180481 run osmo-hlr_10.42.42.2(pid=28952): stdout: | (launched: 2022-12-14_13:42:28.954441) 13:42:32.230310 run osmo-hlr_10.42.42.2(pid=28952): stderr: | 20221214134229129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134229129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134229129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134229129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134229129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134229129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134229143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134229151 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134229151 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134229152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:32.279878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28951): Terminating (SIGTERM) 13:42:32.319262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28954): Terminating (SIGTERM) 13:42:32.358495 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28957): Terminating (SIGTERM) 13:42:32.398145 --- ParallelTerminationStrategy: PID 28951 died... 13:42:32.416511 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28951): Terminated: ok {rc=0} 13:42:32.460155 --- ParallelTerminationStrategy: PID 28954 died... 13:42:32.478552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28954): Terminated: ok {rc=0} 13:42:32.521887 --- ParallelTerminationStrategy: PID 28957 died... 13:42:32.540341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28957): Terminated: ok {rc=0} 13:42:32.625827 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 13:42:33.925459 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:42:33.931856 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:42:33.964590 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:42:34.003799 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:42:34.089765 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:42:34.121906 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:42:34.159975 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:42:34.752832 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:42:34.803385 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:34.814315 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:42:34.862755 tst cs_paging_gprs_active.py: using LAC 41291 13:42:34.981825 tst cs_paging_gprs_active.py: using RAC 236 13:42:35.100227 tst cs_paging_gprs_active.py: using CellId 41291 13:42:35.218810 tst cs_paging_gprs_active.py: using BVCI 41292 13:42:35.331408 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.342261 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.352793 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.363382 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.374221 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.384715 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.395505 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.405942 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:35.416617 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:35.536342 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:35.655895 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:42:35.878300 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:36.207786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28962): Launched 13:42:36.493282 run iperf3-srv_10.42.42.10(pid=28963): Launched 13:42:36.617770 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:42:36.839780 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:37.170338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28964): Launched 13:42:37.457651 run iperf3-srv_10.42.42.10(pid=28965): Launched 13:42:37.581210 tst cs_paging_gprs_active.py:38: start network... 13:42:37.803258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:38.310500 run create_hlr_db(pid=28966): Launched 13:42:38.437762 bus /gobi_6: Setting Powered False 13:42:39.499462 run create_hlr_db(pid=28966): Terminated: ok {rc=0} 13:42:39.936115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28968): Launched 13:42:40.242738 run osmo-hlr_10.42.42.2(pid=28969): Launched 13:42:40.359516 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:40.887673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28971): Launched 13:42:41.193265 run osmo-stp_10.42.42.5(pid=28972): Launched 13:42:41.312186 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:41.840646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28974): Launched 13:42:41.957572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:42.215598 run patchelf(pid=28975): Launched 13:42:42.387989 run osmo-stp_10.42.42.5(pid=28972): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28972)] 13:42:42.517244 run osmo-stp_10.42.42.5(pid=28972): stdout: | (launched: 2022-12-14_13:42:41.136855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:42.648233 run osmo-stp_10.42.42.5(pid=28972): stderr: | 20221214134241309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134241309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134241310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134241310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134241311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134241311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134241311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:42.779422 run osmo-stp_10.42.42.5(pid=28972): stdout: | (launched: 2022-12-14_13:42:41.136855) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:42.904516 run osmo-stp_10.42.42.5(pid=28972): stderr: | 20221214134241309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134241309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134241310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134241310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134241311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134241311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134241311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:43.052868 run patchelf(pid=28975): Terminating (SIGINT) 13:42:43.223880 run patchelf(pid=28975): Terminated: ok {rc=0} 13:42:43.347062 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=28972): Process ended prematurely: osmo-stp_10.42.42.5(pid=28972) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28972)] [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:42:43.356376 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:42:43.383259 run osmo-hlr_10.42.42.2(pid=28969): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28969)] 13:42:43.431048 run osmo-hlr_10.42.42.2(pid=28969): stdout: | (launched: 2022-12-14_13:42:40.186801) 13:42:43.480836 run osmo-hlr_10.42.42.2(pid=28969): stderr: | 20221214134240363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134240363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134240363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134240363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134240363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134240363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134240375 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134240384 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134240384 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134240384 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:43.530651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28962): Terminating (SIGTERM) 13:42:43.570452 run iperf3-srv_10.42.42.10(pid=28963): Terminating (SIGTERM) 13:42:43.609986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28964): Terminating (SIGTERM) 13:42:43.649744 run iperf3-srv_10.42.42.10(pid=28965): Terminating (SIGTERM) 13:42:43.689390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28968): Terminating (SIGTERM) 13:42:43.729064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28971): Terminating (SIGTERM) 13:42:43.768577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28974): Terminating (SIGTERM) 13:42:43.808281 --- ParallelTerminationStrategy: PID 28962 died... 13:42:43.827440 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28962): Terminated: ok {rc=0} 13:42:43.871379 --- ParallelTerminationStrategy: PID 28963 died... 13:42:43.889844 run iperf3-srv_10.42.42.10(pid=28963): Terminated {rc=256} 13:42:43.933302 --- ParallelTerminationStrategy: PID 28964 died... 13:42:43.951947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28964): Terminated: ok {rc=0} 13:42:43.995466 --- ParallelTerminationStrategy: PID 28965 died... 13:42:44.013937 run iperf3-srv_10.42.42.10(pid=28965): Terminated {rc=256} 13:42:44.057454 --- ParallelTerminationStrategy: PID 28968 died... 13:42:44.075980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28968): Terminated: ok {rc=0} 13:42:44.119719 --- ParallelTerminationStrategy: PID 28971 died... 13:42:44.138374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28971): Terminated: ok {rc=0} 13:42:44.182125 --- ParallelTerminationStrategy: PID 28974 died... 13:42:44.200786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28974): Terminated: ok {rc=0} 13:42:44.283614 bus /gobi_0: Setting Powered False 13:42:45.381501 bus /gobi_0: Setting Powered False 13:42:46.505896 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:42:47.658229 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:47.669702 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:42:47.719638 tst iperf3.py: using LAC 41292 13:42:47.849154 tst iperf3.py: using RAC 237 13:42:47.978369 tst iperf3.py: using CellId 41292 13:42:48.107217 tst iperf3.py: using BVCI 41293 13:42:48.225708 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:48.237220 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:48.248394 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:48.259520 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:48.270867 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:48.282260 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:48.293758 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:48.304814 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:48.316319 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:48.435920 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:42:48.657287 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:48.984761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28976): Launched 13:42:49.268593 run iperf3-srv_10.42.42.10(pid=28977): Launched 13:42:49.390964 tst iperf3.py:8: start network... 13:42:49.611420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:42:50.115448 run create_hlr_db(pid=28978): Launched 13:42:50.238773 bus /gobi_6: Setting Powered False 13:42:51.303449 run create_hlr_db(pid=28978): Terminated: ok {rc=0} 13:42:51.741453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28980): Launched 13:42:52.044891 run osmo-hlr_10.42.42.2(pid=28981): Launched 13:42:52.161432 run osmo-stp_10.42.42.5: Starting osmo-stp 13:42:52.685597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28983): Launched 13:42:52.989751 run osmo-stp_10.42.42.5(pid=28984): Launched 13:42:53.105520 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:42:53.631235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28986): Launched 13:42:53.747005 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:42:54.003693 run patchelf(pid=28987): Launched 13:42:54.172709 run osmo-stp_10.42.42.5(pid=28984): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28984)] 13:42:54.301417 run osmo-stp_10.42.42.5(pid=28984): stdout: | (launched: 2022-12-14_13:42:52.933470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:54.431637 run osmo-stp_10.42.42.5(pid=28984): stderr: | 20221214134253105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134253105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134253105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134253106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134253106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134253106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134253106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:54.563147 run osmo-stp_10.42.42.5(pid=28984): stdout: | (launched: 2022-12-14_13:42:52.933470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:42:54.687561 run osmo-stp_10.42.42.5(pid=28984): stderr: | 20221214134253105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134253105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134253105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134253106 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134253106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134253106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134253106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:42:54.835614 run patchelf(pid=28987): Terminating (SIGINT) 13:42:55.005841 run patchelf(pid=28987): Terminated: ok {rc=0} 13:42:55.128934 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=28984): Process ended prematurely: osmo-stp_10.42.42.5(pid=28984) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28984)] [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 13:42:55.138418 tst iperf3.py:8: Test FAILED (7.5 sec) 13:42:55.165207 run osmo-hlr_10.42.42.2(pid=28981): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28981)] 13:42:55.212862 run osmo-hlr_10.42.42.2(pid=28981): stdout: | (launched: 2022-12-14_13:42:51.989306) 13:42:55.262236 run osmo-hlr_10.42.42.2(pid=28981): stderr: | 20221214134252166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134252167 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134252167 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134252167 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134252167 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134252167 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134252179 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134252189 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134252189 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134252189 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:42:55.311648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28976): Terminating (SIGTERM) 13:42:55.351239 run iperf3-srv_10.42.42.10(pid=28977): Terminating (SIGTERM) 13:42:55.390712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28980): Terminating (SIGTERM) 13:42:55.430058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28983): Terminating (SIGTERM) 13:42:55.469793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28986): Terminating (SIGTERM) 13:42:55.509741 --- ParallelTerminationStrategy: PID 28976 died... 13:42:55.528804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28976): Terminated: ok {rc=0} 13:42:55.573820 --- ParallelTerminationStrategy: PID 28977 died... 13:42:55.592579 run iperf3-srv_10.42.42.10(pid=28977): Terminated {rc=256} 13:42:55.636423 --- ParallelTerminationStrategy: PID 28980 died... 13:42:55.655086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28980): Terminated: ok {rc=0} 13:42:55.698989 --- ParallelTerminationStrategy: PID 28983 died... 13:42:55.717742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=28983): Terminated: ok {rc=0} 13:42:55.761701 --- ParallelTerminationStrategy: PID 28986 died... 13:42:55.780422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=28986): Terminated: ok {rc=0} 13:42:55.867151 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:42:57.014980 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:57.026435 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:42:57.077785 tst iperf3m4.py: using LAC 41293 13:42:57.207071 tst iperf3m4.py: using RAC 238 13:42:57.326951 tst iperf3m4.py: using CellId 41293 13:42:57.445158 tst iperf3m4.py: using BVCI 41294 13:42:57.556377 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:57.567534 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:57.578309 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:57.589063 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:57.599533 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:57.610269 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:57.620843 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:57.631366 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:42:57.642495 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:57.758621 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:57.877862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:57.999481 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:42:58.116574 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:42:58.322612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:58.629725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28988): Launched 13:42:58.898541 run iperf3-srv_10.42.42.10(pid=28989): Launched 13:42:59.015525 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:42:59.220347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:42:59.527100 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28990): Launched 13:42:59.793373 run iperf3-srv_10.42.42.10(pid=28991): Launched 13:42:59.907345 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:43:00.111892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:00.419305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28992): Launched 13:43:00.685561 run iperf3-srv_10.42.42.10(pid=28993): Launched 13:43:00.799603 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:43:01.027724 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:01.343246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28994): Launched 13:43:01.628722 run iperf3-srv_10.42.42.10(pid=28995): Launched 13:43:01.760864 tst iperf3m4.py:8: start network... 13:43:01.973428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:02.453815 run create_hlr_db(pid=28996): Launched 13:43:02.579295 bus /gobi_6: Setting Powered False 13:43:03.641168 run create_hlr_db(pid=28996): Terminated: ok {rc=0} 13:43:04.078384 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28998): Launched 13:43:04.383882 run osmo-hlr_10.42.42.2(pid=28999): Launched 13:43:04.499340 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:05.040462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29001): Launched 13:43:05.347279 run osmo-stp_10.42.42.5(pid=29002): Launched 13:43:05.466156 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:05.993331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29004): Launched 13:43:06.109711 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:06.367383 run patchelf(pid=29005): Launched 13:43:06.537069 run osmo-stp_10.42.42.5(pid=29002): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29002)] 13:43:06.666140 run osmo-stp_10.42.42.5(pid=29002): stdout: | (launched: 2022-12-14_13:43:05.290356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:06.796776 run osmo-stp_10.42.42.5(pid=29002): stderr: | 20221214134305461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134305461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134305462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134305462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134305462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134305462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134305463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:06.927071 run osmo-stp_10.42.42.5(pid=29002): stdout: | (launched: 2022-12-14_13:43:05.290356) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:07.051907 run osmo-stp_10.42.42.5(pid=29002): stderr: | 20221214134305461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134305461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134305462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134305462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134305462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134305462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134305463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:07.200006 run patchelf(pid=29005): Terminating (SIGINT) 13:43:07.371250 run patchelf(pid=29005): Terminated: ok {rc=0} 13:43:07.494565 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29002): Process ended prematurely: osmo-stp_10.42.42.5(pid=29002) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29002)] [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 13:43:07.503992 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:43:07.531416 run osmo-hlr_10.42.42.2(pid=28999): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=28999)] 13:43:07.579046 run osmo-hlr_10.42.42.2(pid=28999): stdout: | (launched: 2022-12-14_13:43:04.327742) 13:43:07.628709 run osmo-hlr_10.42.42.2(pid=28999): stderr: | 20221214134304506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134304506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134304506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134304506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134304506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134304506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134304518 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134304527 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134304527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134304528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:07.678541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28988): Terminating (SIGTERM) 13:43:07.718102 run iperf3-srv_10.42.42.10(pid=28989): Terminating (SIGTERM) 13:43:07.757690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28990): Terminating (SIGTERM) 13:43:07.797441 run iperf3-srv_10.42.42.10(pid=28991): Terminating (SIGTERM) 13:43:07.837008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28992): Terminating (SIGTERM) 13:43:07.876576 run iperf3-srv_10.42.42.10(pid=28993): Terminating (SIGTERM) 13:43:07.916076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28994): Terminating (SIGTERM) 13:43:07.955622 run iperf3-srv_10.42.42.10(pid=28995): Terminating (SIGTERM) 13:43:07.995119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28998): Terminating (SIGTERM) 13:43:08.034705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29001): Terminating (SIGTERM) 13:43:08.074212 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29004): Terminating (SIGTERM) 13:43:08.114100 --- ParallelTerminationStrategy: PID 28988 died... 13:43:08.133383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28988): Terminated: ok {rc=0} 13:43:08.177837 --- ParallelTerminationStrategy: PID 28989 died... 13:43:08.196343 run iperf3-srv_10.42.42.10(pid=28989): Terminated {rc=256} 13:43:08.240139 --- ParallelTerminationStrategy: PID 28990 died... 13:43:08.258914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28990): Terminated: ok {rc=0} 13:43:08.302746 --- ParallelTerminationStrategy: PID 28991 died... 13:43:08.321782 run iperf3-srv_10.42.42.10(pid=28991): Terminated {rc=256} 13:43:08.365697 --- ParallelTerminationStrategy: PID 28992 died... 13:43:08.384350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28992): Terminated: ok {rc=0} 13:43:08.428228 --- ParallelTerminationStrategy: PID 28993 died... 13:43:08.446876 run iperf3-srv_10.42.42.10(pid=28993): Terminated {rc=256} 13:43:08.490703 --- ParallelTerminationStrategy: PID 28994 died... 13:43:08.509380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=28994): Terminated: ok {rc=0} 13:43:08.553251 --- ParallelTerminationStrategy: PID 28995 died... 13:43:08.571791 run iperf3-srv_10.42.42.10(pid=28995): Terminated {rc=256} 13:43:08.615633 --- ParallelTerminationStrategy: PID 28998 died... 13:43:08.634394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=28998): Terminated: ok {rc=0} 13:43:08.678200 --- ParallelTerminationStrategy: PID 29001 died... 13:43:08.696805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29001): Terminated: ok {rc=0} 13:43:08.740611 --- ParallelTerminationStrategy: PID 29004 died... 13:43:08.759303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29004): Terminated: ok {rc=0} 13:43:08.843392 bus /gobi_4: Setting Powered False 13:43:09.939115 bus /gobi_4: Setting Powered False 13:43:11.051932 bus /gobi_1: Setting Powered False 13:43:12.149246 bus /gobi_1: Setting Powered False 13:43:13.267677 bus /gobi_0: Setting Powered False 13:43:14.365142 bus /gobi_0: Setting Powered False 13:43:15.477491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 13:43:16.579322 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:16.592500 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:43:16.648896 tst ping.py: using LAC 41294 13:43:16.769477 tst ping.py: using RAC 239 13:43:16.922410 tst ping.py: using CellId 41294 13:43:17.049895 tst ping.py: using BVCI 41295 13:43:17.179747 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:17.191937 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:17.205799 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:17.218742 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:17.231511 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:17.242599 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:17.253886 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:17.265348 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:43:17.379883 tst ping.py:19: start network... 13:43:17.580263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:18.044938 run create_hlr_db(pid=29006): Launched 13:43:18.167077 bus /gobi_6: Setting Powered False 13:43:19.227180 run create_hlr_db(pid=29006): Terminated: ok {rc=0} 13:43:19.664882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29008): Launched 13:43:19.986832 run osmo-hlr_10.42.42.2(pid=29009): Launched 13:43:20.110955 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:20.667025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29011): Launched 13:43:20.988673 run osmo-stp_10.42.42.5(pid=29012): Launched 13:43:21.113083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:21.666750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29014): Launched 13:43:21.790218 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:22.062656 run patchelf(pid=29015): Launched 13:43:22.241348 run osmo-stp_10.42.42.5(pid=29012): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29012)] 13:43:22.377533 run osmo-stp_10.42.42.5(pid=29012): stdout: | (launched: 2022-12-14_13:43:20.930030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:22.515602 run osmo-stp_10.42.42.5(pid=29012): stderr: | 20221214134321121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134321121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134321121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134321122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134321122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134321122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134321122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:22.653470 run osmo-stp_10.42.42.5(pid=29012): stdout: | (launched: 2022-12-14_13:43:20.930030) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:22.785886 run osmo-stp_10.42.42.5(pid=29012): stderr: | 20221214134321121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134321121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134321121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134321122 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134321122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134321122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134321122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:22.942387 run patchelf(pid=29015): Terminating (SIGINT) 13:43:23.121913 run patchelf(pid=29015): Terminated: ok {rc=0} 13:43:23.251350 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29012): Process ended prematurely: osmo-stp_10.42.42.5(pid=29012) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29012)] [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 13:43:23.260716 tst ping.py:22: Test FAILED (6.7 sec) 13:43:23.288895 run osmo-hlr_10.42.42.2(pid=29009): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29009)] 13:43:23.340226 run osmo-hlr_10.42.42.2(pid=29009): stdout: | (launched: 2022-12-14_13:43:19.927980) 13:43:23.392813 run osmo-hlr_10.42.42.2(pid=29009): stderr: | 20221214134320126 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134320126 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134320126 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134320126 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134320126 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134320126 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134320139 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134320148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134320148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134320148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:23.445863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29008): Terminating (SIGTERM) 13:43:23.488102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29011): Terminating (SIGTERM) 13:43:23.530945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29014): Terminating (SIGTERM) 13:43:23.573913 --- ParallelTerminationStrategy: PID 29008 died... 13:43:23.594678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29008): Terminated: ok {rc=0} 13:43:23.641808 --- ParallelTerminationStrategy: PID 29011 died... 13:43:23.661995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29011): Terminated: ok {rc=0} 13:43:23.708720 --- ParallelTerminationStrategy: PID 29014 died... 13:43:23.728925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29014): Terminated: ok {rc=0} 13:43:23.817632 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:43:24.904776 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:24.916812 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:43:24.969659 tst ping_idle_ping.py: using LAC 41295 13:43:25.100132 tst ping_idle_ping.py: using RAC 240 13:43:25.219689 tst ping_idle_ping.py: using CellId 41295 13:43:25.339503 tst ping_idle_ping.py: using BVCI 41296 13:43:25.449778 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.460782 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.471483 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.482244 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.492723 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.503357 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.514159 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:43:25.524732 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:43:25.639067 tst ping_idle_ping.py:24: start network... 13:43:25.841319 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:26.309051 run create_hlr_db(pid=29016): Launched 13:43:26.431912 bus /gobi_6: Setting Powered False 13:43:27.492166 run create_hlr_db(pid=29016): Terminated: ok {rc=0} 13:43:27.913280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29018): Launched 13:43:28.214696 run osmo-hlr_10.42.42.2(pid=29019): Launched 13:43:28.331288 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:28.848620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29021): Launched 13:43:29.151042 run osmo-stp_10.42.42.5(pid=29022): Launched 13:43:29.267295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:29.787031 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29024): Launched 13:43:29.904279 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:30.158153 run patchelf(pid=29025): Launched 13:43:30.324534 run osmo-stp_10.42.42.5(pid=29022): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29022)] 13:43:30.451377 run osmo-stp_10.42.42.5(pid=29022): stdout: | (launched: 2022-12-14_13:43:29.095117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:30.579869 run osmo-stp_10.42.42.5(pid=29022): stderr: | 20221214134329265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134329265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134329266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134329266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134329266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134329266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134329267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:30.708057 run osmo-stp_10.42.42.5(pid=29022): stdout: | (launched: 2022-12-14_13:43:29.095117) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:30.830909 run osmo-stp_10.42.42.5(pid=29022): stderr: | 20221214134329265 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134329265 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134329266 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134329266 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134329266 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134329266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134329267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:30.982832 run patchelf(pid=29025): Terminating (SIGINT) 13:43:31.154153 run patchelf(pid=29025): Terminated: ok {rc=0} 13:43:31.277153 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29022): Process ended prematurely: osmo-stp_10.42.42.5(pid=29022) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29022)] [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 13:43:31.286575 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:43:31.313996 run osmo-hlr_10.42.42.2(pid=29019): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29019)] 13:43:31.362332 run osmo-hlr_10.42.42.2(pid=29019): stdout: | (launched: 2022-12-14_13:43:28.158889) 13:43:31.412305 run osmo-hlr_10.42.42.2(pid=29019): stderr: | 20221214134328334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134328334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134328334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134328335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134328335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134328335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134328351 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134328361 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134328361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134328361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:31.462970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29018): Terminating (SIGTERM) 13:43:31.503056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29021): Terminating (SIGTERM) 13:43:31.543932 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29024): Terminating (SIGTERM) 13:43:31.586301 --- ParallelTerminationStrategy: PID 29018 died... 13:43:31.605781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29018): Terminated: ok {rc=0} 13:43:31.651560 --- ParallelTerminationStrategy: PID 29021 died... 13:43:31.670891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29021): Terminated: ok {rc=0} 13:43:31.715530 --- ParallelTerminationStrategy: PID 29024 died... 13:43:31.734766 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29024): Terminated: ok {rc=0} 13:43:31.831707 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:43:33.147549 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:43:33.154749 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:43:33.187453 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:43:33.225333 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:43:33.308792 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:43:33.341504 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:43:33.379342 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:43:33.980286 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:43:34.035192 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.046712 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:43:34.115582 tst cs_paging_gprs_active.py: using LAC 41296 13:43:34.244625 tst cs_paging_gprs_active.py: using RAC 241 13:43:34.370909 tst cs_paging_gprs_active.py: using CellId 41296 13:43:34.499216 tst cs_paging_gprs_active.py: using BVCI 41297 13:43:34.618954 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.630495 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.641903 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.653115 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.664420 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.675904 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.687310 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.698760 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:34.710292 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:34.826741 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:34.944698 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:43:35.153238 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:35.461997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29031): Launched 13:43:35.730604 run iperf3-srv_10.42.42.10(pid=29032): Launched 13:43:35.844047 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:43:36.049320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:36.356401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29033): Launched 13:43:36.622345 run iperf3-srv_10.42.42.10(pid=29034): Launched 13:43:36.736324 tst cs_paging_gprs_active.py:38: start network... 13:43:36.941454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:37.413492 run create_hlr_db(pid=29035): Launched 13:43:37.538659 bus /gobi_6: Setting Powered False 13:43:38.599398 run create_hlr_db(pid=29035): Terminated: ok {rc=0} 13:43:39.045399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29037): Launched 13:43:39.372371 run osmo-hlr_10.42.42.2(pid=29038): Launched 13:43:39.498103 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:40.061771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29040): Launched 13:43:40.390095 run osmo-stp_10.42.42.5(pid=29041): Launched 13:43:40.517291 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:41.081671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29043): Launched 13:43:41.206728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:41.490314 run patchelf(pid=29044): Launched 13:43:41.673241 run osmo-stp_10.42.42.5(pid=29041): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29041)] 13:43:41.811710 run osmo-stp_10.42.42.5(pid=29041): stdout: | (launched: 2022-12-14_13:43:40.330578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:41.952452 run osmo-stp_10.42.42.5(pid=29041): stderr: | 20221214134340523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134340523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134340523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134340524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134340524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134340524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134340524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:42.092751 run osmo-stp_10.42.42.5(pid=29041): stdout: | (launched: 2022-12-14_13:43:40.330578) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:42.227211 run osmo-stp_10.42.42.5(pid=29041): stderr: | 20221214134340523 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134340523 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134340523 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134340524 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134340524 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134340524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134340524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:42.386979 run patchelf(pid=29044): Terminating (SIGINT) 13:43:42.570864 run patchelf(pid=29044): Terminated: ok {rc=0} 13:43:42.703373 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29041): Process ended prematurely: osmo-stp_10.42.42.5(pid=29041) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29041)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:43:42.713534 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:43:42.742091 run osmo-hlr_10.42.42.2(pid=29038): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29038)] 13:43:42.792694 run osmo-hlr_10.42.42.2(pid=29038): stdout: | (launched: 2022-12-14_13:43:39.312802) 13:43:42.844409 run osmo-hlr_10.42.42.2(pid=29038): stderr: | 20221214134339511 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134339511 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134339511 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134339511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134339511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134339512 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134339524 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134339532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134339532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134339532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:42.896600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29031): Terminating (SIGTERM) 13:43:42.938581 run iperf3-srv_10.42.42.10(pid=29032): Terminating (SIGTERM) 13:43:42.980341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29033): Terminating (SIGTERM) 13:43:43.022779 run iperf3-srv_10.42.42.10(pid=29034): Terminating (SIGTERM) 13:43:43.064685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29037): Terminating (SIGTERM) 13:43:43.107172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29040): Terminating (SIGTERM) 13:43:43.149209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29043): Terminating (SIGTERM) 13:43:43.191526 --- ParallelTerminationStrategy: PID 29031 died... 13:43:43.212099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29031): Terminated: ok {rc=0} 13:43:43.258720 --- ParallelTerminationStrategy: PID 29032 died... 13:43:43.278627 run iperf3-srv_10.42.42.10(pid=29032): Terminated {rc=256} 13:43:43.325127 --- ParallelTerminationStrategy: PID 29033 died... 13:43:43.345067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29033): Terminated: ok {rc=0} 13:43:43.391758 --- ParallelTerminationStrategy: PID 29034 died... 13:43:43.411742 run iperf3-srv_10.42.42.10(pid=29034): Terminated {rc=256} 13:43:43.458097 --- ParallelTerminationStrategy: PID 29037 died... 13:43:43.478519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29037): Terminated: ok {rc=0} 13:43:43.525140 --- ParallelTerminationStrategy: PID 29040 died... 13:43:43.545171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29040): Terminated: ok {rc=0} 13:43:43.591489 --- ParallelTerminationStrategy: PID 29043 died... 13:43:43.611459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29043): Terminated: ok {rc=0} 13:43:43.698694 bus /gobi_0: Setting Powered False 13:43:44.799020 bus /gobi_0: Setting Powered False 13:43:45.922020 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:43:47.075564 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:47.088770 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:43:47.167539 tst iperf3.py: using LAC 41297 13:43:47.313528 tst iperf3.py: using RAC 242 13:43:47.440893 tst iperf3.py: using CellId 41297 13:43:47.558584 tst iperf3.py: using BVCI 41298 13:43:47.668634 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:47.679499 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:47.690180 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:47.701271 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:47.711783 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:47.722461 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:47.733160 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:47.743661 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:47.754495 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:47.873504 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:43:48.095119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:48.422201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29045): Launched 13:43:48.708377 run iperf3-srv_10.42.42.10(pid=29046): Launched 13:43:48.831410 tst iperf3.py:8: start network... 13:43:49.052219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:43:49.559535 run create_hlr_db(pid=29047): Launched 13:43:49.684031 bus /gobi_6: Setting Powered False 13:43:50.747852 run create_hlr_db(pid=29047): Terminated: ok {rc=0} 13:43:51.203018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29049): Launched 13:43:51.531259 run osmo-hlr_10.42.42.2(pid=29050): Launched 13:43:51.658640 run osmo-stp_10.42.42.5: Starting osmo-stp 13:43:52.222657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29052): Launched 13:43:52.550571 run osmo-stp_10.42.42.5(pid=29053): Launched 13:43:52.675663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:43:53.240465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29055): Launched 13:43:53.365404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:43:53.642227 run patchelf(pid=29056): Launched 13:43:53.824359 run osmo-stp_10.42.42.5(pid=29053): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29053)] 13:43:53.962679 run osmo-stp_10.42.42.5(pid=29053): stdout: | (launched: 2022-12-14_13:43:52.490369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:54.103032 run osmo-stp_10.42.42.5(pid=29053): stderr: | 20221214134352684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134352684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134352684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134352685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134352685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134352685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134352685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:54.243132 run osmo-stp_10.42.42.5(pid=29053): stdout: | (launched: 2022-12-14_13:43:52.490369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:43:54.377213 run osmo-stp_10.42.42.5(pid=29053): stderr: | 20221214134352684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134352684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134352684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134352685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134352685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134352685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134352685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:43:54.536334 run patchelf(pid=29056): Terminating (SIGINT) 13:43:54.719324 run patchelf(pid=29056): Terminated: ok {rc=0} 13:43:54.851183 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29053): Process ended prematurely: osmo-stp_10.42.42.5(pid=29053) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29053)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 13:43:54.861192 tst iperf3.py:8: Test FAILED (7.8 sec) 13:43:54.889680 run osmo-hlr_10.42.42.2(pid=29050): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29050)] 13:43:54.940478 run osmo-hlr_10.42.42.2(pid=29050): stdout: | (launched: 2022-12-14_13:43:51.471137) 13:43:54.992577 run osmo-hlr_10.42.42.2(pid=29050): stderr: | 20221214134351671 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134351671 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134351671 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134351671 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134351671 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134351671 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134351684 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134351693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134351694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134351694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:43:55.045565 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29045): Terminating (SIGTERM) 13:43:55.087299 run iperf3-srv_10.42.42.10(pid=29046): Terminating (SIGTERM) 13:43:55.130144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29049): Terminating (SIGTERM) 13:43:55.172399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29052): Terminating (SIGTERM) 13:43:55.214972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29055): Terminating (SIGTERM) 13:43:55.257666 --- ParallelTerminationStrategy: PID 29045 died... 13:43:55.278189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29045): Terminated: ok {rc=0} 13:43:55.324827 --- ParallelTerminationStrategy: PID 29046 died... 13:43:55.344609 run iperf3-srv_10.42.42.10(pid=29046): Terminated {rc=256} 13:43:55.391235 --- ParallelTerminationStrategy: PID 29049 died... 13:43:55.411050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29049): Terminated: ok {rc=0} 13:43:55.457414 --- ParallelTerminationStrategy: PID 29052 died... 13:43:55.477511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29052): Terminated: ok {rc=0} 13:43:55.524379 --- ParallelTerminationStrategy: PID 29055 died... 13:43:55.544593 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29055): Terminated: ok {rc=0} 13:43:55.634295 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:43:56.781418 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:56.793089 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:43:56.863488 tst iperf3m4.py: using LAC 41298 13:43:56.983651 tst iperf3m4.py: using RAC 243 13:43:57.104448 tst iperf3m4.py: using CellId 41298 13:43:57.223487 tst iperf3m4.py: using BVCI 41299 13:43:57.335670 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:57.346676 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:57.357394 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:57.368115 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:57.378710 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:57.389338 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:57.400007 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:57.411145 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:43:57.422536 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:57.543898 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:57.666058 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:57.782826 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:43:57.903549 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:43:58.125142 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:58.453188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29057): Launched 13:43:58.738330 run iperf3-srv_10.42.42.10(pid=29058): Launched 13:43:58.862670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:43:59.083095 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:43:59.411365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29059): Launched 13:43:59.697376 run iperf3-srv_10.42.42.10(pid=29060): Launched 13:43:59.821503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:44:00.042460 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:00.370637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29061): Launched 13:44:00.656701 run iperf3-srv_10.42.42.10(pid=29062): Launched 13:44:00.779150 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:44:01.022966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:01.356128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29063): Launched 13:44:01.655431 run iperf3-srv_10.42.42.10(pid=29064): Launched 13:44:01.793803 tst iperf3m4.py:8: start network... 13:44:02.019314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:02.531169 run create_hlr_db(pid=29065): Launched 13:44:02.656567 bus /gobi_6: Setting Powered False 13:44:03.721435 run create_hlr_db(pid=29065): Terminated: ok {rc=0} 13:44:04.158577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29067): Launched 13:44:04.466261 run osmo-hlr_10.42.42.2(pid=29068): Launched 13:44:04.582612 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:05.112317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29070): Launched 13:44:05.417139 run osmo-stp_10.42.42.5(pid=29071): Launched 13:44:05.532771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:06.058132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29073): Launched 13:44:06.174637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:06.431109 run patchelf(pid=29074): Launched 13:44:06.600683 run osmo-stp_10.42.42.5(pid=29071): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29071)] 13:44:06.729224 run osmo-stp_10.42.42.5(pid=29071): stdout: | (launched: 2022-12-14_13:44:05.360736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:06.859173 run osmo-stp_10.42.42.5(pid=29071): stderr: | 20221214134405532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134405532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134405532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134405533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134405535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134405535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134405535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:06.989241 run osmo-stp_10.42.42.5(pid=29071): stdout: | (launched: 2022-12-14_13:44:05.360736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:07.113720 run osmo-stp_10.42.42.5(pid=29071): stderr: | 20221214134405532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134405532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134405532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134405533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134405535 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134405535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134405535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:07.261335 run patchelf(pid=29074): Terminating (SIGINT) 13:44:07.431618 run patchelf(pid=29074): Terminated: ok {rc=0} 13:44:07.554831 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29071): Process ended prematurely: osmo-stp_10.42.42.5(pid=29071) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29071)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:44:07.564154 tst iperf3m4.py:8: Test FAILED (10.8 sec) 13:44:07.591439 run osmo-hlr_10.42.42.2(pid=29068): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29068)] 13:44:07.638937 run osmo-hlr_10.42.42.2(pid=29068): stdout: | (launched: 2022-12-14_13:44:04.409633) 13:44:07.688051 run osmo-hlr_10.42.42.2(pid=29068): stderr: | 20221214134404590 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134404590 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134404590 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134404590 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134404590 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134404590 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134404602 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134404611 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134404611 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134404611 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:07.737632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29057): Terminating (SIGTERM) 13:44:07.777491 run iperf3-srv_10.42.42.10(pid=29058): Terminating (SIGTERM) 13:44:07.816924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29059): Terminating (SIGTERM) 13:44:07.856570 run iperf3-srv_10.42.42.10(pid=29060): Terminating (SIGTERM) 13:44:07.895966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29061): Terminating (SIGTERM) 13:44:07.935534 run iperf3-srv_10.42.42.10(pid=29062): Terminating (SIGTERM) 13:44:07.974985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29063): Terminating (SIGTERM) 13:44:08.014505 run iperf3-srv_10.42.42.10(pid=29064): Terminating (SIGTERM) 13:44:08.053783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29067): Terminating (SIGTERM) 13:44:08.093333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29070): Terminating (SIGTERM) 13:44:08.133605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29073): Terminating (SIGTERM) 13:44:08.173596 --- ParallelTerminationStrategy: PID 29057 died... 13:44:08.193001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29057): Terminated: ok {rc=0} 13:44:08.237237 --- ParallelTerminationStrategy: PID 29058 died... 13:44:08.255764 run iperf3-srv_10.42.42.10(pid=29058): Terminated {rc=256} 13:44:08.299944 --- ParallelTerminationStrategy: PID 29059 died... 13:44:08.318761 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29059): Terminated: ok {rc=0} 13:44:08.362629 --- ParallelTerminationStrategy: PID 29060 died... 13:44:08.381436 run iperf3-srv_10.42.42.10(pid=29060): Terminated {rc=256} 13:44:08.425287 --- ParallelTerminationStrategy: PID 29061 died... 13:44:08.443939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29061): Terminated: ok {rc=0} 13:44:08.488259 --- ParallelTerminationStrategy: PID 29062 died... 13:44:08.507064 run iperf3-srv_10.42.42.10(pid=29062): Terminated {rc=256} 13:44:08.551016 --- ParallelTerminationStrategy: PID 29063 died... 13:44:08.569961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29063): Terminated: ok {rc=0} 13:44:08.613961 --- ParallelTerminationStrategy: PID 29064 died... 13:44:08.632818 run iperf3-srv_10.42.42.10(pid=29064): Terminated {rc=256} 13:44:08.676694 --- ParallelTerminationStrategy: PID 29067 died... 13:44:08.695604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29067): Terminated: ok {rc=0} 13:44:08.739483 --- ParallelTerminationStrategy: PID 29070 died... 13:44:08.758165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29070): Terminated: ok {rc=0} 13:44:08.802112 --- ParallelTerminationStrategy: PID 29073 died... 13:44:08.820800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29073): Terminated: ok {rc=0} 13:44:08.907170 bus /gobi_4: Setting Powered False 13:44:10.007370 bus /gobi_4: Setting Powered False 13:44:11.124240 bus /gobi_1: Setting Powered False 13:44:12.223854 bus /gobi_1: Setting Powered False 13:44:13.339784 bus /gobi_0: Setting Powered False 13:44:14.437782 bus /gobi_0: Setting Powered False 13:44:15.552528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:44:16.660794 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:16.674282 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:44:16.750357 tst ping.py: using LAC 41299 13:44:16.926825 tst ping.py: using RAC 244 13:44:17.062223 tst ping.py: using CellId 41299 13:44:17.191674 tst ping.py: using BVCI 41300 13:44:17.310194 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:17.321960 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:17.333088 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:17.344465 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:17.355961 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:17.367362 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:17.379271 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:17.390582 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:44:17.507298 tst ping.py:19: start network... 13:44:17.708593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:18.173564 run create_hlr_db(pid=29075): Launched 13:44:18.296837 bus /gobi_6: Setting Powered False 13:44:19.357199 run create_hlr_db(pid=29075): Terminated: ok {rc=0} 13:44:19.775917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29077): Launched 13:44:20.075908 run osmo-hlr_10.42.42.2(pid=29078): Launched 13:44:20.190245 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:20.708634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29081): Launched 13:44:21.008692 run osmo-stp_10.42.42.5(pid=29082): Launched 13:44:21.123241 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:21.638916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29084): Launched 13:44:21.753465 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:22.006753 run patchelf(pid=29085): Launched 13:44:22.173615 run osmo-stp_10.42.42.5(pid=29082): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29082)] 13:44:22.300483 run osmo-stp_10.42.42.5(pid=29082): stdout: | (launched: 2022-12-14_13:44:20.953149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:22.428291 run osmo-stp_10.42.42.5(pid=29082): stderr: | 20221214134421123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134421123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134421123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134421123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134421124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134421124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134421124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:22.556571 run osmo-stp_10.42.42.5(pid=29082): stdout: | (launched: 2022-12-14_13:44:20.953149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:22.679043 run osmo-stp_10.42.42.5(pid=29082): stderr: | 20221214134421123 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134421123 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134421123 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134421123 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134421124 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134421124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134421124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:22.824099 run patchelf(pid=29085): Terminating (SIGINT) 13:44:22.991641 run patchelf(pid=29085): Terminated: ok {rc=0} 13:44:23.112471 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29082): Process ended prematurely: osmo-stp_10.42.42.5(pid=29082) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29082)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 13:44:23.121406 tst ping.py:22: Test FAILED (6.5 sec) 13:44:23.148221 run osmo-hlr_10.42.42.2(pid=29078): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29078)] 13:44:23.195765 run osmo-hlr_10.42.42.2(pid=29078): stdout: | (launched: 2022-12-14_13:44:20.020319) 13:44:23.244795 run osmo-hlr_10.42.42.2(pid=29078): stderr: | 20221214134420196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134420196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134420196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134420196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134420196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134420196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134420208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134420217 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134420217 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134420217 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:23.294412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29077): Terminating (SIGTERM) 13:44:23.333851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29081): Terminating (SIGTERM) 13:44:23.373555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29084): Terminating (SIGTERM) 13:44:23.413580 --- ParallelTerminationStrategy: PID 29077 died... 13:44:23.432875 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29077): Terminated: ok {rc=0} 13:44:23.477560 --- ParallelTerminationStrategy: PID 29081 died... 13:44:23.496221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29081): Terminated: ok {rc=0} 13:44:23.540437 --- ParallelTerminationStrategy: PID 29084 died... 13:44:23.559252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29084): Terminated: ok {rc=0} 13:44:23.642431 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:44:24.729496 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:24.741824 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:44:24.818175 tst ping_idle_ping.py: using LAC 41300 13:44:24.943948 tst ping_idle_ping.py: using RAC 245 13:44:25.068746 tst ping_idle_ping.py: using CellId 41300 13:44:25.193277 tst ping_idle_ping.py: using BVCI 41301 13:44:25.310624 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.322201 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.333397 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.344611 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.356129 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.367671 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.379259 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:44:25.390751 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:44:25.506101 tst ping_idle_ping.py:24: start network... 13:44:25.707555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:26.176909 run create_hlr_db(pid=29086): Launched 13:44:26.302116 bus /gobi_6: Setting Powered False 13:44:27.362638 run create_hlr_db(pid=29086): Terminated: ok {rc=0} 13:44:27.783118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29088): Launched 13:44:28.085305 run osmo-hlr_10.42.42.2(pid=29089): Launched 13:44:28.199626 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:28.715943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29091): Launched 13:44:29.017234 run osmo-stp_10.42.42.5(pid=29092): Launched 13:44:29.132022 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:29.650503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29094): Launched 13:44:29.765054 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:30.019338 run patchelf(pid=29095): Launched 13:44:30.186578 run osmo-stp_10.42.42.5(pid=29092): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29092)] 13:44:30.314801 run osmo-stp_10.42.42.5(pid=29092): stdout: | (launched: 2022-12-14_13:44:28.961467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:30.443830 run osmo-stp_10.42.42.5(pid=29092): stderr: | 20221214134429130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134429130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134429130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134429131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134429133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134429133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134429133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:30.572924 run osmo-stp_10.42.42.5(pid=29092): stdout: | (launched: 2022-12-14_13:44:28.961467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:30.696161 run osmo-stp_10.42.42.5(pid=29092): stderr: | 20221214134429130 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134429130 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134429130 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134429131 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134429133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134429133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134429133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:30.858434 run patchelf(pid=29095): Terminating (SIGINT) 13:44:31.030938 run patchelf(pid=29095): Terminated: ok {rc=0} 13:44:31.154772 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29092): Process ended prematurely: osmo-stp_10.42.42.5(pid=29092) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29092)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:44:31.164275 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:44:31.191716 run osmo-hlr_10.42.42.2(pid=29089): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29089)] 13:44:31.240661 run osmo-hlr_10.42.42.2(pid=29089): stdout: | (launched: 2022-12-14_13:44:28.029385) 13:44:31.291120 run osmo-hlr_10.42.42.2(pid=29089): stderr: | 20221214134428208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134428208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134428208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134428208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134428208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134428208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134428225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134428234 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134428235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134428235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:31.341924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29088): Terminating (SIGTERM) 13:44:31.382642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29091): Terminating (SIGTERM) 13:44:31.423173 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29094): Terminating (SIGTERM) 13:44:31.464387 --- ParallelTerminationStrategy: PID 29088 died... 13:44:31.484166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29088): Terminated: ok {rc=0} 13:44:31.530367 --- ParallelTerminationStrategy: PID 29091 died... 13:44:31.551808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29091): Terminated: ok {rc=0} 13:44:31.597310 --- ParallelTerminationStrategy: PID 29094 died... 13:44:31.616720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29094): Terminated: ok {rc=0} 13:44:31.702201 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:44:33.003583 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:44:33.009922 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:44:33.042810 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:44:33.082251 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:44:33.168749 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:44:33.201044 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:44:33.238655 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:44:33.832643 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:44:33.882130 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:33.893003 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:44:33.961877 tst cs_paging_gprs_active.py: using LAC 41301 13:44:34.083881 tst cs_paging_gprs_active.py: using RAC 246 13:44:34.208885 tst cs_paging_gprs_active.py: using CellId 41301 13:44:34.332029 tst cs_paging_gprs_active.py: using BVCI 41302 13:44:34.455891 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:34.467376 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:34.478729 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:34.490094 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:34.502639 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:34.514912 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:34.527212 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:34.539285 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:34.551688 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:34.668466 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:34.793417 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:44:35.016762 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:35.347203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29101): Launched 13:44:35.634574 run iperf3-srv_10.42.42.10(pid=29102): Launched 13:44:35.759536 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:44:35.981314 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:36.310352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29103): Launched 13:44:36.597730 run iperf3-srv_10.42.42.10(pid=29104): Launched 13:44:36.719857 tst cs_paging_gprs_active.py:38: start network... 13:44:36.941406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:37.449175 run create_hlr_db(pid=29105): Launched 13:44:37.574556 bus /gobi_6: Setting Powered False 13:44:38.639775 run create_hlr_db(pid=29105): Terminated: ok {rc=0} 13:44:39.095677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29107): Launched 13:44:39.424331 run osmo-hlr_10.42.42.2(pid=29108): Launched 13:44:39.550593 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:40.118647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29110): Launched 13:44:40.448370 run osmo-stp_10.42.42.5(pid=29111): Launched 13:44:40.574913 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:41.141492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29113): Launched 13:44:41.266964 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:41.546198 run patchelf(pid=29114): Launched 13:44:41.732040 run osmo-stp_10.42.42.5(pid=29111): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29111)] 13:44:41.871043 run osmo-stp_10.42.42.5(pid=29111): stdout: | (launched: 2022-12-14_13:44:40.388083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:42.012111 run osmo-stp_10.42.42.5(pid=29111): stderr: | 20221214134440583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134440583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134440583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134440584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134440584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134440584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134440584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:42.152471 run osmo-stp_10.42.42.5(pid=29111): stdout: | (launched: 2022-12-14_13:44:40.388083) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:42.287059 run osmo-stp_10.42.42.5(pid=29111): stderr: | 20221214134440583 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134440583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134440583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134440584 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134440584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134440584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134440584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:42.446971 run patchelf(pid=29114): Terminating (SIGINT) 13:44:42.631005 run patchelf(pid=29114): Terminated: ok {rc=0} 13:44:42.763084 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29111): Process ended prematurely: osmo-stp_10.42.42.5(pid=29111) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29111)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:44:42.773182 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:44:42.801483 run osmo-hlr_10.42.42.2(pid=29108): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29108)] 13:44:42.852048 run osmo-hlr_10.42.42.2(pid=29108): stdout: | (launched: 2022-12-14_13:44:39.364274) 13:44:42.903948 run osmo-hlr_10.42.42.2(pid=29108): stderr: | 20221214134439564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134439564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134439564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134439564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134439564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134439564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134439577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134439585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134439586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134439586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:42.955888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29101): Terminating (SIGTERM) 13:44:42.997546 run iperf3-srv_10.42.42.10(pid=29102): Terminating (SIGTERM) 13:44:43.039892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29103): Terminating (SIGTERM) 13:44:43.082051 run iperf3-srv_10.42.42.10(pid=29104): Terminating (SIGTERM) 13:44:43.123686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29107): Terminating (SIGTERM) 13:44:43.165480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29110): Terminating (SIGTERM) 13:44:43.207185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29113): Terminating (SIGTERM) 13:44:43.249764 --- ParallelTerminationStrategy: PID 29101 died... 13:44:43.270205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29101): Terminated: ok {rc=0} 13:44:43.316679 --- ParallelTerminationStrategy: PID 29102 died... 13:44:43.336490 run iperf3-srv_10.42.42.10(pid=29102): Terminated {rc=256} 13:44:43.382616 --- ParallelTerminationStrategy: PID 29103 died... 13:44:43.402662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29103): Terminated: ok {rc=0} 13:44:43.448809 --- ParallelTerminationStrategy: PID 29104 died... 13:44:43.469170 run iperf3-srv_10.42.42.10(pid=29104): Terminated {rc=256} 13:44:43.515549 --- ParallelTerminationStrategy: PID 29107 died... 13:44:43.535411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29107): Terminated: ok {rc=0} 13:44:43.581724 --- ParallelTerminationStrategy: PID 29110 died... 13:44:43.601575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29110): Terminated: ok {rc=0} 13:44:43.647700 --- ParallelTerminationStrategy: PID 29113 died... 13:44:43.667513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29113): Terminated: ok {rc=0} 13:44:43.754985 bus /gobi_0: Setting Powered False 13:44:44.852196 bus /gobi_0: Setting Powered False 13:44:45.976122 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:44:47.128252 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:47.140793 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:44:47.212341 tst iperf3.py: using LAC 41302 13:44:47.332623 tst iperf3.py: using RAC 247 13:44:47.464327 tst iperf3.py: using CellId 41302 13:44:47.595928 tst iperf3.py: using BVCI 41303 13:44:47.716430 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:47.728022 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:47.739395 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:47.750708 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:47.762078 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:47.773534 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:47.785061 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:47.796429 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:47.808131 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:47.922665 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:44:48.128272 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:48.435395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29115): Launched 13:44:48.702471 run iperf3-srv_10.42.42.10(pid=29116): Launched 13:44:48.818792 tst iperf3.py:8: start network... 13:44:49.023567 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:44:49.498180 run create_hlr_db(pid=29117): Launched 13:44:49.623795 bus /gobi_6: Setting Powered False 13:44:50.684268 run create_hlr_db(pid=29117): Terminated: ok {rc=0} 13:44:51.132387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29119): Launched 13:44:51.461170 run osmo-hlr_10.42.42.2(pid=29120): Launched 13:44:51.587833 run osmo-stp_10.42.42.5: Starting osmo-stp 13:44:52.151377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29122): Launched 13:44:52.479148 run osmo-stp_10.42.42.5(pid=29123): Launched 13:44:52.607269 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:44:53.172021 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29125): Launched 13:44:53.296850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:44:53.574156 run patchelf(pid=29126): Launched 13:44:53.755840 run osmo-stp_10.42.42.5(pid=29123): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29123)] 13:44:53.894459 run osmo-stp_10.42.42.5(pid=29123): stdout: | (launched: 2022-12-14_13:44:52.419266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:54.035093 run osmo-stp_10.42.42.5(pid=29123): stderr: | 20221214134452611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134452611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134452612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134452612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134452613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134452613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134452613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:54.175594 run osmo-stp_10.42.42.5(pid=29123): stdout: | (launched: 2022-12-14_13:44:52.419266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:44:54.310268 run osmo-stp_10.42.42.5(pid=29123): stderr: | 20221214134452611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134452611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134452612 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134452612 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134452613 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134452613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134452613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:44:54.469730 run patchelf(pid=29126): Terminating (SIGINT) 13:44:54.653499 run patchelf(pid=29126): Terminated: ok {rc=0} 13:44:54.785332 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29123): Process ended prematurely: osmo-stp_10.42.42.5(pid=29123) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29123)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 13:44:54.795406 tst iperf3.py:8: Test FAILED (7.7 sec) 13:44:54.824132 run osmo-hlr_10.42.42.2(pid=29120): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29120)] 13:44:54.874920 run osmo-hlr_10.42.42.2(pid=29120): stdout: | (launched: 2022-12-14_13:44:51.401342) 13:44:54.926972 run osmo-hlr_10.42.42.2(pid=29120): stderr: | 20221214134451600 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134451600 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134451600 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134451600 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134451600 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134451600 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134451626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134451635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134451635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134451635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:44:54.979476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29115): Terminating (SIGTERM) 13:44:55.021666 run iperf3-srv_10.42.42.10(pid=29116): Terminating (SIGTERM) 13:44:55.063927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29119): Terminating (SIGTERM) 13:44:55.106373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29122): Terminating (SIGTERM) 13:44:55.148734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29125): Terminating (SIGTERM) 13:44:55.191854 --- ParallelTerminationStrategy: PID 29115 died... 13:44:55.212563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29115): Terminated: ok {rc=0} 13:44:55.259405 --- ParallelTerminationStrategy: PID 29116 died... 13:44:55.279486 run iperf3-srv_10.42.42.10(pid=29116): Terminated {rc=256} 13:44:55.326028 --- ParallelTerminationStrategy: PID 29119 died... 13:44:55.346229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29119): Terminated: ok {rc=0} 13:44:55.392739 --- ParallelTerminationStrategy: PID 29122 died... 13:44:55.412891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29122): Terminated: ok {rc=0} 13:44:55.459403 --- ParallelTerminationStrategy: PID 29125 died... 13:44:55.479569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29125): Terminated: ok {rc=0} 13:44:55.567762 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:44:56.716249 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:56.727920 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:44:56.798066 tst iperf3m4.py: using LAC 41303 13:44:56.927738 tst iperf3m4.py: using RAC 248 13:44:57.049203 tst iperf3m4.py: using CellId 41303 13:44:57.168764 tst iperf3m4.py: using BVCI 41304 13:44:57.279109 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:57.290224 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:57.300838 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:57.311635 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:57.322215 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:57.332757 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:57.344393 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:57.355124 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:44:57.366005 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:57.482384 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:57.603881 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:57.721112 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:44:57.836927 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:44:58.042442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:58.350033 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29127): Launched 13:44:58.618285 run iperf3-srv_10.42.42.10(pid=29128): Launched 13:44:58.735313 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:44:58.939954 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:44:59.247163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29129): Launched 13:44:59.515047 run iperf3-srv_10.42.42.10(pid=29130): Launched 13:44:59.629861 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:44:59.834965 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:00.141767 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29131): Launched 13:45:00.408140 run iperf3-srv_10.42.42.10(pid=29132): Launched 13:45:00.522361 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:45:00.726804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:45:01.041623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29133): Launched 13:45:01.376139 run iperf3-srv_10.42.42.10(pid=29134): Launched 13:45:01.507593 tst iperf3m4.py:8: start network... 13:45:01.742012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:02.231744 run create_hlr_db(pid=29138): Launched 13:45:02.385544 bus /gobi_6: Setting Powered False 13:45:03.450806 run create_hlr_db(pid=29138): Terminated: ok {rc=0} 13:45:03.907936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Launched 13:45:04.237739 run osmo-hlr_10.42.42.2(pid=29141): Launched 13:45:04.364313 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:04.932530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Launched 13:45:05.261768 run osmo-stp_10.42.42.5(pid=29144): Launched 13:45:05.387141 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:05.953944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Launched 13:45:06.079291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:06.357452 run patchelf(pid=29147): Launched 13:45:06.540482 run osmo-stp_10.42.42.5(pid=29144): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] 13:45:06.679567 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-14_13:45:05.201263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:06.820046 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221214134505395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134505395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134505395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134505395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134505398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134505398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134505398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:06.960296 run osmo-stp_10.42.42.5(pid=29144): stdout: | (launched: 2022-12-14_13:45:05.201263) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:07.095060 run osmo-stp_10.42.42.5(pid=29144): stderr: | 20221214134505395 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134505395 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134505395 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134505395 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134505398 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134505398 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134505398 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:07.254504 run patchelf(pid=29147): Terminating (SIGINT) 13:45:07.437836 run patchelf(pid=29147): Terminated: ok {rc=0} 13:45:07.571152 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:45:07.581603 tst iperf3m4.py:8: Test FAILED (10.9 sec) 13:45:07.610808 run osmo-hlr_10.42.42.2(pid=29141): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29141)] 13:45:07.661880 run osmo-hlr_10.42.42.2(pid=29141): stdout: | (launched: 2022-12-14_13:45:04.177782) 13:45:07.714150 run osmo-hlr_10.42.42.2(pid=29141): stderr: | 20221214134504379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134504379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134504379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134504379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134504379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134504379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134504393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134504403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134504403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134504403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:07.766668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29127): Terminating (SIGTERM) 13:45:07.809318 run iperf3-srv_10.42.42.10(pid=29128): Terminating (SIGTERM) 13:45:07.852454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29129): Terminating (SIGTERM) 13:45:07.895295 run iperf3-srv_10.42.42.10(pid=29130): Terminating (SIGTERM) 13:45:07.938364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29131): Terminating (SIGTERM) 13:45:07.981147 run iperf3-srv_10.42.42.10(pid=29132): Terminating (SIGTERM) 13:45:08.024067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29133): Terminating (SIGTERM) 13:45:08.066583 run iperf3-srv_10.42.42.10(pid=29134): Terminating (SIGTERM) 13:45:08.109347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminating (SIGTERM) 13:45:08.151594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminating (SIGTERM) 13:45:08.194487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminating (SIGTERM) 13:45:08.237131 --- ParallelTerminationStrategy: PID 29127 died... 13:45:08.257716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29127): Terminated: ok {rc=0} 13:45:08.304607 --- ParallelTerminationStrategy: PID 29128 died... 13:45:08.324644 run iperf3-srv_10.42.42.10(pid=29128): Terminated {rc=256} 13:45:08.371200 --- ParallelTerminationStrategy: PID 29129 died... 13:45:08.391303 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29129): Terminated: ok {rc=0} 13:45:08.438069 --- ParallelTerminationStrategy: PID 29130 died... 13:45:08.458047 run iperf3-srv_10.42.42.10(pid=29130): Terminated {rc=256} 13:45:08.504589 --- ParallelTerminationStrategy: PID 29131 died... 13:45:08.524893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29131): Terminated: ok {rc=0} 13:45:08.571673 --- ParallelTerminationStrategy: PID 29132 died... 13:45:08.591684 run iperf3-srv_10.42.42.10(pid=29132): Terminated {rc=256} 13:45:08.638452 --- ParallelTerminationStrategy: PID 29133 died... 13:45:08.658507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29133): Terminated: ok {rc=0} 13:45:08.705328 --- ParallelTerminationStrategy: PID 29134 died... 13:45:08.725332 run iperf3-srv_10.42.42.10(pid=29134): Terminated {rc=256} 13:45:08.771867 --- ParallelTerminationStrategy: PID 29140 died... 13:45:08.792037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29140): Terminated: ok {rc=0} 13:45:08.838590 --- ParallelTerminationStrategy: PID 29143 died... 13:45:08.858616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29143): Terminated: ok {rc=0} 13:45:08.905221 --- ParallelTerminationStrategy: PID 29146 died... 13:45:08.925691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29146): Terminated: ok {rc=0} 13:45:09.014456 bus /gobi_4: Setting Powered False 13:45:10.113475 bus /gobi_4: Setting Powered False 13:45:11.233432 bus /gobi_1: Setting Powered False 13:45:12.332804 bus /gobi_1: Setting Powered False 13:45:13.448235 bus /gobi_0: Setting Powered False 13:45:14.546482 bus /gobi_0: Setting Powered False 13:45:15.663673 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:45:16.769609 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:16.782066 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:45:16.859642 tst ping.py: using LAC 41304 13:45:17.017487 tst ping.py: using RAC 249 13:45:17.177746 tst ping.py: using CellId 41304 13:45:17.305636 tst ping.py: using BVCI 41305 13:45:17.424529 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:17.436774 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:17.448127 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:17.459379 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:17.470954 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:17.482427 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:17.494011 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:17.505544 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:45:17.625445 tst ping.py:19: start network... 13:45:17.842858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:18.343265 run create_hlr_db(pid=29148): Launched 13:45:18.467807 bus /gobi_6: Setting Powered False 13:45:19.531748 run create_hlr_db(pid=29148): Terminated: ok {rc=0} 13:45:19.964313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Launched 13:45:20.268001 run osmo-hlr_10.42.42.2(pid=29151): Launched 13:45:20.383888 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:20.925311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Launched 13:45:21.226503 run osmo-stp_10.42.42.5(pid=29154): Launched 13:45:21.342948 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:21.880556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Launched 13:45:21.996648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:22.252205 run patchelf(pid=29157): Launched 13:45:22.419687 run osmo-stp_10.42.42.5(pid=29154): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] 13:45:22.546826 run osmo-stp_10.42.42.5(pid=29154): stdout: | (launched: 2022-12-14_13:45:21.170281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:22.675271 run osmo-stp_10.42.42.5(pid=29154): stderr: | 20221214134521343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134521343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134521343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134521344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134521344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134521344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134521344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:22.804628 run osmo-stp_10.42.42.5(pid=29154): stdout: | (launched: 2022-12-14_13:45:21.170281) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:22.927821 run osmo-stp_10.42.42.5(pid=29154): stderr: | 20221214134521343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134521343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134521343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134521344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134521344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134521344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134521344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:23.074114 run patchelf(pid=29157): Terminating (SIGINT) 13:45:23.242787 run patchelf(pid=29157): Terminated: ok {rc=0} 13:45:23.363755 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29154): Process ended prematurely: osmo-stp_10.42.42.5(pid=29154) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 13:45:23.372421 tst ping.py:22: Test FAILED (6.6 sec) 13:45:23.399153 run osmo-hlr_10.42.42.2(pid=29151): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29151)] 13:45:23.446415 run osmo-hlr_10.42.42.2(pid=29151): stdout: | (launched: 2022-12-14_13:45:20.212294) 13:45:23.495084 run osmo-hlr_10.42.42.2(pid=29151): stderr: | 20221214134520391 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134520391 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134520391 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134520391 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134520391 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134520391 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134520404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134520414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134520414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134520414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:23.544416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Terminating (SIGTERM) 13:45:23.583845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Terminating (SIGTERM) 13:45:23.623220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Terminating (SIGTERM) 13:45:23.663264 --- ParallelTerminationStrategy: PID 29150 died... 13:45:23.682521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29150): Terminated: ok {rc=0} 13:45:23.726340 --- ParallelTerminationStrategy: PID 29153 died... 13:45:23.744883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29153): Terminated: ok {rc=0} 13:45:23.788694 --- ParallelTerminationStrategy: PID 29156 died... 13:45:23.807510 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29156): Terminated: ok {rc=0} 13:45:23.892818 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:45:24.980238 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:24.991999 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:45:25.065415 tst ping_idle_ping.py: using LAC 41305 13:45:25.185999 tst ping_idle_ping.py: using RAC 250 13:45:25.306875 tst ping_idle_ping.py: using CellId 41305 13:45:25.427664 tst ping_idle_ping.py: using BVCI 41306 13:45:25.539313 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:25.550357 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:25.561237 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:25.572045 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:25.583342 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:25.594735 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:25.606252 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:45:25.617584 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:45:25.732924 tst ping_idle_ping.py:24: start network... 13:45:25.935439 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:26.406820 run create_hlr_db(pid=29158): Launched 13:45:26.531790 bus /gobi_6: Setting Powered False 13:45:27.591680 run create_hlr_db(pid=29158): Terminated: ok {rc=0} 13:45:28.012484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29160): Launched 13:45:28.314997 run osmo-hlr_10.42.42.2(pid=29161): Launched 13:45:28.429928 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:28.949568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29163): Launched 13:45:29.253562 run osmo-stp_10.42.42.5(pid=29164): Launched 13:45:29.369053 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:29.891968 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29166): Launched 13:45:30.006698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:30.262224 run patchelf(pid=29167): Launched 13:45:30.428568 run osmo-stp_10.42.42.5(pid=29164): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29164)] 13:45:30.555807 run osmo-stp_10.42.42.5(pid=29164): stdout: | (launched: 2022-12-14_13:45:29.197539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:30.684180 run osmo-stp_10.42.42.5(pid=29164): stderr: | 20221214134529369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134529369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134529369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134529370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134529370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134529370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134529370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:30.813566 run osmo-stp_10.42.42.5(pid=29164): stdout: | (launched: 2022-12-14_13:45:29.197539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:30.982475 run osmo-stp_10.42.42.5(pid=29164): stderr: | 20221214134529369 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134529369 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134529369 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134529370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134529370 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134529370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134529370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:31.133892 run patchelf(pid=29167): Terminating (SIGINT) 13:45:31.308757 run patchelf(pid=29167): Terminated: ok {rc=0} 13:45:31.433756 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29164): Process ended prematurely: osmo-stp_10.42.42.5(pid=29164) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29164)] [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:45:31.443334 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 13:45:31.471548 run osmo-hlr_10.42.42.2(pid=29161): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29161)] 13:45:31.520457 run osmo-hlr_10.42.42.2(pid=29161): stdout: | (launched: 2022-12-14_13:45:28.259003) 13:45:31.571040 run osmo-hlr_10.42.42.2(pid=29161): stderr: | 20221214134528437 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134528437 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134528437 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134528438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134528438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134528438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134528454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134528463 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134528464 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134528464 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:31.622482 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29160): Terminating (SIGTERM) 13:45:31.663253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29163): Terminating (SIGTERM) 13:45:31.703809 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29166): Terminating (SIGTERM) 13:45:31.745390 --- ParallelTerminationStrategy: PID 29160 died... 13:45:31.765484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29160): Terminated: ok {rc=0} 13:45:31.812457 --- ParallelTerminationStrategy: PID 29163 died... 13:45:31.832602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29163): Terminated: ok {rc=0} 13:45:31.877952 --- ParallelTerminationStrategy: PID 29166 died... 13:45:31.898086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29166): Terminated: ok {rc=0} 13:45:31.984728 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:45:33.286988 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:45:33.293421 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:45:33.326130 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:45:33.360181 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:45:33.412023 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:45:33.444750 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:45:33.479210 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:45:34.037373 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:45:34.042706 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:34.054113 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:45:34.123585 tst switch_tch_pdch.py: using LAC 41306 13:45:34.241212 tst switch_tch_pdch.py: using RAC 251 13:45:34.358996 tst switch_tch_pdch.py: using CellId 41306 13:45:34.476631 tst switch_tch_pdch.py: using BVCI 41307 13:45:34.586035 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:34.597199 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:34.607997 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:34.618879 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:34.629934 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:34.640984 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:34.652240 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:45:34.663309 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:45:34.777669 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:45:34.898674 tst switch_tch_pdch.py:51: start network... 13:45:35.100423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:35.565967 run create_hlr_db(pid=29171): Launched 13:45:35.690982 bus /gobi_6: Setting Powered False 13:45:36.751226 run create_hlr_db(pid=29171): Terminated: ok {rc=0} 13:45:37.171220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29173): Launched 13:45:37.471891 run osmo-hlr_10.42.42.2(pid=29174): Launched 13:45:37.587900 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:38.120294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29176): Launched 13:45:38.420805 run osmo-stp_10.42.42.5(pid=29177): Launched 13:45:38.534677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:39.053120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29179): Launched 13:45:39.167611 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:39.421433 run patchelf(pid=29180): Launched 13:45:39.587964 run osmo-stp_10.42.42.5(pid=29177): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29177)] 13:45:39.714933 run osmo-stp_10.42.42.5(pid=29177): stdout: | (launched: 2022-12-14_13:45:38.365259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:39.843157 run osmo-stp_10.42.42.5(pid=29177): stderr: | 20221214134538537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134538537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134538538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134538538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134538540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134538540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134538540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:39.971821 run osmo-stp_10.42.42.5(pid=29177): stdout: | (launched: 2022-12-14_13:45:38.365259) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:40.094711 run osmo-stp_10.42.42.5(pid=29177): stderr: | 20221214134538537 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134538537 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134538538 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134538538 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134538540 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134538540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134538540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:40.240350 run patchelf(pid=29180): Terminating (SIGINT) 13:45:40.408499 run patchelf(pid=29180): Terminated: ok {rc=0} 13:45:40.530308 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29177): Process ended prematurely: osmo-stp_10.42.42.5(pid=29177) [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29177)] [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:45:40.539130 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:45:40.565832 run osmo-hlr_10.42.42.2(pid=29174): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29174)] 13:45:40.613473 run osmo-hlr_10.42.42.2(pid=29174): stdout: | (launched: 2022-12-14_13:45:37.416240) 13:45:40.662338 run osmo-hlr_10.42.42.2(pid=29174): stderr: | 20221214134537593 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134537593 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134537593 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134537593 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134537594 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134537594 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134537605 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134537614 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134537614 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134537614 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:40.711771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29173): Terminating (SIGTERM) 13:45:40.751634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29176): Terminating (SIGTERM) 13:45:40.791482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29179): Terminating (SIGTERM) 13:45:40.831396 --- ParallelTerminationStrategy: PID 29173 died... 13:45:40.851098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29173): Terminated: ok {rc=0} 13:45:40.895398 --- ParallelTerminationStrategy: PID 29176 died... 13:45:40.914256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29176): Terminated: ok {rc=0} 13:45:40.958136 --- ParallelTerminationStrategy: PID 29179 died... 13:45:40.976893 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29179): Terminated: ok {rc=0} 13:45:41.061586 bus /gobi_0: Setting Powered False 13:45:42.160346 bus /gobi_0: Setting Powered False 13:45:43.276269 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:45:44.530433 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:45:44.537312 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:45:44.570645 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:45:44.605298 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:45:44.657219 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:45:44.689599 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:45:44.723391 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:45:45.281822 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:45:45.288153 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:45:45.300148 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:45:45.369434 tst switch_tch_pdch.py: using LAC 41307 13:45:45.494199 tst switch_tch_pdch.py: using RAC 252 13:45:45.619926 tst switch_tch_pdch.py: using CellId 41307 13:45:45.744909 tst switch_tch_pdch.py: using BVCI 41308 13:45:45.886617 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:45:45.898963 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:45:45.913552 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:45:45.926433 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:45:45.939342 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:45:45.953538 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:45:45.967080 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:45:45.979853 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:45:46.101413 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:45:46.220400 tst switch_tch_pdch.py:51: start network... 13:45:46.456875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:45:46.937413 run create_hlr_db(pid=29184): Launched 13:45:47.097719 bus /gobi_6: Setting Powered False 13:45:48.161715 run create_hlr_db(pid=29184): Terminated: ok {rc=0} 13:45:48.584464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29186): Launched 13:45:48.907587 run osmo-hlr_10.42.42.2(pid=29187): Launched 13:45:49.030478 run osmo-stp_10.42.42.5: Starting osmo-stp 13:45:49.558517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29189): Launched 13:45:49.882720 run osmo-stp_10.42.42.5(pid=29190): Launched 13:45:50.007402 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:45:50.536397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29192): Launched 13:45:50.659661 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:45:50.932361 run patchelf(pid=29193): Launched 13:45:51.111003 run osmo-stp_10.42.42.5(pid=29190): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29190)] 13:45:51.246826 run osmo-stp_10.42.42.5(pid=29190): stdout: | (launched: 2022-12-14_13:45:49.823301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:51.384356 run osmo-stp_10.42.42.5(pid=29190): stderr: | 20221214134550018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134550018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134550018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134550019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134550019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134550019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134550019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:51.522331 run osmo-stp_10.42.42.5(pid=29190): stdout: | (launched: 2022-12-14_13:45:49.823301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:45:51.655006 run osmo-stp_10.42.42.5(pid=29190): stderr: | 20221214134550018 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134550018 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134550018 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134550019 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134550019 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134550019 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134550019 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:45:51.811314 run patchelf(pid=29193): Terminating (SIGINT) 13:45:51.991602 run patchelf(pid=29193): Terminated: ok {rc=0} 13:45:52.124231 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29190): Process ended prematurely: osmo-stp_10.42.42.5(pid=29190) [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29190)] [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:45:52.134066 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 13:45:52.161929 run osmo-hlr_10.42.42.2(pid=29187): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29187)] 13:45:52.212237 run osmo-hlr_10.42.42.2(pid=29187): stdout: | (launched: 2022-12-14_13:45:48.848305) 13:45:52.264055 run osmo-hlr_10.42.42.2(pid=29187): stderr: | 20221214134549048 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134549048 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134549048 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134549048 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134549049 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134549049 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134549060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134549068 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134549069 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134549069 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:45:52.316471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29186): Terminating (SIGTERM) 13:45:52.358552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29189): Terminating (SIGTERM) 13:45:52.400411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29192): Terminating (SIGTERM) 13:45:52.442745 --- ParallelTerminationStrategy: PID 29186 died... 13:45:52.463145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29186): Terminated: ok {rc=0} 13:45:52.509617 --- ParallelTerminationStrategy: PID 29189 died... 13:45:52.529540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29189): Terminated: ok {rc=0} 13:45:52.576478 --- ParallelTerminationStrategy: PID 29192 died... 13:45:52.596699 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29192): Terminated: ok {rc=0} 13:45:52.684744 bus /gobi_0: Setting Powered False 13:45:53.782500 bus /gobi_0: Setting Powered False 13:45:54.897320 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 13:45:56.145259 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:45:56.149126 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:45:56.177758 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 13:45:56.184374 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 13:45:56.234190 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:45:56.262875 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 13:45:56.269564 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 13:45:56.812659 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 13:45:56.818193 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 13:45:56.829661 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:45:56.874819 tst mo_mt_sms.py: using LAC 41308 13:45:56.999885 tst mo_mt_sms.py: using RAC 253 13:45:57.123958 tst mo_mt_sms.py: using CellId 41308 13:45:57.241477 tst mo_mt_sms.py: using BVCI 41309 13:45:57.351698 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:45:57.469988 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:45:57.584704 tst mo_mt_sms.py:9: start nitb and bts... 13:45:57.787583 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:45:58.400517 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29199): Launched 13:45:58.701696 run osmo-nitb_10.42.42.2(pid=29200): Launched 13:45:58.867947 run osmo-nitb_10.42.42.2(pid=29200): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29200)] 13:45:59.003034 run osmo-nitb_10.42.42.2(pid=29200): stdout: | (launched: 2022-12-14_13:45:58.645594) 13:45:59.139004 run osmo-nitb_10.42.42.2(pid=29200): stderr: | (launched: 2022-12-14_13:45:58.690204) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:45:59.274723 run osmo-nitb_10.42.42.2(pid=29200): stdout: | (launched: 2022-12-14_13:45:58.645594) 13:45:59.404839 run osmo-nitb_10.42.42.2(pid=29200): stderr: | (launched: 2022-12-14_13:45:58.690204) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29200): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29200) [trial-2405↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29200)] 13:45:59.814893 tst osmo-nitb_10.42.42.2(pid=29200): stdout: | (launched: 2022-12-14_13:45:58.645594) 13:45:59.935934 tst osmo-nitb_10.42.42.2(pid=29200): stderr: | (launched: 2022-12-14_13:45:58.690204) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:46:00.078687 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29200): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29200) [trial-2405↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29200)] [trial-2405↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 13:46:00.087117 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 13:46:00.093839 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29199): Terminating (SIGTERM) 13:46:00.303917 --- ParallelTerminationStrategy: PID 29199 died... 13:46:00.327678 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29199): Terminated: ok {rc=0} 13:46:00.417064 bus /sierra_3: Setting Powered False 13:46:01.514858 bus /sierra_3: Setting Powered False 13:46:02.633203 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 13:46:03.830939 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:03.835298 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:46:03.865107 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:46:03.893556 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 13:46:03.947577 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:46:03.978892 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:46:04.006586 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 13:46:04.553438 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 13:46:04.558979 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:04.570516 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:46:04.617496 tst mo_mt_sms.py: using LAC 41309 13:46:04.745180 tst mo_mt_sms.py: using RAC 254 13:46:04.872312 tst mo_mt_sms.py: using CellId 41309 13:46:04.999422 tst mo_mt_sms.py: using BVCI 41310 13:46:05.116347 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:05.127725 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:05.138897 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:05.150042 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:05.162037 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:05.173946 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:46:05.290400 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 13:46:05.409887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:05.910026 run create_hlr_db(pid=29204): Launched 13:46:06.033193 bus /sierra_2: Setting Powered False 13:46:07.097820 run create_hlr_db(pid=29204): Terminated: ok {rc=0} 13:46:07.530432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29206): Launched 13:46:07.830905 run osmo-hlr_10.42.42.2(pid=29207): Launched 13:46:07.944852 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:08.478945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29209): Launched 13:46:08.779599 run osmo-stp_10.42.42.5(pid=29210): Launched 13:46:08.894111 run osmo-msc_10.42.42.6: Starting osmo-msc 13:46:09.442340 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29212): Launched 13:46:09.744147 run osmo-msc_10.42.42.6(pid=29213): Launched 13:46:09.912246 run osmo-stp_10.42.42.5(pid=29210): ERR: Terminated: ERROR {rc=1} [trial-2405↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29210)] 13:46:10.040075 run osmo-stp_10.42.42.5(pid=29210): stdout: | (launched: 2022-12-14_13:46:08.723959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:10.167290 run osmo-stp_10.42.42.5(pid=29210): stderr: | 20221214134608897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134608897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134608897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134608898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134608898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134608898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134608898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:10.292778 run osmo-stp_10.42.42.5(pid=29210): stdout: | (launched: 2022-12-14_13:46:08.723959) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:10.413519 run osmo-stp_10.42.42.5(pid=29210): stderr: | 20221214134608897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134608897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134608897 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134608898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134608898 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134608898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134608898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:10.557169 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29210): Process ended prematurely: osmo-stp_10.42.42.5(pid=29210) [trial-2405↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29210)] [trial-2405↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 13:46:10.565508 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 13:46:10.591904 run osmo-hlr_10.42.42.2(pid=29207): ERR: Terminated: ERROR {rc=237} [trial-2405↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29207)] 13:46:10.640340 run osmo-hlr_10.42.42.2(pid=29207): stdout: | (launched: 2022-12-14_13:46:07.774878) 13:46:10.690157 run osmo-hlr_10.42.42.2(pid=29207): stderr: | 20221214134607954 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134607954 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134607954 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134607954 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134607954 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134607954 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134607966 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134607975 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134607975 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134607975 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:10.759346 run osmo-msc_10.42.42.6(pid=29213): ERR: Terminated: ERROR {rc=2} [trial-2405↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29213)] 13:46:10.807390 run osmo-msc_10.42.42.6(pid=29213): stdout: | (launched: 2022-12-14_13:46:09.688214) 13:46:10.857187 run osmo-msc_10.42.42.6(pid=29213): stderr: | 20221214134609961 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134609961 DLGLOBAL DEBUG validating counter group 0x7f84ec7c2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134609961 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134609961 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134609961 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134609961 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134609963 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134609963 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134609964 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134609964 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:46:10.907127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29206): Terminating (SIGTERM) 13:46:10.946960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29209): Terminating (SIGTERM) 13:46:10.986820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29212): Terminating (SIGTERM) 13:46:11.026976 --- ParallelTerminationStrategy: PID 29206 died... 13:46:11.046580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29206): Terminated: ok {rc=0} 13:46:11.091584 --- ParallelTerminationStrategy: PID 29209 died... 13:46:11.110895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29209): Terminated: ok {rc=0} 13:46:11.155963 --- ParallelTerminationStrategy: PID 29212 died... 13:46:11.175096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29212): Terminated: ok {rc=0} 13:46:11.262315 bus /sierra_3: Setting Powered False 13:46:12.362168 bus /sierra_3: Setting Powered False 13:46:13.475298 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 13:46:14.708563 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:14.713048 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:46:14.743367 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 13:46:14.751856 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 13:46:14.787114 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:46:14.815939 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 13:46:14.822737 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 13:46:15.344055 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 13:46:15.350454 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 13:46:15.362650 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:46:15.407826 tst assert_extension.py: using LAC 41310 13:46:15.546021 tst assert_extension.py: using RAC 255 13:46:15.675745 tst assert_extension.py: using CellId 41310 13:46:15.800702 tst assert_extension.py: using BVCI 41311 13:46:15.953809 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 13:46:16.096243 tst assert_extension.py:10: start nitb and bts... 13:46:16.317892 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:46:16.969291 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29218): Launched 13:46:17.310604 run osmo-nitb_10.42.42.2(pid=29219): Launched 13:46:17.491292 run osmo-nitb_10.42.42.2(pid=29219): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29219)] 13:46:17.636577 run osmo-nitb_10.42.42.2(pid=29219): stdout: | (launched: 2022-12-14_13:46:17.250275) 13:46:17.783082 run osmo-nitb_10.42.42.2(pid=29219): stderr: | (launched: 2022-12-14_13:46:17.299468) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:46:17.929346 run osmo-nitb_10.42.42.2(pid=29219): stdout: | (launched: 2022-12-14_13:46:17.250275) 13:46:18.070030 run osmo-nitb_10.42.42.2(pid=29219): stderr: | (launched: 2022-12-14_13:46:17.299468) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29219): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29219) [trial-2405↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29219)] 13:46:18.434234 tst osmo-nitb_10.42.42.2(pid=29219): stdout: | (launched: 2022-12-14_13:46:17.250275) 13:46:18.565579 tst osmo-nitb_10.42.42.2(pid=29219): stderr: | (launched: 2022-12-14_13:46:17.299468) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:46:18.719250 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=29219): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29219) [trial-2405↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29219)] [trial-2405↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 13:46:18.728131 tst assert_extension.py:12: Test FAILED (3.4 sec) 13:46:18.735418 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29218): Terminating (SIGTERM) 13:46:18.947128 --- ParallelTerminationStrategy: PID 29218 died... 13:46:18.969190 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29218): Terminated: ok {rc=0} 13:46:19.058376 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 13:46:20.231624 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:20.236336 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:46:20.266571 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:46:20.295982 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 13:46:20.333230 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:46:20.364207 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:46:20.392035 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 13:46:20.920691 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 13:46:20.926317 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:20.937714 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:46:20.983066 tst assert_extension.py: using LAC 41311 13:46:21.110377 tst assert_extension.py: using RAC 1 13:46:21.238970 tst assert_extension.py: using CellId 41311 13:46:21.364349 tst assert_extension.py: using BVCI 41312 13:46:21.481136 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:21.492542 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:21.504062 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:21.515032 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:21.526378 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:46:21.537694 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 13:46:21.653243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:22.120364 run create_hlr_db(pid=29223): Launched 13:46:22.244837 bus /sierra_2: Setting Powered False 13:46:23.305204 run create_hlr_db(pid=29223): Terminated: ok {rc=0} 13:46:23.747760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29225): Launched 13:46:24.072086 run osmo-hlr_10.42.42.2(pid=29226): Launched 13:46:24.195731 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:24.755826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29228): Launched 13:46:25.080385 run osmo-stp_10.42.42.5(pid=29229): Launched 13:46:25.204025 run osmo-msc_10.42.42.6: Starting osmo-msc 13:46:25.789321 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29231): Launched 13:46:26.113837 run osmo-msc_10.42.42.6(pid=29232): Launched 13:46:26.296070 run osmo-stp_10.42.42.5(pid=29229): ERR: Terminated: ERROR {rc=1} [trial-2405↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29229)] 13:46:26.432888 run osmo-stp_10.42.42.5(pid=29229): stdout: | (launched: 2022-12-14_13:46:25.020704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:26.570979 run osmo-stp_10.42.42.5(pid=29229): stderr: | 20221214134625215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134625215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134625215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134625216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134625218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134625218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134625218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:26.707895 run osmo-stp_10.42.42.5(pid=29229): stdout: | (launched: 2022-12-14_13:46:25.020704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:26.837582 run osmo-stp_10.42.42.5(pid=29229): stderr: | 20221214134625215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134625215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134625215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134625216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134625218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134625218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134625218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:26.992012 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=29229): Process ended prematurely: osmo-stp_10.42.42.5(pid=29229) [trial-2405↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29229)] [trial-2405↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 13:46:27.000766 tst assert_extension.py:17: Test FAILED (6.1 sec) 13:46:27.028266 run osmo-hlr_10.42.42.2(pid=29226): ERR: Terminated: ERROR {rc=237} [trial-2405↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29226)] 13:46:27.079307 run osmo-hlr_10.42.42.2(pid=29226): stdout: | (launched: 2022-12-14_13:46:24.012794) 13:46:27.131500 run osmo-hlr_10.42.42.2(pid=29226): stderr: | 20221214134624211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134624212 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134624212 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134624212 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134624212 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134624212 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134624224 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134624232 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134624232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134624232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:27.205113 run osmo-msc_10.42.42.6(pid=29232): ERR: Terminated: ERROR {rc=2} [trial-2405↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29232)] 13:46:27.255685 run osmo-msc_10.42.42.6(pid=29232): stdout: | (launched: 2022-12-14_13:46:26.054331) 13:46:27.308107 run osmo-msc_10.42.42.6(pid=29232): stderr: | 20221214134626376 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134626376 DLGLOBAL DEBUG validating counter group 0x7f543561ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134626376 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134626376 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134626376 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134626377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134626378 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134626379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134626379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134626379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:46:27.360686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29225): Terminating (SIGTERM) 13:46:27.402772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29228): Terminating (SIGTERM) 13:46:27.445515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29231): Terminating (SIGTERM) 13:46:27.487827 --- ParallelTerminationStrategy: PID 29225 died... 13:46:27.508290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29225): Terminated: ok {rc=0} 13:46:27.555280 --- ParallelTerminationStrategy: PID 29228 died... 13:46:27.575180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29228): Terminated: ok {rc=0} 13:46:27.621773 --- ParallelTerminationStrategy: PID 29231 died... 13:46:27.641685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29231): Terminated: ok {rc=0} 13:46:27.729868 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:46:28.936416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:28.943974 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:46:28.972795 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:46:28.999710 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:46:29.051602 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:46:29.081392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:46:29.109028 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:46:29.659234 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:46:29.709475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:29.720776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:46:29.790533 tst mo_mt_call.py: using LAC 41312 13:46:29.910468 tst mo_mt_call.py: using RAC 2 13:46:30.030947 tst mo_mt_call.py: using CellId 41312 13:46:30.151041 tst mo_mt_call.py: using BVCI 41313 13:46:30.263159 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:30.274531 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:30.286296 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:30.297593 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:30.308784 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:30.320034 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:46:30.440758 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:46:30.557814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:31.043698 run create_hlr_db(pid=29237): Launched 13:46:31.199608 bus /sierra_2: Setting Powered False 13:46:32.287007 run create_hlr_db(pid=29237): Terminated: ok {rc=0} 13:46:32.731586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29239): Launched 13:46:33.038626 run osmo-hlr_10.42.42.2(pid=29240): Launched 13:46:33.156815 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:33.684381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29242): Launched 13:46:33.990797 run osmo-stp_10.42.42.5(pid=29243): Launched 13:46:34.107829 run osmo-msc_10.42.42.6: Starting osmo-msc 13:46:34.660119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29245): Launched 13:46:34.967100 run osmo-msc_10.42.42.6(pid=29246): Launched 13:46:35.138834 run osmo-stp_10.42.42.5(pid=29243): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29243)] 13:46:35.267763 run osmo-stp_10.42.42.5(pid=29243): stdout: | (launched: 2022-12-14_13:46:33.934499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:35.397240 run osmo-stp_10.42.42.5(pid=29243): stderr: | 20221214134634107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134634107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134634107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134634107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134634108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134634108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134634108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:35.524200 run osmo-stp_10.42.42.5(pid=29243): stdout: | (launched: 2022-12-14_13:46:33.934499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:35.645944 run osmo-stp_10.42.42.5(pid=29243): stderr: | 20221214134634107 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134634107 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134634107 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134634107 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134634108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134634108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134634108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:35.791673 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29243): Process ended prematurely: osmo-stp_10.42.42.5(pid=29243) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29243)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:46:35.800652 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:46:35.827147 run osmo-hlr_10.42.42.2(pid=29240): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29240)] 13:46:35.874479 run osmo-hlr_10.42.42.2(pid=29240): stdout: | (launched: 2022-12-14_13:46:32.981873) 13:46:35.923920 run osmo-hlr_10.42.42.2(pid=29240): stderr: | 20221214134633162 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134633163 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134633163 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134633163 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134633163 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134633163 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134633175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134633186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134633186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134633186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:35.993803 run osmo-msc_10.42.42.6(pid=29246): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29246)] 13:46:36.041224 run osmo-msc_10.42.42.6(pid=29246): stdout: | (launched: 2022-12-14_13:46:34.910552) 13:46:36.090333 run osmo-msc_10.42.42.6(pid=29246): stderr: | 20221214134635184 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134635184 DLGLOBAL DEBUG validating counter group 0x7fd741aa1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134635184 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134635184 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134635184 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134635185 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134635186 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134635187 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134635187 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134635187 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:46:36.139595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29239): Terminating (SIGTERM) 13:46:36.178987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29242): Terminating (SIGTERM) 13:46:36.218332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29245): Terminating (SIGTERM) 13:46:36.258286 --- ParallelTerminationStrategy: PID 29239 died... 13:46:36.277512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29239): Terminated: ok {rc=0} 13:46:36.321313 --- ParallelTerminationStrategy: PID 29242 died... 13:46:36.340110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29242): Terminated: ok {rc=0} 13:46:36.383870 --- ParallelTerminationStrategy: PID 29245 died... 13:46:36.402570 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29245): Terminated: ok {rc=0} 13:46:36.487636 bus /sierra_3: Setting Powered False 13:46:37.587064 bus /sierra_3: Setting Powered False 13:46:38.700802 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:46:39.845132 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:39.857184 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:46:39.925884 tst mo_mt_call_osmux.py: using LAC 41313 13:46:40.054994 tst mo_mt_call_osmux.py: using RAC 3 13:46:40.189788 tst mo_mt_call_osmux.py: using CellId 41313 13:46:40.318676 tst mo_mt_call_osmux.py: using BVCI 41314 13:46:40.438596 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:40.450713 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:40.462452 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:40.474197 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:40.486270 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:46:40.497993 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:46:40.616722 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:46:40.737424 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:41.247902 run create_hlr_db(pid=29248): Launched 13:46:41.373550 bus /sierra_2: Setting Powered False 13:46:42.439121 run create_hlr_db(pid=29248): Terminated: ok {rc=0} 13:46:42.880044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29250): Launched 13:46:43.211707 run osmo-hlr_10.42.42.2(pid=29251): Launched 13:46:43.337483 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:43.904306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29253): Launched 13:46:44.235539 run osmo-stp_10.42.42.5(pid=29254): Launched 13:46:44.363214 run osmo-msc_10.42.42.6: Starting osmo-msc 13:46:44.962615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29256): Launched 13:46:45.292159 run osmo-msc_10.42.42.6(pid=29257): Launched 13:46:45.475873 run osmo-stp_10.42.42.5(pid=29254): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29254)] 13:46:45.615391 run osmo-stp_10.42.42.5(pid=29254): stdout: | (launched: 2022-12-14_13:46:44.175502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:45.754806 run osmo-stp_10.42.42.5(pid=29254): stderr: | 20221214134644370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134644370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134644371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134644371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134644371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134644372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134644372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:45.900687 run osmo-stp_10.42.42.5(pid=29254): stdout: | (launched: 2022-12-14_13:46:44.175502) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:46.035521 run osmo-stp_10.42.42.5(pid=29254): stderr: | 20221214134644370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134644370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134644371 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134644371 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134644371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134644372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134644372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:46.195760 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29254): Process ended prematurely: osmo-stp_10.42.42.5(pid=29254) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29254)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:46:46.206134 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:46:46.235204 run osmo-hlr_10.42.42.2(pid=29251): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29251)] 13:46:46.290017 run osmo-hlr_10.42.42.2(pid=29251): stdout: | (launched: 2022-12-14_13:46:43.151191) 13:46:46.344076 run osmo-hlr_10.42.42.2(pid=29251): stderr: | 20221214134643354 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134643354 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134643354 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134643354 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134643354 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134643354 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134643366 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134643374 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134643375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134643375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:46.419110 run osmo-msc_10.42.42.6(pid=29257): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29257)] 13:46:46.470460 run osmo-msc_10.42.42.6(pid=29257): stdout: | (launched: 2022-12-14_13:46:45.232128) 13:46:46.525427 run osmo-msc_10.42.42.6(pid=29257): stderr: | 20221214134645555 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134645555 DLGLOBAL DEBUG validating counter group 0x7fa84c619c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134645555 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134645556 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134645556 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134645556 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134645558 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134645558 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134645558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134645559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:46:46.580362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29250): Terminating (SIGTERM) 13:46:46.624245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29253): Terminating (SIGTERM) 13:46:46.670568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29256): Terminating (SIGTERM) 13:46:46.716584 --- ParallelTerminationStrategy: PID 29250 died... 13:46:46.738686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29250): Terminated: ok {rc=0} 13:46:46.788391 --- ParallelTerminationStrategy: PID 29253 died... 13:46:46.809911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29253): Terminated: ok {rc=0} 13:46:46.858277 --- ParallelTerminationStrategy: PID 29256 died... 13:46:46.879903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29256): Terminated: ok {rc=0} 13:46:46.974133 bus /sierra_3: Setting Powered False 13:46:48.071820 bus /sierra_3: Setting Powered False 13:46:49.189755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:46:50.438688 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:46:50.445451 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:46:50.474360 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:46:50.501148 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:46:50.552459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:46:50.581840 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:46:50.608096 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:46:51.161392 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:46:51.210780 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:46:51.222104 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:46:51.287629 tst mo_mt_call.py: using LAC 41314 13:46:51.407896 tst mo_mt_call.py: using RAC 4 13:46:51.530480 tst mo_mt_call.py: using CellId 41314 13:46:51.652110 tst mo_mt_call.py: using BVCI 41315 13:46:51.764606 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:46:51.775820 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:46:51.786876 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:46:51.797912 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:46:51.809044 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:46:51.820053 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:46:51.939415 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:46:52.056904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:46:52.532464 run create_hlr_db(pid=29262): Launched 13:46:52.656521 bus /sierra_2: Setting Powered False 13:46:53.718295 run create_hlr_db(pid=29262): Terminated: ok {rc=0} 13:46:54.166388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29264): Launched 13:46:54.496309 run osmo-hlr_10.42.42.2(pid=29265): Launched 13:46:54.623170 run osmo-stp_10.42.42.5: Starting osmo-stp 13:46:55.188298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29267): Launched 13:46:55.518674 run osmo-stp_10.42.42.5(pid=29268): Launched 13:46:55.639322 run osmo-msc_10.42.42.6: Starting osmo-msc 13:46:56.195576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29270): Launched 13:46:56.503451 run osmo-msc_10.42.42.6(pid=29271): Launched 13:46:56.675707 run osmo-stp_10.42.42.5(pid=29268): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29268)] 13:46:56.806666 run osmo-stp_10.42.42.5(pid=29268): stdout: | (launched: 2022-12-14_13:46:55.458789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:56.936473 run osmo-stp_10.42.42.5(pid=29268): stderr: | 20221214134655636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134655636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134655636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134655636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134655637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134655637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134655637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:57.063943 run osmo-stp_10.42.42.5(pid=29268): stdout: | (launched: 2022-12-14_13:46:55.458789) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:46:57.185936 run osmo-stp_10.42.42.5(pid=29268): stderr: | 20221214134655636 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134655636 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134655636 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134655636 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134655637 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134655637 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134655637 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:46:57.331886 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29268): Process ended prematurely: osmo-stp_10.42.42.5(pid=29268) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29268)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:46:57.340916 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:46:57.367348 run osmo-hlr_10.42.42.2(pid=29265): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29265)] 13:46:57.414496 run osmo-hlr_10.42.42.2(pid=29265): stdout: | (launched: 2022-12-14_13:46:54.436218) 13:46:57.463764 run osmo-hlr_10.42.42.2(pid=29265): stderr: | 20221214134654634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134654634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134654635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134654635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134654635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134654635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134654648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134654656 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134654656 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134654656 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:46:57.532410 run osmo-msc_10.42.42.6(pid=29271): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29271)] 13:46:57.579391 run osmo-msc_10.42.42.6(pid=29271): stdout: | (launched: 2022-12-14_13:46:56.446798) 13:46:57.627968 run osmo-msc_10.42.42.6(pid=29271): stderr: | 20221214134656722 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134656722 DLGLOBAL DEBUG validating counter group 0x7f6a008c8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134656722 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134656722 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134656722 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134656722 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134656724 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134656724 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134656725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134656725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:46:57.677044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29264): Terminating (SIGTERM) 13:46:57.716156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29267): Terminating (SIGTERM) 13:46:57.755163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29270): Terminating (SIGTERM) 13:46:57.794748 --- ParallelTerminationStrategy: PID 29264 died... 13:46:57.813866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29264): Terminated: ok {rc=0} 13:46:57.857399 --- ParallelTerminationStrategy: PID 29267 died... 13:46:57.875921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29267): Terminated: ok {rc=0} 13:46:57.919687 --- ParallelTerminationStrategy: PID 29270 died... 13:46:57.938360 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29270): Terminated: ok {rc=0} 13:46:58.022457 bus /sierra_3: Setting Powered False 13:46:59.120441 bus /sierra_3: Setting Powered False 13:47:00.234479 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:47:01.389661 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:01.403800 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:47:01.474863 tst mo_mt_call_osmux.py: using LAC 41315 13:47:01.612799 tst mo_mt_call_osmux.py: using RAC 5 13:47:01.746271 tst mo_mt_call_osmux.py: using CellId 41315 13:47:01.878533 tst mo_mt_call_osmux.py: using BVCI 41316 13:47:02.033862 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:02.045649 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:02.057121 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:02.069152 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:02.081716 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:47:02.094228 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:02.214359 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:47:02.333519 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:02.810036 run create_hlr_db(pid=29273): Launched 13:47:02.937511 bus /sierra_2: Setting Powered False 13:47:03.999143 run create_hlr_db(pid=29273): Terminated: ok {rc=0} 13:47:04.449950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29275): Launched 13:47:04.780142 run osmo-hlr_10.42.42.2(pid=29276): Launched 13:47:04.905924 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:05.476565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29278): Launched 13:47:05.809339 run osmo-stp_10.42.42.5(pid=29279): Launched 13:47:05.936857 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:06.532020 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29281): Launched 13:47:06.862514 run osmo-msc_10.42.42.6(pid=29282): Launched 13:47:07.046799 run osmo-stp_10.42.42.5(pid=29279): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29279)] 13:47:07.185977 run osmo-stp_10.42.42.5(pid=29279): stdout: | (launched: 2022-12-14_13:47:05.749397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:07.325863 run osmo-stp_10.42.42.5(pid=29279): stderr: | 20221214134705943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134705943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134705944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134705944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134705945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134705945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134705945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:07.464823 run osmo-stp_10.42.42.5(pid=29279): stdout: | (launched: 2022-12-14_13:47:05.749397) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:07.598181 run osmo-stp_10.42.42.5(pid=29279): stderr: | 20221214134705943 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134705943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134705944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134705944 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134705945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134705945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134705945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:07.756210 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29279): Process ended prematurely: osmo-stp_10.42.42.5(pid=29279) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29279)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:47:07.766017 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 13:47:07.794057 run osmo-hlr_10.42.42.2(pid=29276): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29276)] 13:47:07.844687 run osmo-hlr_10.42.42.2(pid=29276): stdout: | (launched: 2022-12-14_13:47:04.720125) 13:47:07.897111 run osmo-hlr_10.42.42.2(pid=29276): stderr: | 20221214134704917 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134704917 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134704917 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134704917 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134704917 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134704917 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134704929 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134704938 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134704938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134704938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:07.969662 run osmo-msc_10.42.42.6(pid=29282): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29282)] 13:47:08.019384 run osmo-msc_10.42.42.6(pid=29282): stdout: | (launched: 2022-12-14_13:47:06.802457) 13:47:08.071212 run osmo-msc_10.42.42.6(pid=29282): stderr: | 20221214134707124 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134707124 DLGLOBAL DEBUG validating counter group 0x7f11e4c1dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134707124 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134707124 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134707124 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134707124 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134707126 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134707126 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134707127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134707127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:08.123657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29275): Terminating (SIGTERM) 13:47:08.165584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29278): Terminating (SIGTERM) 13:47:08.207647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29281): Terminating (SIGTERM) 13:47:08.250622 --- ParallelTerminationStrategy: PID 29275 died... 13:47:08.271230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29275): Terminated: ok {rc=0} 13:47:08.318097 --- ParallelTerminationStrategy: PID 29278 died... 13:47:08.338311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29278): Terminated: ok {rc=0} 13:47:08.384860 --- ParallelTerminationStrategy: PID 29281 died... 13:47:08.405590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29281): Terminated: ok {rc=0} 13:47:08.494088 bus /sierra_3: Setting Powered False 13:47:09.591809 bus /sierra_3: Setting Powered False 13:47:10.707075 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:47:11.956463 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:11.963679 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:47:11.993646 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:47:12.021520 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:47:12.075406 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:47:12.105493 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:47:12.133274 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:47:12.682595 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:47:12.732727 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:12.744272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:47:12.819125 tst mo_mt_call.py: using LAC 41316 13:47:12.946655 tst mo_mt_call.py: using RAC 6 13:47:13.074131 tst mo_mt_call.py: using CellId 41316 13:47:13.205321 tst mo_mt_call.py: using BVCI 41317 13:47:13.325737 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:13.337776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:13.349550 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:13.361235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:13.373229 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:13.385438 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:47:13.505302 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:47:13.625769 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:14.135886 run create_hlr_db(pid=29287): Launched 13:47:14.263019 bus /sierra_2: Setting Powered False 13:47:15.328331 run create_hlr_db(pid=29287): Terminated: ok {rc=0} 13:47:15.769878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29289): Launched 13:47:16.118106 run osmo-hlr_10.42.42.2(pid=29290): Launched 13:47:16.371729 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:17.013762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29292): Launched 13:47:17.360530 run osmo-stp_10.42.42.5(pid=29293): Launched 13:47:17.488077 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:18.089719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29295): Launched 13:47:18.421089 run osmo-msc_10.42.42.6(pid=29296): Launched 13:47:18.607931 run osmo-stp_10.42.42.5(pid=29293): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29293)] 13:47:18.748155 run osmo-stp_10.42.42.5(pid=29293): stdout: | (launched: 2022-12-14_13:47:17.299840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:18.887915 run osmo-stp_10.42.42.5(pid=29293): stderr: | 20221214134717495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134717496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134717496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134717496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134717497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134717497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134717497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:19.026512 run osmo-stp_10.42.42.5(pid=29293): stdout: | (launched: 2022-12-14_13:47:17.299840) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:19.158502 run osmo-stp_10.42.42.5(pid=29293): stderr: | 20221214134717495 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134717496 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134717496 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134717496 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134717497 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134717497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134717497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:19.315962 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29293): Process ended prematurely: osmo-stp_10.42.42.5(pid=29293) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29293)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:47:19.325607 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 13:47:19.353496 run osmo-hlr_10.42.42.2(pid=29290): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29290)] 13:47:19.404458 run osmo-hlr_10.42.42.2(pid=29290): stdout: | (launched: 2022-12-14_13:47:16.054353) 13:47:19.456538 run osmo-hlr_10.42.42.2(pid=29290): stderr: | 20221214134716309 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134716309 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134716309 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134716309 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134716309 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134716309 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134716323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134716339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134716339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134716340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:19.529651 run osmo-msc_10.42.42.6(pid=29296): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29296)] 13:47:19.580155 run osmo-msc_10.42.42.6(pid=29296): stdout: | (launched: 2022-12-14_13:47:18.360581) 13:47:19.632729 run osmo-msc_10.42.42.6(pid=29296): stderr: | 20221214134718685 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134718685 DLGLOBAL DEBUG validating counter group 0x7fa5ac6eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134718685 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134718686 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134718686 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134718686 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134718688 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134718688 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134718688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134718688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:19.685316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29289): Terminating (SIGTERM) 13:47:19.727260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29292): Terminating (SIGTERM) 13:47:19.769459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29295): Terminating (SIGTERM) 13:47:19.812488 --- ParallelTerminationStrategy: PID 29289 died... 13:47:19.833095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29289): Terminated: ok {rc=0} 13:47:19.879966 --- ParallelTerminationStrategy: PID 29292 died... 13:47:19.899894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29292): Terminated: ok {rc=0} 13:47:19.946457 --- ParallelTerminationStrategy: PID 29295 died... 13:47:19.966495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29295): Terminated: ok {rc=0} 13:47:20.054816 bus /sierra_3: Setting Powered False 13:47:21.153280 bus /sierra_3: Setting Powered False 13:47:22.271476 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:47:23.418602 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:23.430819 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:47:23.497360 tst mo_mt_call_osmux.py: using LAC 41317 13:47:23.619865 tst mo_mt_call_osmux.py: using RAC 7 13:47:23.742419 tst mo_mt_call_osmux.py: using CellId 41317 13:47:23.863500 tst mo_mt_call_osmux.py: using BVCI 41318 13:47:23.975761 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:23.987245 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:23.998534 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:24.009708 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:24.021041 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:47:24.032009 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:47:24.147718 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:47:24.263872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:24.740243 run create_hlr_db(pid=29298): Launched 13:47:24.865334 bus /sierra_2: Setting Powered False 13:47:25.926738 run create_hlr_db(pid=29298): Terminated: ok {rc=0} 13:47:26.377385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29300): Launched 13:47:26.709289 run osmo-hlr_10.42.42.2(pid=29301): Launched 13:47:26.836266 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:27.387375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29303): Launched 13:47:27.694936 run osmo-stp_10.42.42.5(pid=29304): Launched 13:47:27.811525 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:28.365549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29306): Launched 13:47:28.672169 run osmo-msc_10.42.42.6(pid=29307): Launched 13:47:28.843739 run osmo-stp_10.42.42.5(pid=29304): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29304)] 13:47:28.972470 run osmo-stp_10.42.42.5(pid=29304): stdout: | (launched: 2022-12-14_13:47:27.638319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:29.101732 run osmo-stp_10.42.42.5(pid=29304): stderr: | 20221214134727813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134727813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134727813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134727814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134727814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134727814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134727815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:29.229421 run osmo-stp_10.42.42.5(pid=29304): stdout: | (launched: 2022-12-14_13:47:27.638319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:29.351554 run osmo-stp_10.42.42.5(pid=29304): stderr: | 20221214134727813 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134727813 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134727813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134727814 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134727814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134727814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134727815 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:29.497995 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29304): Process ended prematurely: osmo-stp_10.42.42.5(pid=29304) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29304)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:47:29.506982 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:47:29.533663 run osmo-hlr_10.42.42.2(pid=29301): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29301)] 13:47:29.581781 run osmo-hlr_10.42.42.2(pid=29301): stdout: | (launched: 2022-12-14_13:47:26.649071) 13:47:29.631202 run osmo-hlr_10.42.42.2(pid=29301): stderr: | 20221214134726846 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134726846 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134726846 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134726846 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134726846 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134726847 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134726858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134726867 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134726867 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134726867 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:29.700724 run osmo-msc_10.42.42.6(pid=29307): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29307)] 13:47:29.749096 run osmo-msc_10.42.42.6(pid=29307): stdout: | (launched: 2022-12-14_13:47:28.615676) 13:47:29.798117 run osmo-msc_10.42.42.6(pid=29307): stderr: | 20221214134728886 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134728886 DLGLOBAL DEBUG validating counter group 0x7f5e2dd9dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134728886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134728886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134728887 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134728887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134728888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134728889 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134728889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134728889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:29.847579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29300): Terminating (SIGTERM) 13:47:29.887191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29303): Terminating (SIGTERM) 13:47:29.926782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29306): Terminating (SIGTERM) 13:47:29.966772 --- ParallelTerminationStrategy: PID 29300 died... 13:47:29.986028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29300): Terminated: ok {rc=0} 13:47:30.030073 --- ParallelTerminationStrategy: PID 29303 died... 13:47:30.049142 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29303): Terminated: ok {rc=0} 13:47:30.093213 --- ParallelTerminationStrategy: PID 29306 died... 13:47:30.112059 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29306): Terminated: ok {rc=0} 13:47:30.197333 bus /sierra_3: Setting Powered False 13:47:31.317773 bus /sierra_3: Setting Powered False 13:47:32.449835 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 13:47:33.695076 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:33.701362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 13:47:33.730069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 13:47:33.757092 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 13:47:33.808852 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 13:47:33.837742 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 13:47:33.864864 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 13:47:34.416339 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 13:47:34.466360 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:34.477714 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:47:34.542823 tst mo_mt_call.py: using LAC 41318 13:47:34.662666 tst mo_mt_call.py: using RAC 8 13:47:34.784331 tst mo_mt_call.py: using CellId 41318 13:47:34.916867 tst mo_mt_call.py: using BVCI 41319 13:47:35.037786 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:35.049651 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:35.061517 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:35.073219 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:35.085261 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:35.096934 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:47:35.213182 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:47:35.332571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:35.843571 run create_hlr_db(pid=29315): Launched 13:47:35.970260 bus /sierra_2: Setting Powered False 13:47:37.035160 run create_hlr_db(pid=29315): Terminated: ok {rc=0} 13:47:37.493337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29317): Launched 13:47:37.823668 run osmo-hlr_10.42.42.2(pid=29318): Launched 13:47:37.949838 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:38.478036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29320): Launched 13:47:38.784604 run osmo-stp_10.42.42.5(pid=29321): Launched 13:47:38.900102 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:39.453571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29323): Launched 13:47:39.760534 run osmo-msc_10.42.42.6(pid=29324): Launched 13:47:39.932322 run osmo-stp_10.42.42.5(pid=29321): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29321)] 13:47:40.061809 run osmo-stp_10.42.42.5(pid=29321): stdout: | (launched: 2022-12-14_13:47:38.728179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:40.191120 run osmo-stp_10.42.42.5(pid=29321): stderr: | 20221214134738900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134738901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134738901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134738901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134738902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134738902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134738902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:40.318319 run osmo-stp_10.42.42.5(pid=29321): stdout: | (launched: 2022-12-14_13:47:38.728179) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:40.440158 run osmo-stp_10.42.42.5(pid=29321): stderr: | 20221214134738900 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134738901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134738901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134738901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134738902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134738902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134738902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:40.586364 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29321): Process ended prematurely: osmo-stp_10.42.42.5(pid=29321) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29321)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 13:47:40.595195 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:47:40.621572 run osmo-hlr_10.42.42.2(pid=29318): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29318)] 13:47:40.669629 run osmo-hlr_10.42.42.2(pid=29318): stdout: | (launched: 2022-12-14_13:47:37.763004) 13:47:40.718544 run osmo-hlr_10.42.42.2(pid=29318): stderr: | 20221214134737964 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134737964 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134737964 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134737964 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134737964 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134737964 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134737977 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134737985 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134737985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134737985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:40.787046 run osmo-msc_10.42.42.6(pid=29324): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29324)] 13:47:40.834204 run osmo-msc_10.42.42.6(pid=29324): stdout: | (launched: 2022-12-14_13:47:39.703938) 13:47:40.883013 run osmo-msc_10.42.42.6(pid=29324): stderr: | 20221214134739979 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134739979 DLGLOBAL DEBUG validating counter group 0x7fc518275c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134739979 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134739979 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134739979 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134739979 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134739983 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134739983 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134739983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134739983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:40.932076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29317): Terminating (SIGTERM) 13:47:40.971960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29320): Terminating (SIGTERM) 13:47:41.011678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29323): Terminating (SIGTERM) 13:47:41.051473 --- ParallelTerminationStrategy: PID 29317 died... 13:47:41.070165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29317): Terminated: ok {rc=0} 13:47:41.113818 --- ParallelTerminationStrategy: PID 29320 died... 13:47:41.132228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29320): Terminated: ok {rc=0} 13:47:41.176058 --- ParallelTerminationStrategy: PID 29323 died... 13:47:41.194656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29323): Terminated: ok {rc=0} 13:47:41.277379 bus /sierra_3: Setting Powered False 13:47:42.373278 bus /sierra_3: Setting Powered False 13:47:43.484165 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 13:47:44.633907 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:44.646465 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 13:47:44.713412 tst mo_mt_call_osmux.py: using LAC 41319 13:47:44.843369 tst mo_mt_call_osmux.py: using RAC 9 13:47:44.971885 tst mo_mt_call_osmux.py: using CellId 41319 13:47:45.100696 tst mo_mt_call_osmux.py: using BVCI 41320 13:47:45.213433 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:45.224810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:45.236003 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:45.247145 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:45.258398 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 13:47:45.269573 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:47:45.390247 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 13:47:45.508184 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:46.036408 run create_hlr_db(pid=29326): Launched 13:47:46.200705 bus /sierra_2: Setting Powered False 13:47:47.273691 run create_hlr_db(pid=29326): Terminated: ok {rc=0} 13:47:47.717722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29328): Launched 13:47:48.026087 run osmo-hlr_10.42.42.2(pid=29329): Launched 13:47:48.142440 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:48.674651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29331): Launched 13:47:48.982349 run osmo-stp_10.42.42.5(pid=29332): Launched 13:47:49.100644 run osmo-msc_10.42.42.6: Starting osmo-msc 13:47:49.654287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29334): Launched 13:47:49.963590 run osmo-msc_10.42.42.6(pid=29335): Launched 13:47:50.134869 run osmo-stp_10.42.42.5(pid=29332): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29332)] 13:47:50.264097 run osmo-stp_10.42.42.5(pid=29332): stdout: | (launched: 2022-12-14_13:47:48.925370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:50.393682 run osmo-stp_10.42.42.5(pid=29332): stderr: | 20221214134749097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134749098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134749098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134749098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134749099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134749099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134749099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:50.521490 run osmo-stp_10.42.42.5(pid=29332): stdout: | (launched: 2022-12-14_13:47:48.925370) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:47:50.643835 run osmo-stp_10.42.42.5(pid=29332): stderr: | 20221214134749097 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134749098 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134749098 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134749098 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134749099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134749099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134749099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:47:50.790145 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29332): Process ended prematurely: osmo-stp_10.42.42.5(pid=29332) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29332)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 13:47:50.799024 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:47:50.825706 run osmo-hlr_10.42.42.2(pid=29329): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29329)] 13:47:50.873509 run osmo-hlr_10.42.42.2(pid=29329): stdout: | (launched: 2022-12-14_13:47:47.969064) 13:47:50.923038 run osmo-hlr_10.42.42.2(pid=29329): stderr: | 20221214134748148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134748149 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134748149 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134748149 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134748149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134748149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134748161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134748171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134748171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134748172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:47:50.992621 run osmo-msc_10.42.42.6(pid=29335): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29335)] 13:47:51.040475 run osmo-msc_10.42.42.6(pid=29335): stdout: | (launched: 2022-12-14_13:47:49.906928) 13:47:51.089831 run osmo-msc_10.42.42.6(pid=29335): stderr: | 20221214134750179 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134750179 DLGLOBAL DEBUG validating counter group 0x7f15d7465c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134750179 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134750179 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134750179 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134750179 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134750181 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134750182 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134750182 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134750182 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:47:51.139714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29328): Terminating (SIGTERM) 13:47:51.179375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29331): Terminating (SIGTERM) 13:47:51.219113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29334): Terminating (SIGTERM) 13:47:51.259272 --- ParallelTerminationStrategy: PID 29328 died... 13:47:51.278573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29328): Terminated: ok {rc=0} 13:47:51.322831 --- ParallelTerminationStrategy: PID 29331 died... 13:47:51.341748 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29331): Terminated: ok {rc=0} 13:47:51.385784 --- ParallelTerminationStrategy: PID 29334 died... 13:47:51.404537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29334): Terminated: ok {rc=0} 13:47:51.490807 bus /sierra_3: Setting Powered False 13:47:52.592321 bus /sierra_3: Setting Powered False 13:47:53.712282 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:47:54.957448 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:47:54.964038 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:47:54.992742 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:47:55.019204 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:47:55.071439 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:47:55.100170 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:47:55.126735 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:47:55.682689 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:47:55.732936 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:47:55.744343 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:47:55.809515 tst mo_mt_call.py: using LAC 41320 13:47:55.929469 tst mo_mt_call.py: using RAC 10 13:47:56.060083 tst mo_mt_call.py: using CellId 41320 13:47:56.188527 tst mo_mt_call.py: using BVCI 41321 13:47:56.309629 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:47:56.321566 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:47:56.333273 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:47:56.344908 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:47:56.357618 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:47:56.369755 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:47:56.486546 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:47:56.603273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:47:57.113828 run create_hlr_db(pid=29340): Launched 13:47:57.240202 bus /sierra_2: Setting Powered False 13:47:58.305504 run create_hlr_db(pid=29340): Terminated: ok {rc=0} 13:47:58.744805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29342): Launched 13:47:59.051516 run osmo-hlr_10.42.42.2(pid=29343): Launched 13:47:59.168230 run osmo-stp_10.42.42.5: Starting osmo-stp 13:47:59.699572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29345): Launched 13:48:00.006515 run osmo-stp_10.42.42.5(pid=29346): Launched 13:48:00.123268 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:00.675163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29348): Launched 13:48:01.017713 run osmo-msc_10.42.42.6(pid=29349): Launched 13:48:01.455363 run osmo-stp_10.42.42.5(pid=29346): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29346)] 13:48:01.794612 run osmo-stp_10.42.42.5(pid=29346): stdout: | (launched: 2022-12-14_13:47:59.949651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:02.154147 run osmo-stp_10.42.42.5(pid=29346): stderr: | 20221214134800120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134800120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134800120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134800121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134800121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134800121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134800121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:02.329907 run osmo-stp_10.42.42.5(pid=29346): stdout: | (launched: 2022-12-14_13:47:59.949651) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:02.466740 run osmo-stp_10.42.42.5(pid=29346): stderr: | 20221214134800120 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134800120 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134800120 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134800121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134800121 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134800121 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134800121 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:02.627148 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29346): Process ended prematurely: osmo-stp_10.42.42.5(pid=29346) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29346)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:48:02.637057 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 13:48:02.665500 run osmo-hlr_10.42.42.2(pid=29343): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29343)] 13:48:02.717125 run osmo-hlr_10.42.42.2(pid=29343): stdout: | (launched: 2022-12-14_13:47:58.995391) 13:48:02.769063 run osmo-hlr_10.42.42.2(pid=29343): stderr: | 20221214134759172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134759173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134759173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134759173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134759173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134759173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134759185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134759194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134759194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134759194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:02.841511 run osmo-msc_10.42.42.6(pid=29349): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29349)] 13:48:02.891536 run osmo-msc_10.42.42.6(pid=29349): stdout: | (launched: 2022-12-14_13:48:00.957299) 13:48:02.943213 run osmo-msc_10.42.42.6(pid=29349): stderr: | 20221214134801761 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134801761 DLGLOBAL DEBUG validating counter group 0x7fddf0684c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134801761 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134801761 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134801762 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134801762 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134801763 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134801764 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134801764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134801764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:02.995398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29342): Terminating (SIGTERM) 13:48:03.036918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29345): Terminating (SIGTERM) 13:48:03.078621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29348): Terminating (SIGTERM) 13:48:03.120787 --- ParallelTerminationStrategy: PID 29342 died... 13:48:03.140596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29342): Terminated: ok {rc=0} 13:48:03.187632 --- ParallelTerminationStrategy: PID 29345 died... 13:48:03.207315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29345): Terminated: ok {rc=0} 13:48:03.253617 --- ParallelTerminationStrategy: PID 29348 died... 13:48:03.273436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29348): Terminated: ok {rc=0} 13:48:03.361771 bus /sierra_3: Setting Powered False 13:48:04.457616 bus /sierra_3: Setting Powered False 13:48:05.571366 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:48:06.716299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:06.728202 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:48:06.793933 tst mo_mt_call_osmux.py: using LAC 41321 13:48:06.916287 tst mo_mt_call_osmux.py: using RAC 11 13:48:07.036724 tst mo_mt_call_osmux.py: using CellId 41321 13:48:07.157394 tst mo_mt_call_osmux.py: using BVCI 41322 13:48:07.268397 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:07.279813 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:07.291016 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:07.302085 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:07.313255 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:48:07.324313 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:07.443802 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:48:07.562609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:08.040458 run create_hlr_db(pid=29351): Launched 13:48:08.167372 bus /sierra_2: Setting Powered False 13:48:09.228449 run create_hlr_db(pid=29351): Terminated: ok {rc=0} 13:48:09.655865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29353): Launched 13:48:09.963505 run osmo-hlr_10.42.42.2(pid=29354): Launched 13:48:10.080543 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:10.621686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29356): Launched 13:48:10.927872 run osmo-stp_10.42.42.5(pid=29357): Launched 13:48:11.044428 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:11.598464 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29359): Launched 13:48:11.907858 run osmo-msc_10.42.42.6(pid=29360): Launched 13:48:12.080171 run osmo-stp_10.42.42.5(pid=29357): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29357)] 13:48:12.209221 run osmo-stp_10.42.42.5(pid=29357): stdout: | (launched: 2022-12-14_13:48:10.871413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:12.338658 run osmo-stp_10.42.42.5(pid=29357): stderr: | 20221214134811047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134811047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134811048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134811048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134811049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134811049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134811049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:12.466094 run osmo-stp_10.42.42.5(pid=29357): stdout: | (launched: 2022-12-14_13:48:10.871413) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:12.588124 run osmo-stp_10.42.42.5(pid=29357): stderr: | 20221214134811047 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134811047 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134811048 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134811048 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134811049 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134811049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134811049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:12.734537 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29357): Process ended prematurely: osmo-stp_10.42.42.5(pid=29357) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29357)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:48:12.743406 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 13:48:12.769910 run osmo-hlr_10.42.42.2(pid=29354): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29354)] 13:48:12.817784 run osmo-hlr_10.42.42.2(pid=29354): stdout: | (launched: 2022-12-14_13:48:09.906127) 13:48:12.867008 run osmo-hlr_10.42.42.2(pid=29354): stderr: | 20221214134810086 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134810086 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134810086 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134810086 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134810086 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134810086 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134810098 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134810107 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134810107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134810108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:12.935576 run osmo-msc_10.42.42.6(pid=29360): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29360)] 13:48:12.982979 run osmo-msc_10.42.42.6(pid=29360): stdout: | (launched: 2022-12-14_13:48:11.850771) 13:48:13.031781 run osmo-msc_10.42.42.6(pid=29360): stderr: | 20221214134812125 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134812125 DLGLOBAL DEBUG validating counter group 0x7f569ee4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134812126 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134812126 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134812126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134812126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134812128 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134812128 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134812128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134812128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:13.081312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29353): Terminating (SIGTERM) 13:48:13.120884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29356): Terminating (SIGTERM) 13:48:13.160439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29359): Terminating (SIGTERM) 13:48:13.200383 --- ParallelTerminationStrategy: PID 29353 died... 13:48:13.219638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29353): Terminated: ok {rc=0} 13:48:13.263639 --- ParallelTerminationStrategy: PID 29356 died... 13:48:13.282365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29356): Terminated: ok {rc=0} 13:48:13.325776 --- ParallelTerminationStrategy: PID 29359 died... 13:48:13.344526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29359): Terminated: ok {rc=0} 13:48:13.430187 bus /sierra_3: Setting Powered False 13:48:14.528920 bus /sierra_3: Setting Powered False 13:48:15.644630 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:48:16.909273 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:16.917181 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:48:16.952485 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:48:16.981723 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:48:17.038847 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:48:17.072043 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:48:17.100851 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:48:17.647320 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:48:17.696365 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:17.707971 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:48:17.773402 tst mo_mt_call.py: using LAC 41322 13:48:17.895750 tst mo_mt_call.py: using RAC 12 13:48:18.014758 tst mo_mt_call.py: using CellId 41322 13:48:18.148311 tst mo_mt_call.py: using BVCI 41323 13:48:18.260867 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:18.272424 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:18.283670 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:18.295029 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:18.306209 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:18.317583 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:18.438682 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:18.556342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:19.031441 run create_hlr_db(pid=29365): Launched 13:48:19.157099 bus /sierra_2: Setting Powered False 13:48:20.218940 run create_hlr_db(pid=29365): Terminated: ok {rc=0} 13:48:20.646352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29367): Launched 13:48:20.954596 run osmo-hlr_10.42.42.2(pid=29368): Launched 13:48:21.071352 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:21.615076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29370): Launched 13:48:21.924145 run osmo-stp_10.42.42.5(pid=29371): Launched 13:48:22.040493 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:22.596822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29373): Launched 13:48:22.903720 run osmo-msc_10.42.42.6(pid=29374): Launched 13:48:23.074927 run osmo-stp_10.42.42.5(pid=29371): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29371)] 13:48:23.204192 run osmo-stp_10.42.42.5(pid=29371): stdout: | (launched: 2022-12-14_13:48:21.867509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:23.333395 run osmo-stp_10.42.42.5(pid=29371): stderr: | 20221214134822041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134822042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134822042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134822042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134822043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134822043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134822043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:23.460759 run osmo-stp_10.42.42.5(pid=29371): stdout: | (launched: 2022-12-14_13:48:21.867509) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:23.583168 run osmo-stp_10.42.42.5(pid=29371): stderr: | 20221214134822041 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134822042 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134822042 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134822042 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134822043 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134822043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134822043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:23.729674 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29371): Process ended prematurely: osmo-stp_10.42.42.5(pid=29371) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29371)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:48:23.738616 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:48:23.765243 run osmo-hlr_10.42.42.2(pid=29368): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29368)] 13:48:23.812867 run osmo-hlr_10.42.42.2(pid=29368): stdout: | (launched: 2022-12-14_13:48:20.896381) 13:48:23.862284 run osmo-hlr_10.42.42.2(pid=29368): stderr: | 20221214134821073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134821073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134821073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134821073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134821073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134821073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134821086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134821094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134821094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134821094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:23.930962 run osmo-msc_10.42.42.6(pid=29374): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29374)] 13:48:23.978381 run osmo-msc_10.42.42.6(pid=29374): stdout: | (launched: 2022-12-14_13:48:22.847200) 13:48:24.027450 run osmo-msc_10.42.42.6(pid=29374): stderr: | 20221214134823119 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134823119 DLGLOBAL DEBUG validating counter group 0x7fe93ced7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134823119 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134823119 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134823120 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134823120 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134823122 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134823122 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134823122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134823122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:24.076904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29367): Terminating (SIGTERM) 13:48:24.116088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29370): Terminating (SIGTERM) 13:48:24.155773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29373): Terminating (SIGTERM) 13:48:24.195647 --- ParallelTerminationStrategy: PID 29367 died... 13:48:24.214891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29367): Terminated: ok {rc=0} 13:48:24.258592 --- ParallelTerminationStrategy: PID 29370 died... 13:48:24.277308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29370): Terminated: ok {rc=0} 13:48:24.321076 --- ParallelTerminationStrategy: PID 29373 died... 13:48:24.339836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29373): Terminated: ok {rc=0} 13:48:24.424447 bus /sierra_3: Setting Powered False 13:48:25.524085 bus /sierra_3: Setting Powered False 13:48:26.637614 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:48:27.787131 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:27.799904 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:48:27.868706 tst mo_mt_call_osmux.py: using LAC 41323 13:48:27.998682 tst mo_mt_call_osmux.py: using RAC 13 13:48:28.129047 tst mo_mt_call_osmux.py: using CellId 41323 13:48:28.258650 tst mo_mt_call_osmux.py: using BVCI 41324 13:48:28.378741 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:28.390634 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:28.402349 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:28.413975 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:28.425966 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:48:28.437921 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:28.558825 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:48:28.680019 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:29.190452 run create_hlr_db(pid=29376): Launched 13:48:29.318135 bus /sierra_2: Setting Powered False 13:48:30.383036 run create_hlr_db(pid=29376): Terminated: ok {rc=0} 13:48:30.824275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29378): Launched 13:48:31.197709 run osmo-hlr_10.42.42.2(pid=29379): Launched 13:48:31.397077 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:32.085714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29381): Launched 13:48:32.439858 run osmo-stp_10.42.42.5(pid=29382): Launched 13:48:32.558832 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:33.114584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29384): Launched 13:48:33.423168 run osmo-msc_10.42.42.6(pid=29385): Launched 13:48:33.595081 run osmo-stp_10.42.42.5(pid=29382): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29382)] 13:48:33.727381 run osmo-stp_10.42.42.5(pid=29382): stdout: | (launched: 2022-12-14_13:48:32.383190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:33.857293 run osmo-stp_10.42.42.5(pid=29382): stderr: | 20221214134832554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134832554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134832554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134832555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134832557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134832557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134832558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:33.985394 run osmo-stp_10.42.42.5(pid=29382): stdout: | (launched: 2022-12-14_13:48:32.383190) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:34.107862 run osmo-stp_10.42.42.5(pid=29382): stderr: | 20221214134832554 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134832554 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134832554 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134832555 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134832557 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134832557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134832558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:34.254691 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29382): Process ended prematurely: osmo-stp_10.42.42.5(pid=29382) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29382)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:48:34.263952 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 13:48:34.290708 run osmo-hlr_10.42.42.2(pid=29379): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29379)] 13:48:34.338297 run osmo-hlr_10.42.42.2(pid=29379): stdout: | (launched: 2022-12-14_13:48:31.131294) 13:48:34.388118 run osmo-hlr_10.42.42.2(pid=29379): stderr: | 20221214134831488 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134831488 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134831488 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134831488 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134831488 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134831488 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134831507 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134831515 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134831515 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134831515 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:34.457198 run osmo-msc_10.42.42.6(pid=29385): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29385)] 13:48:34.504425 run osmo-msc_10.42.42.6(pid=29385): stdout: | (launched: 2022-12-14_13:48:33.366162) 13:48:34.553568 run osmo-msc_10.42.42.6(pid=29385): stderr: | 20221214134833639 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134833639 DLGLOBAL DEBUG validating counter group 0x7fd02677fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134833639 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134833640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134833640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134833640 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134833642 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134833642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134833642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134833642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:34.602850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29378): Terminating (SIGTERM) 13:48:34.642442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29381): Terminating (SIGTERM) 13:48:34.681821 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29384): Terminating (SIGTERM) 13:48:34.721659 --- ParallelTerminationStrategy: PID 29378 died... 13:48:34.740268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29378): Terminated: ok {rc=0} 13:48:34.784837 --- ParallelTerminationStrategy: PID 29381 died... 13:48:34.804161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29381): Terminated: ok {rc=0} 13:48:34.847905 --- ParallelTerminationStrategy: PID 29384 died... 13:48:34.866644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29384): Terminated: ok {rc=0} 13:48:34.949781 bus /sierra_3: Setting Powered False 13:48:36.045576 bus /sierra_3: Setting Powered False 13:48:37.161937 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:48:38.416395 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:38.422157 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:48:38.450602 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 13:48:38.477055 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 13:48:38.529114 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:48:38.559071 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 13:48:38.586645 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 13:48:39.138453 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 13:48:39.192160 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:39.204002 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:48:39.273770 tst mo_mt_call.py: using LAC 41324 13:48:39.402459 tst mo_mt_call.py: using RAC 14 13:48:39.530851 tst mo_mt_call.py: using CellId 41324 13:48:39.661088 tst mo_mt_call.py: using BVCI 41325 13:48:39.782064 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:39.793911 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:39.805452 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:39.816913 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:39.829087 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:39.840822 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:48:39.956696 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:48:40.072891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:40.552326 run create_hlr_db(pid=29390): Launched 13:48:40.678645 bus /sierra_2: Setting Powered False 13:48:41.740933 run create_hlr_db(pid=29390): Terminated: ok {rc=0} 13:48:42.191066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29392): Launched 13:48:42.523010 run osmo-hlr_10.42.42.2(pid=29393): Launched 13:48:42.649885 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:43.220213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29395): Launched 13:48:43.550752 run osmo-stp_10.42.42.5(pid=29396): Launched 13:48:43.678051 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:44.272740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29398): Launched 13:48:44.603978 run osmo-msc_10.42.42.6(pid=29399): Launched 13:48:44.790669 run osmo-stp_10.42.42.5(pid=29396): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29396)] 13:48:44.930003 run osmo-stp_10.42.42.5(pid=29396): stdout: | (launched: 2022-12-14_13:48:43.490609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:45.070022 run osmo-stp_10.42.42.5(pid=29396): stderr: | 20221214134843684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134843684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134843684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134843685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134843685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134843685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134843685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:45.202130 run osmo-stp_10.42.42.5(pid=29396): stdout: | (launched: 2022-12-14_13:48:43.490609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:45.325197 run osmo-stp_10.42.42.5(pid=29396): stderr: | 20221214134843684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134843684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134843684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134843685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134843685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134843685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134843685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:45.472450 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29396): Process ended prematurely: osmo-stp_10.42.42.5(pid=29396) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29396)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 13:48:45.481637 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:48:45.508555 run osmo-hlr_10.42.42.2(pid=29393): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29393)] 13:48:45.556853 run osmo-hlr_10.42.42.2(pid=29393): stdout: | (launched: 2022-12-14_13:48:42.462445) 13:48:45.606936 run osmo-hlr_10.42.42.2(pid=29393): stderr: | 20221214134842664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134842664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134842664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134842664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134842664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134842664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134842676 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134842684 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134842684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134842685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:45.676846 run osmo-msc_10.42.42.6(pid=29399): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29399)] 13:48:45.725538 run osmo-msc_10.42.42.6(pid=29399): stdout: | (launched: 2022-12-14_13:48:44.543586) 13:48:45.775708 run osmo-msc_10.42.42.6(pid=29399): stderr: | 20221214134844865 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134844865 DLGLOBAL DEBUG validating counter group 0x7f4f7468fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134844866 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134844866 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134844866 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134844866 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134844869 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134844870 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134844870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134844870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:45.826220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29392): Terminating (SIGTERM) 13:48:45.886117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29395): Terminating (SIGTERM) 13:48:45.930279 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29398): Terminating (SIGTERM) 13:48:45.976348 --- ParallelTerminationStrategy: PID 29392 died... 13:48:45.998122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29392): Terminated: ok {rc=0} 13:48:46.049142 --- ParallelTerminationStrategy: PID 29395 died... 13:48:46.070136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29395): Terminated: ok {rc=0} 13:48:46.120744 --- ParallelTerminationStrategy: PID 29398 died... 13:48:46.141748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29398): Terminated: ok {rc=0} 13:48:46.234642 bus /sierra_3: Setting Powered False 13:48:47.335158 bus /sierra_3: Setting Powered False 13:48:48.451017 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 13:48:49.603422 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:49.615978 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:48:49.685590 tst mo_mt_call_osmux.py: using LAC 41325 13:48:49.815646 tst mo_mt_call_osmux.py: using RAC 15 13:48:49.944030 tst mo_mt_call_osmux.py: using CellId 41325 13:48:50.073280 tst mo_mt_call_osmux.py: using BVCI 41326 13:48:50.193517 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:50.205509 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:50.217236 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:50.228758 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:50.241057 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 13:48:50.252877 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:48:50.369991 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 13:48:50.491481 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:48:51.001997 run create_hlr_db(pid=29401): Launched 13:48:51.129723 bus /sierra_2: Setting Powered False 13:48:52.194885 run create_hlr_db(pid=29401): Terminated: ok {rc=0} 13:48:52.635268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29403): Launched 13:48:52.945917 run osmo-hlr_10.42.42.2(pid=29404): Launched 13:48:53.063329 run osmo-stp_10.42.42.5: Starting osmo-stp 13:48:53.590448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29406): Launched 13:48:53.898376 run osmo-stp_10.42.42.5(pid=29407): Launched 13:48:54.015554 run osmo-msc_10.42.42.6: Starting osmo-msc 13:48:54.570215 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29409): Launched 13:48:54.877331 run osmo-msc_10.42.42.6(pid=29410): Launched 13:48:55.049239 run osmo-stp_10.42.42.5(pid=29407): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29407)] 13:48:55.178820 run osmo-stp_10.42.42.5(pid=29407): stdout: | (launched: 2022-12-14_13:48:53.841897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:55.308907 run osmo-stp_10.42.42.5(pid=29407): stderr: | 20221214134854014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134854014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134854014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134854015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134854015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134854015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134854015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:55.436580 run osmo-stp_10.42.42.5(pid=29407): stdout: | (launched: 2022-12-14_13:48:53.841897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:48:55.558694 run osmo-stp_10.42.42.5(pid=29407): stderr: | 20221214134854014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134854014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134854014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134854015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134854015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134854015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134854015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:48:55.704775 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29407): Process ended prematurely: osmo-stp_10.42.42.5(pid=29407) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29407)] [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 13:48:55.713878 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:48:55.740156 run osmo-hlr_10.42.42.2(pid=29404): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29404)] 13:48:55.787545 run osmo-hlr_10.42.42.2(pid=29404): stdout: | (launched: 2022-12-14_13:48:52.888841) 13:48:55.836727 run osmo-hlr_10.42.42.2(pid=29404): stderr: | 20221214134853066 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134853066 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134853066 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134853066 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134853066 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134853066 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134853099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134853108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134853109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134853109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:48:55.905662 run osmo-msc_10.42.42.6(pid=29410): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29410)] 13:48:55.952915 run osmo-msc_10.42.42.6(pid=29410): stdout: | (launched: 2022-12-14_13:48:54.820677) 13:48:56.001975 run osmo-msc_10.42.42.6(pid=29410): stderr: | 20221214134855095 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134855095 DLGLOBAL DEBUG validating counter group 0x7f3e31e5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134855095 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134855095 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134855095 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134855095 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134855097 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134855098 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134855098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134855098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:48:56.051057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29403): Terminating (SIGTERM) 13:48:56.090203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29406): Terminating (SIGTERM) 13:48:56.129619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29409): Terminating (SIGTERM) 13:48:56.169532 --- ParallelTerminationStrategy: PID 29403 died... 13:48:56.188679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29403): Terminated: ok {rc=0} 13:48:56.232753 --- ParallelTerminationStrategy: PID 29406 died... 13:48:56.251630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29406): Terminated: ok {rc=0} 13:48:56.295414 --- ParallelTerminationStrategy: PID 29409 died... 13:48:56.314261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29409): Terminated: ok {rc=0} 13:48:56.399581 bus /sierra_3: Setting Powered False 13:48:57.499783 bus /sierra_3: Setting Powered False 13:48:58.614910 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 13:48:59.856801 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:48:59.861280 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:48:59.889938 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 13:48:59.916756 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 13:49:00.003256 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:49:00.033894 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 13:49:00.061089 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 13:49:00.643092 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2405 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 13:49:00.649131 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:00.661228 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:49:00.706270 tst emergency_mo_mt_call.py: using LAC 41326 13:49:00.831536 tst emergency_mo_mt_call.py: using RAC 16 13:49:00.966668 tst emergency_mo_mt_call.py: using CellId 41326 13:49:01.106557 tst emergency_mo_mt_call.py: using BVCI 41327 13:49:01.219176 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:01.230346 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:01.241176 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:01.252848 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:01.264530 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:01.275588 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:01.421305 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:01.545047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:02.062062 run create_hlr_db(pid=29416): Launched 13:49:02.224602 bus /sierra_2: Setting Powered False 13:49:03.288760 run create_hlr_db(pid=29416): Terminated: ok {rc=0} 13:49:03.720557 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29418): Launched 13:49:04.022878 run osmo-hlr_10.42.42.2(pid=29419): Launched 13:49:04.139670 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:04.662859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29421): Launched 13:49:04.965633 run osmo-stp_10.42.42.5(pid=29422): Launched 13:49:05.089647 tst emergency_mo_mt_call.py: using MSISDN 8712 13:49:05.259046 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:05.803886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29424): Launched 13:49:06.106643 run osmo-msc_10.42.42.6(pid=29425): Launched 13:49:06.276745 run osmo-stp_10.42.42.5(pid=29422): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29422)] 13:49:06.403989 run osmo-stp_10.42.42.5(pid=29422): stdout: | (launched: 2022-12-14_13:49:04.909428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:06.531544 run osmo-stp_10.42.42.5(pid=29422): stderr: | 20221214134905081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134905081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134905081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134905082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134905083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134905083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134905083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:06.656274 run osmo-stp_10.42.42.5(pid=29422): stdout: | (launched: 2022-12-14_13:49:04.909428) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:06.775428 run osmo-stp_10.42.42.5(pid=29422): stderr: | 20221214134905081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134905081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134905081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134905082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134905083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134905083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134905083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:06.918374 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=29422): Process ended prematurely: osmo-stp_10.42.42.5(pid=29422) [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29422)] [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 13:49:06.926480 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 13:49:06.952471 run osmo-hlr_10.42.42.2(pid=29419): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29419)] 13:49:06.999853 run osmo-hlr_10.42.42.2(pid=29419): stdout: | (launched: 2022-12-14_13:49:03.966691) 13:49:07.049218 run osmo-hlr_10.42.42.2(pid=29419): stderr: | 20221214134904141 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134904142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134904142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134904142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134904142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134904142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134904154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134904162 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134904162 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134904162 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:07.117462 run osmo-msc_10.42.42.6(pid=29425): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29425)] 13:49:07.164622 run osmo-msc_10.42.42.6(pid=29425): stdout: | (launched: 2022-12-14_13:49:06.050370) 13:49:07.213277 run osmo-msc_10.42.42.6(pid=29425): stderr: | 20221214134906324 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134906324 DLGLOBAL DEBUG validating counter group 0x7feb668e1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134906324 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134906324 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134906324 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134906325 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134906326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134906327 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134906327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134906327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:07.262324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29418): Terminating (SIGTERM) 13:49:07.301399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29421): Terminating (SIGTERM) 13:49:07.340638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29424): Terminating (SIGTERM) 13:49:07.380656 --- ParallelTerminationStrategy: PID 29418 died... 13:49:07.399744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29418): Terminated: ok {rc=0} 13:49:07.443378 --- ParallelTerminationStrategy: PID 29421 died... 13:49:07.461889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29421): Terminated: ok {rc=0} 13:49:07.505304 --- ParallelTerminationStrategy: PID 29424 died... 13:49:07.523756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29424): Terminated: ok {rc=0} 13:49:07.607765 bus /sierra_3: Setting Powered False 13:49:08.705125 bus /sierra_3: Setting Powered False 13:49:09.819114 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 13:49:10.907784 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:10.920038 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:49:10.969218 tst emergency_preemptive_call.py: using LAC 41327 13:49:11.096918 tst emergency_preemptive_call.py: using RAC 17 13:49:11.223989 tst emergency_preemptive_call.py: using CellId 41327 13:49:11.349236 tst emergency_preemptive_call.py: using BVCI 41328 13:49:11.460417 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:11.471574 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:11.482267 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:11.493133 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:11.504786 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 13:49:11.516253 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:11.639028 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:11.755557 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:11.875410 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:11.994478 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:12.498966 run create_hlr_db(pid=29427): Launched 13:49:12.625812 bus /sierra_2: Setting Powered False 13:49:13.690548 run create_hlr_db(pid=29427): Terminated: ok {rc=0} 13:49:14.123692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29429): Launched 13:49:14.426562 run osmo-hlr_10.42.42.2(pid=29430): Launched 13:49:14.541956 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:15.063538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29432): Launched 13:49:15.365102 run osmo-stp_10.42.42.5(pid=29433): Launched 13:49:15.489456 tst emergency_preemptive_call.py: using MSISDN 8713 13:49:15.645140 run osmo-msc_10.42.42.6: Starting osmo-msc 13:49:16.235218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29435): Launched 13:49:16.578510 run osmo-msc_10.42.42.6(pid=29436): Launched 13:49:16.877468 run osmo-stp_10.42.42.5(pid=29433): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29433)] 13:49:17.110393 run osmo-stp_10.42.42.5(pid=29433): stdout: | (launched: 2022-12-14_13:49:15.308847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:17.310138 run osmo-stp_10.42.42.5(pid=29433): stderr: | 20221214134915483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134915483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134915483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134915483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134915484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134915484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134915484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:17.435606 run osmo-stp_10.42.42.5(pid=29433): stdout: | (launched: 2022-12-14_13:49:15.308847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:17.555762 run osmo-stp_10.42.42.5(pid=29433): stderr: | 20221214134915483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134915483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134915483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134915483 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134915484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134915484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134915484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:17.699543 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=29433): Process ended prematurely: osmo-stp_10.42.42.5(pid=29433) [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29433)] [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 13:49:17.707949 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 13:49:17.734188 run osmo-hlr_10.42.42.2(pid=29430): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29430)] 13:49:17.781831 run osmo-hlr_10.42.42.2(pid=29430): stdout: | (launched: 2022-12-14_13:49:14.370589) 13:49:17.831674 run osmo-hlr_10.42.42.2(pid=29430): stderr: | 20221214134914546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134914546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134914546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134914546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134914546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134914546 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134914559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134914569 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134914570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134914570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:17.900990 run osmo-msc_10.42.42.6(pid=29436): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29436)] 13:49:17.948576 run osmo-msc_10.42.42.6(pid=29436): stdout: | (launched: 2022-12-14_13:49:16.517700) 13:49:17.997827 run osmo-msc_10.42.42.6(pid=29436): stderr: | 20221214134916997 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214134916997 DLGLOBAL DEBUG validating counter group 0x7f983d826c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214134916997 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214134916997 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214134916998 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214134916998 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214134916999 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214134917000 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214134917000 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214134917000 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:49:18.047525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29429): Terminating (SIGTERM) 13:49:18.087032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29432): Terminating (SIGTERM) 13:49:18.126984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29435): Terminating (SIGTERM) 13:49:18.166852 --- ParallelTerminationStrategy: PID 29429 died... 13:49:18.185935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29429): Terminated: ok {rc=0} 13:49:18.229939 --- ParallelTerminationStrategy: PID 29432 died... 13:49:18.248548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29432): Terminated: ok {rc=0} 13:49:18.292110 --- ParallelTerminationStrategy: PID 29435 died... 13:49:18.310733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29435): Terminated: ok {rc=0} 13:49:18.396254 bus /sierra_9: Setting Powered False 13:49:19.493470 bus /sierra_9: Setting Powered False 13:49:20.607413 bus /sierra_8: Setting Powered False 13:49:21.705086 bus /sierra_8: Setting Powered False 13:49:22.819416 bus /sierra_3: Setting Powered False 13:49:23.919428 bus /sierra_3: Setting Powered False 13:49:25.036269 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 13:49:26.304385 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:49:26.308765 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 13:49:26.337642 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 13:49:26.375877 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 13:49:26.462127 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 13:49:26.491247 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 13:49:26.529535 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 13:49:27.120505 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 13:49:27.170945 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:27.182017 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:49:27.227319 tst cs_paging_gprs_active.py: using LAC 41328 13:49:27.349136 tst cs_paging_gprs_active.py: using RAC 18 13:49:27.471069 tst cs_paging_gprs_active.py: using CellId 41328 13:49:27.593422 tst cs_paging_gprs_active.py: using BVCI 41329 13:49:27.705249 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:27.715991 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:27.727102 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:27.737706 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:27.748355 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:27.758995 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:27.769865 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:27.780374 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:27.791064 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:27.910124 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:28.029174 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:49:28.254441 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:28.587425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29441): Launched 13:49:28.878289 run iperf3-srv_10.42.42.10(pid=29442): Launched 13:49:29.004104 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:49:29.228105 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:29.561253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29443): Launched 13:49:29.852007 run iperf3-srv_10.42.42.10(pid=29444): Launched 13:49:29.977550 tst cs_paging_gprs_active.py:38: start network... 13:49:30.201097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:30.714442 run create_hlr_db(pid=29445): Launched 13:49:30.842892 bus /sierra_2: Setting Powered False 13:49:31.907659 run create_hlr_db(pid=29445): Terminated: ok {rc=0} 13:49:32.408928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29449): Launched 13:49:32.718483 run osmo-hlr_10.42.42.2(pid=29451): Launched 13:49:32.835743 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:33.365970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29453): Launched 13:49:33.676424 run osmo-stp_10.42.42.5(pid=29454): Launched 13:49:33.793871 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:49:34.325794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29456): Launched 13:49:34.443715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:49:34.705854 run patchelf(pid=29457): Launched 13:49:34.877969 run osmo-stp_10.42.42.5(pid=29454): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29454)] 13:49:35.008199 run osmo-stp_10.42.42.5(pid=29454): stdout: | (launched: 2022-12-14_13:49:33.619471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:35.140200 run osmo-stp_10.42.42.5(pid=29454): stderr: | 20221214134933793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134933793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134933793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134933794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134933794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134933794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134933794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:35.272902 run osmo-stp_10.42.42.5(pid=29454): stdout: | (launched: 2022-12-14_13:49:33.619471) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:35.399353 run osmo-stp_10.42.42.5(pid=29454): stderr: | 20221214134933793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134933793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134933793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134933794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134933794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134933794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134933794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:35.549173 run patchelf(pid=29457): Terminating (SIGINT) 13:49:35.722856 run patchelf(pid=29457): Terminated: ok {rc=0} 13:49:35.847495 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29454): Process ended prematurely: osmo-stp_10.42.42.5(pid=29454) [trial-2405↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29454)] [trial-2405↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 13:49:35.857092 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 13:49:35.884334 run osmo-hlr_10.42.42.2(pid=29451): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29451)] 13:49:35.932161 run osmo-hlr_10.42.42.2(pid=29451): stdout: | (launched: 2022-12-14_13:49:32.660564) 13:49:35.981508 run osmo-hlr_10.42.42.2(pid=29451): stderr: | 20221214134932838 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134932838 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134932838 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134932838 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134932838 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134932838 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134932851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134932859 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134932859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134932860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:36.031341 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29441): Terminating (SIGTERM) 13:49:36.071481 run iperf3-srv_10.42.42.10(pid=29442): Terminating (SIGTERM) 13:49:36.111561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29443): Terminating (SIGTERM) 13:49:36.151594 run iperf3-srv_10.42.42.10(pid=29444): Terminating (SIGTERM) 13:49:36.191452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29449): Terminating (SIGTERM) 13:49:36.231522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29453): Terminating (SIGTERM) 13:49:36.271476 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29456): Terminating (SIGTERM) 13:49:36.311871 --- ParallelTerminationStrategy: PID 29441 died... 13:49:36.331321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29441): Terminated: ok {rc=0} 13:49:36.375814 --- ParallelTerminationStrategy: PID 29442 died... 13:49:36.394398 run iperf3-srv_10.42.42.10(pid=29442): Terminated {rc=256} 13:49:36.438807 --- ParallelTerminationStrategy: PID 29443 died... 13:49:36.457672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29443): Terminated: ok {rc=0} 13:49:36.501819 --- ParallelTerminationStrategy: PID 29444 died... 13:49:36.520513 run iperf3-srv_10.42.42.10(pid=29444): Terminated {rc=256} 13:49:36.564532 --- ParallelTerminationStrategy: PID 29449 died... 13:49:36.583425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29449): Terminated: ok {rc=0} 13:49:36.627549 --- ParallelTerminationStrategy: PID 29453 died... 13:49:36.646452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29453): Terminated: ok {rc=0} 13:49:36.690723 --- ParallelTerminationStrategy: PID 29456 died... 13:49:36.709709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29456): Terminated: ok {rc=0} 13:49:36.793661 bus /gobi_0: Setting Powered False 13:49:37.891994 bus /gobi_0: Setting Powered False 13:49:39.007730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 13:49:40.158549 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:40.170861 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:49:40.220464 tst iperf3.py: using LAC 41329 13:49:40.349268 tst iperf3.py: using RAC 19 13:49:40.472586 tst iperf3.py: using CellId 41329 13:49:40.595265 tst iperf3.py: using BVCI 41330 13:49:40.709250 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:40.720108 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:40.730970 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:40.741696 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:40.753037 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:40.764120 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:40.775454 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:40.786637 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:40.797848 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:40.917065 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:49:41.140293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:41.472670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29458): Launched 13:49:41.762509 run iperf3-srv_10.42.42.10(pid=29459): Launched 13:49:41.888011 tst iperf3.py:8: start network... 13:49:42.111379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:42.622950 run create_hlr_db(pid=29460): Launched 13:49:42.749402 bus /gobi_6: Setting Powered False 13:49:43.810957 run create_hlr_db(pid=29460): Terminated: ok {rc=0} 13:49:44.249400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29462): Launched 13:49:44.557200 run osmo-hlr_10.42.42.2(pid=29463): Launched 13:49:44.678636 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:45.210714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29465): Launched 13:49:45.519495 run osmo-stp_10.42.42.5(pid=29466): Launched 13:49:45.637289 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:49:46.223468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29468): Launched 13:49:46.372269 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:49:46.657989 run patchelf(pid=29469): Launched 13:49:46.858522 run osmo-stp_10.42.42.5(pid=29466): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29466)] 13:49:47.002222 run osmo-stp_10.42.42.5(pid=29466): stdout: | (launched: 2022-12-14_13:49:45.462794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:47.146568 run osmo-stp_10.42.42.5(pid=29466): stderr: | 20221214134945634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134945635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134945635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134945635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134945636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134945636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134945636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:47.290087 run osmo-stp_10.42.42.5(pid=29466): stdout: | (launched: 2022-12-14_13:49:45.462794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:49:47.425610 run osmo-stp_10.42.42.5(pid=29466): stderr: | 20221214134945634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134945635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134945635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134945635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134945636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134945636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134945636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:49:47.586236 run patchelf(pid=29469): Terminating (SIGINT) 13:49:47.771445 run patchelf(pid=29469): Terminated: ok {rc=0} 13:49:47.904715 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29466): Process ended prematurely: osmo-stp_10.42.42.5(pid=29466) [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29466)] [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 13:49:47.914999 tst iperf3.py:8: Test FAILED (7.8 sec) 13:49:47.943928 run osmo-hlr_10.42.42.2(pid=29463): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29463)] 13:49:47.995340 run osmo-hlr_10.42.42.2(pid=29463): stdout: | (launched: 2022-12-14_13:49:44.500193) 13:49:48.047847 run osmo-hlr_10.42.42.2(pid=29463): stderr: | 20221214134944680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134944680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134944680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134944680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134944680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134944680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134944695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134944705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134944706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134944706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:49:48.101055 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29458): Terminating (SIGTERM) 13:49:48.143276 run iperf3-srv_10.42.42.10(pid=29459): Terminating (SIGTERM) 13:49:48.185876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29462): Terminating (SIGTERM) 13:49:48.228548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29465): Terminating (SIGTERM) 13:49:48.271107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29468): Terminating (SIGTERM) 13:49:48.314065 --- ParallelTerminationStrategy: PID 29458 died... 13:49:48.334886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29458): Terminated: ok {rc=0} 13:49:48.382390 --- ParallelTerminationStrategy: PID 29459 died... 13:49:48.402330 run iperf3-srv_10.42.42.10(pid=29459): Terminated {rc=256} 13:49:48.449320 --- ParallelTerminationStrategy: PID 29462 died... 13:49:48.469546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29462): Terminated: ok {rc=0} 13:49:48.516838 --- ParallelTerminationStrategy: PID 29465 died... 13:49:48.536761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29465): Terminated: ok {rc=0} 13:49:48.583896 --- ParallelTerminationStrategy: PID 29468 died... 13:49:48.603938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29468): Terminated: ok {rc=0} 13:49:48.693187 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 13:49:49.846037 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:49.858224 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:49:49.905563 tst iperf3m4.py: using LAC 41330 13:49:50.028818 tst iperf3m4.py: using RAC 20 13:49:50.148491 tst iperf3m4.py: using CellId 41330 13:49:50.274509 tst iperf3m4.py: using BVCI 41331 13:49:50.386453 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:50.397325 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:50.407897 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:50.418428 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:50.429650 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:50.440665 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:50.451997 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:50.463036 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:49:50.474229 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:50.595536 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:50.717675 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:50.834961 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:49:50.960540 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:49:51.184051 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:51.515203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29470): Launched 13:49:51.803405 run iperf3-srv_10.42.42.10(pid=29471): Launched 13:49:51.928235 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:49:52.151068 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:52.481615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29472): Launched 13:49:52.768213 run iperf3-srv_10.42.42.10(pid=29473): Launched 13:49:52.894846 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:49:53.116902 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:53.447547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29474): Launched 13:49:53.736468 run iperf3-srv_10.42.42.10(pid=29475): Launched 13:49:53.861751 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:49:54.084293 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:49:54.415477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29476): Launched 13:49:54.704315 run iperf3-srv_10.42.42.10(pid=29477): Launched 13:49:54.829746 tst iperf3m4.py:8: start network... 13:49:55.053111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:49:55.564327 run create_hlr_db(pid=29478): Launched 13:49:55.689852 bus /gobi_6: Setting Powered False 13:49:56.754590 run create_hlr_db(pid=29478): Terminated: ok {rc=0} 13:49:57.214057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29480): Launched 13:49:57.545530 run osmo-hlr_10.42.42.2(pid=29481): Launched 13:49:57.671866 run osmo-stp_10.42.42.5: Starting osmo-stp 13:49:58.342577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29483): Launched 13:49:58.664416 run osmo-stp_10.42.42.5(pid=29484): Launched 13:49:58.789086 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:49:59.346368 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29486): Launched 13:49:59.469567 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:49:59.742477 run patchelf(pid=29487): Launched 13:49:59.922178 run osmo-stp_10.42.42.5(pid=29484): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29484)] 13:50:00.058249 run osmo-stp_10.42.42.5(pid=29484): stdout: | (launched: 2022-12-14_13:49:58.605203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:00.195915 run osmo-stp_10.42.42.5(pid=29484): stderr: | 20221214134958796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134958796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134958796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134958797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134958797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134958797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134958797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:00.333935 run osmo-stp_10.42.42.5(pid=29484): stdout: | (launched: 2022-12-14_13:49:58.605203) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:00.466316 run osmo-stp_10.42.42.5(pid=29484): stderr: | 20221214134958796 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214134958796 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214134958796 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214134958797 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214134958797 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214134958797 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214134958797 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:00.623119 run patchelf(pid=29487): Terminating (SIGINT) 13:50:00.803930 run patchelf(pid=29487): Terminated: ok {rc=0} 13:50:00.937361 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29484): Process ended prematurely: osmo-stp_10.42.42.5(pid=29484) [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29484)] [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 13:50:00.948734 tst iperf3m4.py:8: Test FAILED (11.1 sec) 13:50:00.979280 run osmo-hlr_10.42.42.2(pid=29481): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29481)] 13:50:01.032422 run osmo-hlr_10.42.42.2(pid=29481): stdout: | (launched: 2022-12-14_13:49:57.484831) 13:50:01.086321 run osmo-hlr_10.42.42.2(pid=29481): stderr: | 20221214134957684 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214134957685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214134957685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214134957685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214134957685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214134957685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214134957698 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214134957706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214134957706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214134957707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:01.140661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29470): Terminating (SIGTERM) 13:50:01.183219 run iperf3-srv_10.42.42.10(pid=29471): Terminating (SIGTERM) 13:50:01.227157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29472): Terminating (SIGTERM) 13:50:01.270766 run iperf3-srv_10.42.42.10(pid=29473): Terminating (SIGTERM) 13:50:01.314240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29474): Terminating (SIGTERM) 13:50:01.358413 run iperf3-srv_10.42.42.10(pid=29475): Terminating (SIGTERM) 13:50:01.404773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29476): Terminating (SIGTERM) 13:50:01.448454 run iperf3-srv_10.42.42.10(pid=29477): Terminating (SIGTERM) 13:50:01.491945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29480): Terminating (SIGTERM) 13:50:01.535689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29483): Terminating (SIGTERM) 13:50:01.579420 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29486): Terminating (SIGTERM) 13:50:01.623329 --- ParallelTerminationStrategy: PID 29470 died... 13:50:01.644914 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29470): Terminated: ok {rc=0} 13:50:01.694665 --- ParallelTerminationStrategy: PID 29471 died... 13:50:01.715289 run iperf3-srv_10.42.42.10(pid=29471): Terminated {rc=256} 13:50:01.774542 --- ParallelTerminationStrategy: PID 29472 died... 13:50:01.795124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29472): Terminated: ok {rc=0} 13:50:01.844213 --- ParallelTerminationStrategy: PID 29473 died... 13:50:01.864385 run iperf3-srv_10.42.42.10(pid=29473): Terminated {rc=256} 13:50:01.915541 --- ParallelTerminationStrategy: PID 29474 died... 13:50:01.936090 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29474): Terminated: ok {rc=0} 13:50:01.984563 --- ParallelTerminationStrategy: PID 29475 died... 13:50:02.004725 run iperf3-srv_10.42.42.10(pid=29475): Terminated {rc=256} 13:50:02.053280 --- ParallelTerminationStrategy: PID 29476 died... 13:50:02.073707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29476): Terminated: ok {rc=0} 13:50:02.122127 --- ParallelTerminationStrategy: PID 29477 died... 13:50:02.142593 run iperf3-srv_10.42.42.10(pid=29477): Terminated {rc=256} 13:50:02.190842 --- ParallelTerminationStrategy: PID 29480 died... 13:50:02.211339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29480): Terminated: ok {rc=0} 13:50:02.259864 --- ParallelTerminationStrategy: PID 29483 died... 13:50:02.280254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29483): Terminated: ok {rc=0} 13:50:02.328469 --- ParallelTerminationStrategy: PID 29486 died... 13:50:02.348913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29486): Terminated: ok {rc=0} 13:50:02.438552 bus /gobi_4: Setting Powered False 13:50:03.536768 bus /gobi_4: Setting Powered False 13:50:04.652543 bus /gobi_1: Setting Powered False 13:50:05.748683 bus /gobi_1: Setting Powered False 13:50:06.861848 bus /gobi_0: Setting Powered False 13:50:07.959856 bus /gobi_0: Setting Powered False 13:50:09.076914 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 13:50:10.178907 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:10.190418 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:50:10.235934 tst ping.py: using LAC 41331 13:50:10.357033 tst ping.py: using RAC 21 13:50:10.476647 tst ping.py: using CellId 41331 13:50:10.594199 tst ping.py: using BVCI 41332 13:50:10.703245 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:10.713989 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:10.724468 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:10.735054 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:10.745447 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:10.755835 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:10.766442 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:10.776932 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:50:10.889511 tst ping.py:19: start network... 13:50:11.087547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:11.545304 run create_hlr_db(pid=29491): Launched 13:50:11.666566 bus /gobi_6: Setting Powered False 13:50:12.726365 run create_hlr_db(pid=29491): Terminated: ok {rc=0} 13:50:13.161660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29493): Launched 13:50:13.482046 run osmo-hlr_10.42.42.2(pid=29494): Launched 13:50:13.605700 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:14.155071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29496): Launched 13:50:14.473673 run osmo-stp_10.42.42.5(pid=29497): Launched 13:50:14.596072 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:15.146834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29499): Launched 13:50:15.268144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:15.537985 run patchelf(pid=29500): Launched 13:50:15.714244 run osmo-stp_10.42.42.5(pid=29497): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29497)] 13:50:15.849254 run osmo-stp_10.42.42.5(pid=29497): stdout: | (launched: 2022-12-14_13:50:14.414799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:15.997874 run osmo-stp_10.42.42.5(pid=29497): stderr: | 20221214135014608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135014608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135014608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135014609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135014609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135014609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135014609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:16.139474 run osmo-stp_10.42.42.5(pid=29497): stdout: | (launched: 2022-12-14_13:50:14.414799) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:16.273586 run osmo-stp_10.42.42.5(pid=29497): stderr: | 20221214135014608 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135014608 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135014608 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135014609 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135014609 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135014609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135014609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:16.432174 run patchelf(pid=29500): Terminating (SIGINT) 13:50:16.614487 run patchelf(pid=29500): Terminated: ok {rc=0} 13:50:16.746359 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29497): Process ended prematurely: osmo-stp_10.42.42.5(pid=29497) [trial-2405↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29497)] [trial-2405↪gprs:trx-lms-limenet-micro↪ping.py:22] 13:50:16.756879 tst ping.py:22: Test FAILED (6.6 sec) 13:50:16.787089 run osmo-hlr_10.42.42.2(pid=29494): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29494)] 13:50:16.840493 run osmo-hlr_10.42.42.2(pid=29494): stdout: | (launched: 2022-12-14_13:50:13.423805) 13:50:16.894666 run osmo-hlr_10.42.42.2(pid=29494): stderr: | 20221214135013622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135013622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135013622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135013623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135013623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135013623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135013635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135013645 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135013645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135013645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:16.949283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29493): Terminating (SIGTERM) 13:50:16.991905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29496): Terminating (SIGTERM) 13:50:17.035383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29499): Terminating (SIGTERM) 13:50:17.079931 --- ParallelTerminationStrategy: PID 29493 died... 13:50:17.101662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29493): Terminated: ok {rc=0} 13:50:17.152025 --- ParallelTerminationStrategy: PID 29496 died... 13:50:17.172268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29496): Terminated: ok {rc=0} 13:50:17.221638 --- ParallelTerminationStrategy: PID 29499 died... 13:50:17.242051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29499): Terminated: ok {rc=0} 13:50:17.331467 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 13:50:18.418004 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:18.429853 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 13:50:18.476642 tst ping_idle_ping.py: using LAC 41332 13:50:18.602610 tst ping_idle_ping.py: using RAC 22 13:50:18.729431 tst ping_idle_ping.py: using CellId 41332 13:50:18.846801 tst ping_idle_ping.py: using BVCI 41333 13:50:18.956437 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:18.967272 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:18.977955 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:18.988562 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:18.998972 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:19.009530 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:19.020173 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 13:50:19.030655 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 13:50:19.147019 tst ping_idle_ping.py:24: start network... 13:50:19.361844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:19.858051 run create_hlr_db(pid=29501): Launched 13:50:19.980195 bus /gobi_6: Setting Powered False 13:50:21.043685 run create_hlr_db(pid=29501): Terminated: ok {rc=0} 13:50:21.470033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29503): Launched 13:50:21.768875 run osmo-hlr_10.42.42.2(pid=29504): Launched 13:50:21.882957 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:22.413651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29506): Launched 13:50:22.713306 run osmo-stp_10.42.42.5(pid=29507): Launched 13:50:22.826321 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:23.342081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29509): Launched 13:50:23.455783 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:23.708933 run patchelf(pid=29510): Launched 13:50:23.874297 run osmo-stp_10.42.42.5(pid=29507): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29507)] 13:50:24.000037 run osmo-stp_10.42.42.5(pid=29507): stdout: | (launched: 2022-12-14_13:50:22.657260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:24.127833 run osmo-stp_10.42.42.5(pid=29507): stderr: | 20221214135022828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135022828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135022828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135022828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135022831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135022831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135022831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:24.255653 run osmo-stp_10.42.42.5(pid=29507): stdout: | (launched: 2022-12-14_13:50:22.657260) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:24.377607 run osmo-stp_10.42.42.5(pid=29507): stderr: | 20221214135022828 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135022828 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135022828 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135022828 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135022831 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135022831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135022831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:24.522498 run patchelf(pid=29510): Terminating (SIGINT) 13:50:24.689209 run patchelf(pid=29510): Terminated: ok {rc=0} 13:50:24.809606 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29507): Process ended prematurely: osmo-stp_10.42.42.5(pid=29507) [trial-2405↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29507)] [trial-2405↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 13:50:24.818385 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 13:50:24.844737 run osmo-hlr_10.42.42.2(pid=29504): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29504)] 13:50:24.892440 run osmo-hlr_10.42.42.2(pid=29504): stdout: | (launched: 2022-12-14_13:50:21.713609) 13:50:24.941500 run osmo-hlr_10.42.42.2(pid=29504): stderr: | 20221214135021891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135021891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135021891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135021892 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135021892 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135021892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135021904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135021913 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135021913 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135021913 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:24.990902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29503): Terminating (SIGTERM) 13:50:25.030440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29506): Terminating (SIGTERM) 13:50:25.069929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29509): Terminating (SIGTERM) 13:50:25.109886 --- ParallelTerminationStrategy: PID 29503 died... 13:50:25.128940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29503): Terminated: ok {rc=0} 13:50:25.172604 --- ParallelTerminationStrategy: PID 29506 died... 13:50:25.191250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29506): Terminated: ok {rc=0} 13:50:25.234547 --- ParallelTerminationStrategy: PID 29509 died... 13:50:25.252907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29509): Terminated: ok {rc=0} 13:50:25.334921 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 13:50:26.638449 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:50:26.644160 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:50:26.672807 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:50:26.711123 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:50:26.798674 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:50:26.828519 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:50:26.866063 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:50:27.461103 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:50:27.509957 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:27.520828 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:50:27.567816 tst cs_paging_gprs_active.py: using LAC 41333 13:50:27.688508 tst cs_paging_gprs_active.py: using RAC 23 13:50:27.809143 tst cs_paging_gprs_active.py: using CellId 41333 13:50:27.928009 tst cs_paging_gprs_active.py: using BVCI 41334 13:50:28.039328 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:28.050502 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:28.061316 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:28.071907 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:28.082743 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:28.093691 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:28.104646 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:28.115539 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:28.126608 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:28.244487 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:28.360219 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:50:28.564032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:28.869431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29514): Launched 13:50:29.133379 run iperf3-srv_10.42.42.10(pid=29515): Launched 13:50:29.246919 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:50:29.449972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:29.754858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29516): Launched 13:50:30.019063 run iperf3-srv_10.42.42.10(pid=29517): Launched 13:50:30.132454 tst cs_paging_gprs_active.py:38: start network... 13:50:30.335323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:30.805083 run create_hlr_db(pid=29518): Launched 13:50:30.963397 bus /gobi_6: Setting Powered False 13:50:32.027289 run create_hlr_db(pid=29518): Terminated: ok {rc=0} 13:50:32.490832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29520): Launched 13:50:32.794553 run osmo-hlr_10.42.42.2(pid=29521): Launched 13:50:32.909581 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:33.451174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29523): Launched 13:50:33.754131 run osmo-stp_10.42.42.5(pid=29524): Launched 13:50:33.871580 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:34.395273 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29526): Launched 13:50:34.511098 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:34.767462 run patchelf(pid=29527): Launched 13:50:34.935931 run osmo-stp_10.42.42.5(pid=29524): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29524)] 13:50:35.063895 run osmo-stp_10.42.42.5(pid=29524): stdout: | (launched: 2022-12-14_13:50:33.698449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:35.194328 run osmo-stp_10.42.42.5(pid=29524): stderr: | 20221214135033870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135033871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135033871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135033871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135033872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135033872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135033872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:35.324044 run osmo-stp_10.42.42.5(pid=29524): stdout: | (launched: 2022-12-14_13:50:33.698449) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:35.447961 run osmo-stp_10.42.42.5(pid=29524): stderr: | 20221214135033870 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135033871 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135033871 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135033871 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135033872 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135033872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135033872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:35.594808 run patchelf(pid=29527): Terminating (SIGINT) 13:50:35.764427 run patchelf(pid=29527): Terminated: ok {rc=0} 13:50:35.886887 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29524): Process ended prematurely: osmo-stp_10.42.42.5(pid=29524) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29524)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:50:35.896180 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 13:50:35.922973 run osmo-hlr_10.42.42.2(pid=29521): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29521)] 13:50:35.970369 run osmo-hlr_10.42.42.2(pid=29521): stdout: | (launched: 2022-12-14_13:50:32.738079) 13:50:36.019454 run osmo-hlr_10.42.42.2(pid=29521): stderr: | 20221214135032914 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135032914 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135032914 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135032914 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135032914 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135032914 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135032926 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135032935 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135032935 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135032935 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:36.068800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29514): Terminating (SIGTERM) 13:50:36.108206 run iperf3-srv_10.42.42.10(pid=29515): Terminating (SIGTERM) 13:50:36.147540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29516): Terminating (SIGTERM) 13:50:36.186925 run iperf3-srv_10.42.42.10(pid=29517): Terminating (SIGTERM) 13:50:36.226197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29520): Terminating (SIGTERM) 13:50:36.265723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29523): Terminating (SIGTERM) 13:50:36.305064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29526): Terminating (SIGTERM) 13:50:36.345028 --- ParallelTerminationStrategy: PID 29514 died... 13:50:36.364160 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29514): Terminated: ok {rc=0} 13:50:36.408829 --- ParallelTerminationStrategy: PID 29515 died... 13:50:36.427393 run iperf3-srv_10.42.42.10(pid=29515): Terminated {rc=256} 13:50:36.471219 --- ParallelTerminationStrategy: PID 29516 died... 13:50:36.489852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29516): Terminated: ok {rc=0} 13:50:36.533530 --- ParallelTerminationStrategy: PID 29517 died... 13:50:36.552021 run iperf3-srv_10.42.42.10(pid=29517): Terminated {rc=256} 13:50:36.595693 --- ParallelTerminationStrategy: PID 29520 died... 13:50:36.614331 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29520): Terminated: ok {rc=0} 13:50:36.657931 --- ParallelTerminationStrategy: PID 29523 died... 13:50:36.676565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29523): Terminated: ok {rc=0} 13:50:36.720368 --- ParallelTerminationStrategy: PID 29526 died... 13:50:36.739177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29526): Terminated: ok {rc=0} 13:50:36.824863 bus /gobi_0: Setting Powered False 13:50:37.923014 bus /gobi_0: Setting Powered False 13:50:39.038006 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:50:40.188398 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:40.200743 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:50:40.249657 tst iperf3.py: using LAC 41334 13:50:40.369142 tst iperf3.py: using RAC 24 13:50:40.487811 tst iperf3.py: using CellId 41334 13:50:40.607657 tst iperf3.py: using BVCI 41335 13:50:40.718817 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:40.730069 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:40.741107 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:40.751797 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:40.762492 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:40.773200 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:40.784034 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:40.794705 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:40.805611 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:40.923517 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:50:41.142167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:41.467117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29528): Launched 13:50:41.750000 run iperf3-srv_10.42.42.10(pid=29529): Launched 13:50:41.872564 tst iperf3.py:8: start network... 13:50:42.091196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:42.592032 run create_hlr_db(pid=29530): Launched 13:50:42.717931 bus /gobi_6: Setting Powered False 13:50:43.780918 run create_hlr_db(pid=29530): Terminated: ok {rc=0} 13:50:44.232316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29532): Launched 13:50:44.555360 run osmo-hlr_10.42.42.2(pid=29533): Launched 13:50:44.678876 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:45.233952 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29535): Launched 13:50:45.556152 run osmo-stp_10.42.42.5(pid=29536): Launched 13:50:45.679602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:46.255474 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29538): Launched 13:50:46.386478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:46.657726 run patchelf(pid=29539): Launched 13:50:46.844712 run osmo-stp_10.42.42.5(pid=29536): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29536)] 13:50:46.985324 run osmo-stp_10.42.42.5(pid=29536): stdout: | (launched: 2022-12-14_13:50:45.497243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:47.127719 run osmo-stp_10.42.42.5(pid=29536): stderr: | 20221214135045689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135045689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135045689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135045690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135045690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135045690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135045690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:47.268856 run osmo-stp_10.42.42.5(pid=29536): stdout: | (launched: 2022-12-14_13:50:45.497243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:47.402692 run osmo-stp_10.42.42.5(pid=29536): stderr: | 20221214135045689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135045689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135045689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135045690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135045690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135045690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135045690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:47.560912 run patchelf(pid=29539): Terminating (SIGINT) 13:50:47.751258 run patchelf(pid=29539): Terminated: ok {rc=0} 13:50:47.880729 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29536): Process ended prematurely: osmo-stp_10.42.42.5(pid=29536) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29536)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 13:50:47.890731 tst iperf3.py:8: Test FAILED (7.7 sec) 13:50:47.919191 run osmo-hlr_10.42.42.2(pid=29533): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29533)] 13:50:47.970607 run osmo-hlr_10.42.42.2(pid=29533): stdout: | (launched: 2022-12-14_13:50:44.495992) 13:50:48.023027 run osmo-hlr_10.42.42.2(pid=29533): stderr: | 20221214135044696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135044696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135044696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135044696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135044696 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135044696 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135044709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135044717 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135044717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135044717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:50:48.075587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29528): Terminating (SIGTERM) 13:50:48.117461 run iperf3-srv_10.42.42.10(pid=29529): Terminating (SIGTERM) 13:50:48.159406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29532): Terminating (SIGTERM) 13:50:48.201588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29535): Terminating (SIGTERM) 13:50:48.243518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29538): Terminating (SIGTERM) 13:50:48.285732 --- ParallelTerminationStrategy: PID 29528 died... 13:50:48.306089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29528): Terminated: ok {rc=0} 13:50:48.353055 --- ParallelTerminationStrategy: PID 29529 died... 13:50:48.372743 run iperf3-srv_10.42.42.10(pid=29529): Terminated {rc=256} 13:50:48.419376 --- ParallelTerminationStrategy: PID 29532 died... 13:50:48.439448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29532): Terminated: ok {rc=0} 13:50:48.485940 --- ParallelTerminationStrategy: PID 29535 died... 13:50:48.506414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29535): Terminated: ok {rc=0} 13:50:48.553076 --- ParallelTerminationStrategy: PID 29538 died... 13:50:48.573545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29538): Terminated: ok {rc=0} 13:50:48.662717 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:50:49.812306 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:49.824526 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:50:49.873294 tst iperf3m4.py: using LAC 41335 13:50:50.000296 tst iperf3m4.py: using RAC 25 13:50:50.131218 tst iperf3m4.py: using CellId 41335 13:50:50.257285 tst iperf3m4.py: using BVCI 41336 13:50:50.375724 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:50.387403 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:50.398855 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:50.410183 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:50.422032 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:50.433547 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:50.445166 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:50.456689 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:50:50.468548 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:50.595009 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:50.711371 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:50.829737 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:50:50.950386 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:50:51.168261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:51.491382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29540): Launched 13:50:51.772055 run iperf3-srv_10.42.42.10(pid=29541): Launched 13:50:51.893069 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:50:52.112589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:52.436187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29545): Launched 13:50:52.716672 run iperf3-srv_10.42.42.10(pid=29546): Launched 13:50:52.837834 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:50:53.054903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:53.378051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29547): Launched 13:50:53.657139 run iperf3-srv_10.42.42.10(pid=29548): Launched 13:50:53.778027 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:50:53.994715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:50:54.317124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29549): Launched 13:50:54.596351 run iperf3-srv_10.42.42.10(pid=29550): Launched 13:50:54.717324 tst iperf3m4.py:8: start network... 13:50:54.933941 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:50:55.433319 run create_hlr_db(pid=29551): Launched 13:50:55.556174 bus /gobi_6: Setting Powered False 13:50:56.620537 run create_hlr_db(pid=29551): Terminated: ok {rc=0} 13:50:57.052020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29553): Launched 13:50:57.354630 run osmo-hlr_10.42.42.2(pid=29554): Launched 13:50:57.468829 run osmo-stp_10.42.42.5: Starting osmo-stp 13:50:58.003871 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29556): Launched 13:50:58.303746 run osmo-stp_10.42.42.5(pid=29557): Launched 13:50:58.418079 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:50:58.934693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29559): Launched 13:50:59.049179 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:50:59.302926 run patchelf(pid=29560): Launched 13:50:59.470521 run osmo-stp_10.42.42.5(pid=29557): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29557)] 13:50:59.597730 run osmo-stp_10.42.42.5(pid=29557): stdout: | (launched: 2022-12-14_13:50:58.248491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:59.726403 run osmo-stp_10.42.42.5(pid=29557): stderr: | 20221214135058418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135058419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135058419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135058419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135058420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135058420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135058420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:50:59.854951 run osmo-stp_10.42.42.5(pid=29557): stdout: | (launched: 2022-12-14_13:50:58.248491) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:50:59.978588 run osmo-stp_10.42.42.5(pid=29557): stderr: | 20221214135058418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135058419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135058419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135058419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135058420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135058420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135058420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:00.124670 run patchelf(pid=29560): Terminating (SIGINT) 13:51:00.292862 run patchelf(pid=29560): Terminated: ok {rc=0} 13:51:00.414387 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29557): Process ended prematurely: osmo-stp_10.42.42.5(pid=29557) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29557)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 13:51:00.423820 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:51:00.450890 run osmo-hlr_10.42.42.2(pid=29554): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29554)] 13:51:00.498487 run osmo-hlr_10.42.42.2(pid=29554): stdout: | (launched: 2022-12-14_13:50:57.299158) 13:51:00.547747 run osmo-hlr_10.42.42.2(pid=29554): stderr: | 20221214135057476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135057476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135057476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135057476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135057477 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135057477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135057489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135057500 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135057500 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135057500 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:00.597063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29540): Terminating (SIGTERM) 13:51:00.636611 run iperf3-srv_10.42.42.10(pid=29541): Terminating (SIGTERM) 13:51:00.676317 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29545): Terminating (SIGTERM) 13:51:00.716010 run iperf3-srv_10.42.42.10(pid=29546): Terminating (SIGTERM) 13:51:00.755795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29547): Terminating (SIGTERM) 13:51:00.795627 run iperf3-srv_10.42.42.10(pid=29548): Terminating (SIGTERM) 13:51:00.847374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29549): Terminating (SIGTERM) 13:51:00.898609 run iperf3-srv_10.42.42.10(pid=29550): Terminating (SIGTERM) 13:51:00.946223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29553): Terminating (SIGTERM) 13:51:00.993597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29556): Terminating (SIGTERM) 13:51:01.038337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29559): Terminating (SIGTERM) 13:51:01.085759 --- ParallelTerminationStrategy: PID 29540 died... 13:51:01.106523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29540): Terminated: ok {rc=0} 13:51:01.157457 --- ParallelTerminationStrategy: PID 29541 died... 13:51:01.178551 run iperf3-srv_10.42.42.10(pid=29541): Terminated {rc=256} 13:51:01.229358 --- ParallelTerminationStrategy: PID 29545 died... 13:51:01.249884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29545): Terminated: ok {rc=0} 13:51:01.300151 --- ParallelTerminationStrategy: PID 29546 died... 13:51:01.320864 run iperf3-srv_10.42.42.10(pid=29546): Terminated {rc=256} 13:51:01.371050 --- ParallelTerminationStrategy: PID 29547 died... 13:51:01.392630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29547): Terminated: ok {rc=0} 13:51:01.442821 --- ParallelTerminationStrategy: PID 29548 died... 13:51:01.464061 run iperf3-srv_10.42.42.10(pid=29548): Terminated {rc=256} 13:51:01.514163 --- ParallelTerminationStrategy: PID 29549 died... 13:51:01.535133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29549): Terminated: ok {rc=0} 13:51:01.586560 --- ParallelTerminationStrategy: PID 29550 died... 13:51:01.607228 run iperf3-srv_10.42.42.10(pid=29550): Terminated {rc=256} 13:51:01.655751 --- ParallelTerminationStrategy: PID 29553 died... 13:51:01.677755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29553): Terminated: ok {rc=0} 13:51:01.727919 --- ParallelTerminationStrategy: PID 29556 died... 13:51:01.749787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29556): Terminated: ok {rc=0} 13:51:01.800628 --- ParallelTerminationStrategy: PID 29559 died... 13:51:01.821352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29559): Terminated: ok {rc=0} 13:51:01.913144 bus /gobi_4: Setting Powered False 13:51:03.018996 bus /gobi_4: Setting Powered False 13:51:04.139252 bus /gobi_1: Setting Powered False 13:51:05.238685 bus /gobi_1: Setting Powered False 13:51:06.355401 bus /gobi_0: Setting Powered False 13:51:07.453823 bus /gobi_0: Setting Powered False 13:51:08.570670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 13:51:09.672002 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:09.684021 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:51:09.732895 tst ping.py: using LAC 41336 13:51:09.856894 tst ping.py: using RAC 26 13:51:09.979367 tst ping.py: using CellId 41336 13:51:10.103033 tst ping.py: using BVCI 41337 13:51:10.218527 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:10.230007 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:10.241145 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:10.252281 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:10.263643 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:10.274998 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:10.286599 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:10.298181 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:10.415028 tst ping.py:19: start network... 13:51:10.628139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:11.116500 run create_hlr_db(pid=29561): Launched 13:51:11.236675 bus /gobi_6: Setting Powered False 13:51:12.298092 run create_hlr_db(pid=29561): Terminated: ok {rc=0} 13:51:12.718873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29563): Launched 13:51:13.011877 run osmo-hlr_10.42.42.2(pid=29564): Launched 13:51:13.123129 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:13.631224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29566): Launched 13:51:13.925395 run osmo-stp_10.42.42.5(pid=29567): Launched 13:51:14.036893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:14.545196 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29569): Launched 13:51:14.657594 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:14.906788 run patchelf(pid=29570): Launched 13:51:15.070333 run osmo-stp_10.42.42.5(pid=29567): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29567)] 13:51:15.194763 run osmo-stp_10.42.42.5(pid=29567): stdout: | (launched: 2022-12-14_13:51:13.871149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:15.321247 run osmo-stp_10.42.42.5(pid=29567): stderr: | 20221214135114040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135114041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135114041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135114041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135114042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135114042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135114042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:15.447669 run osmo-stp_10.42.42.5(pid=29567): stdout: | (launched: 2022-12-14_13:51:13.871149) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:15.569438 run osmo-stp_10.42.42.5(pid=29567): stderr: | 20221214135114040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135114041 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135114041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135114041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135114042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135114042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135114042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:15.712545 run patchelf(pid=29570): Terminating (SIGINT) 13:51:15.888450 run patchelf(pid=29570): Terminated: ok {rc=0} 13:51:16.029932 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29567): Process ended prematurely: osmo-stp_10.42.42.5(pid=29567) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29567)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 13:51:16.039568 tst ping.py:22: Test FAILED (6.4 sec) 13:51:16.067888 run osmo-hlr_10.42.42.2(pid=29564): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29564)] 13:51:16.117557 run osmo-hlr_10.42.42.2(pid=29564): stdout: | (launched: 2022-12-14_13:51:12.957814) 13:51:16.168822 run osmo-hlr_10.42.42.2(pid=29564): stderr: | 20221214135113133 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135113133 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135113133 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135113133 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135113133 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135113134 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135113149 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135113159 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135113159 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135113159 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:16.220799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29563): Terminating (SIGTERM) 13:51:16.261745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29566): Terminating (SIGTERM) 13:51:16.303179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29569): Terminating (SIGTERM) 13:51:16.344171 --- ParallelTerminationStrategy: PID 29563 died... 13:51:16.363655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29563): Terminated: ok {rc=0} 13:51:16.409166 --- ParallelTerminationStrategy: PID 29566 died... 13:51:16.428384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29566): Terminated: ok {rc=0} 13:51:16.473690 --- ParallelTerminationStrategy: PID 29569 died... 13:51:16.493319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29569): Terminated: ok {rc=0} 13:51:16.579002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:51:17.663827 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:17.675463 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:51:17.722944 tst ping_idle_ping.py: using LAC 41337 13:51:17.847767 tst ping_idle_ping.py: using RAC 27 13:51:17.970554 tst ping_idle_ping.py: using CellId 41337 13:51:18.093885 tst ping_idle_ping.py: using BVCI 41338 13:51:18.210436 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:18.221986 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:18.233117 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:18.244236 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:18.255662 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:18.267081 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:18.278731 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:51:18.290147 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:51:18.404577 tst ping_idle_ping.py:24: start network... 13:51:18.602674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:19.063394 run create_hlr_db(pid=29571): Launched 13:51:19.185279 bus /gobi_6: Setting Powered False 13:51:20.245233 run create_hlr_db(pid=29571): Terminated: ok {rc=0} 13:51:20.658211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Launched 13:51:20.953810 run osmo-hlr_10.42.42.2(pid=29574): Launched 13:51:21.065947 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:21.588912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29576): Launched 13:51:21.885862 run osmo-stp_10.42.42.5(pid=29577): Launched 13:51:21.998317 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:22.508158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29579): Launched 13:51:22.621096 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:22.871442 run patchelf(pid=29580): Launched 13:51:23.035264 run osmo-stp_10.42.42.5(pid=29577): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29577)] 13:51:23.160388 run osmo-stp_10.42.42.5(pid=29577): stdout: | (launched: 2022-12-14_13:51:21.830731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:23.287095 run osmo-stp_10.42.42.5(pid=29577): stderr: | 20221214135122001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135122001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135122001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135122002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135122004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135122004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135122004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:23.414021 run osmo-stp_10.42.42.5(pid=29577): stdout: | (launched: 2022-12-14_13:51:21.830731) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:23.535558 run osmo-stp_10.42.42.5(pid=29577): stderr: | 20221214135122001 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135122001 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135122001 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135122002 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135122004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135122004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135122004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:23.680076 run patchelf(pid=29580): Terminating (SIGINT) 13:51:23.845743 run patchelf(pid=29580): Terminated: ok {rc=0} 13:51:23.964721 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29577): Process ended prematurely: osmo-stp_10.42.42.5(pid=29577) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29577)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 13:51:23.973647 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 13:51:24.000258 run osmo-hlr_10.42.42.2(pid=29574): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29574)] 13:51:24.047539 run osmo-hlr_10.42.42.2(pid=29574): stdout: | (launched: 2022-12-14_13:51:20.899133) 13:51:24.096389 run osmo-hlr_10.42.42.2(pid=29574): stderr: | 20221214135121075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135121075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135121075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135121075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135121075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135121075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135121088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135121096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135121096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135121096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:24.145680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Terminating (SIGTERM) 13:51:24.184920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29576): Terminating (SIGTERM) 13:51:24.224290 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29579): Terminating (SIGTERM) 13:51:24.263906 --- ParallelTerminationStrategy: PID 29573 died... 13:51:24.282882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29573): Terminated: ok {rc=0} 13:51:24.326236 --- ParallelTerminationStrategy: PID 29576 died... 13:51:24.344432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29576): Terminated: ok {rc=0} 13:51:24.387710 --- ParallelTerminationStrategy: PID 29579 died... 13:51:24.406219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29579): Terminated: ok {rc=0} 13:51:24.489435 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:51:25.791176 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:51:25.797993 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:51:25.828530 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:51:25.868225 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:51:25.957224 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:51:25.987149 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:51:26.026566 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:51:26.622980 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:51:26.675505 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:26.686881 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:51:26.754374 tst cs_paging_gprs_active.py: using LAC 41338 13:51:26.879747 tst cs_paging_gprs_active.py: using RAC 28 13:51:27.005426 tst cs_paging_gprs_active.py: using CellId 41338 13:51:27.132932 tst cs_paging_gprs_active.py: using BVCI 41339 13:51:27.251192 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:27.262601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:27.273790 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:27.284916 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:27.296470 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:27.307910 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:27.319402 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:27.330871 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:27.342560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:27.458869 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:27.579105 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:51:27.798760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:28.123114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29584): Launched 13:51:28.404560 run iperf3-srv_10.42.42.10(pid=29585): Launched 13:51:28.525854 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:51:28.744021 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:29.068709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29586): Launched 13:51:29.349709 run iperf3-srv_10.42.42.10(pid=29587): Launched 13:51:29.470898 tst cs_paging_gprs_active.py:38: start network... 13:51:29.689920 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:30.190419 run create_hlr_db(pid=29588): Launched 13:51:30.313151 bus /gobi_6: Setting Powered False 13:51:31.388611 run create_hlr_db(pid=29588): Terminated: ok {rc=0} 13:51:31.930359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29590): Launched 13:51:32.273089 run osmo-hlr_10.42.42.2(pid=29591): Launched 13:51:32.396354 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:32.954900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29593): Launched 13:51:33.278349 run osmo-stp_10.42.42.5(pid=29594): Launched 13:51:33.401887 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:33.959709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29596): Launched 13:51:34.083631 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:34.357436 run patchelf(pid=29597): Launched 13:51:34.537473 run osmo-stp_10.42.42.5(pid=29594): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29594)] 13:51:34.675031 run osmo-stp_10.42.42.5(pid=29594): stdout: | (launched: 2022-12-14_13:51:33.219415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:34.814810 run osmo-stp_10.42.42.5(pid=29594): stderr: | 20221214135133410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135133411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135133411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135133411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135133412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135133412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135133412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:34.954116 run osmo-stp_10.42.42.5(pid=29594): stdout: | (launched: 2022-12-14_13:51:33.219415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:35.087252 run osmo-stp_10.42.42.5(pid=29594): stderr: | 20221214135133410 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135133411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135133411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135133411 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135133412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135133412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135133412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:35.244768 run patchelf(pid=29597): Terminating (SIGINT) 13:51:35.425946 run patchelf(pid=29597): Terminated: ok {rc=0} 13:51:35.556399 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29594): Process ended prematurely: osmo-stp_10.42.42.5(pid=29594) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29594)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:51:35.567116 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 13:51:35.596087 run osmo-hlr_10.42.42.2(pid=29591): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29591)] 13:51:35.647030 run osmo-hlr_10.42.42.2(pid=29591): stdout: | (launched: 2022-12-14_13:51:32.203026) 13:51:35.699063 run osmo-hlr_10.42.42.2(pid=29591): stderr: | 20221214135132405 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135132405 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135132405 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135132405 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135132405 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135132405 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135132418 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135132426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135132427 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135132427 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:35.751739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29584): Terminating (SIGTERM) 13:51:35.793464 run iperf3-srv_10.42.42.10(pid=29585): Terminating (SIGTERM) 13:51:35.835176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29586): Terminating (SIGTERM) 13:51:35.877077 run iperf3-srv_10.42.42.10(pid=29587): Terminating (SIGTERM) 13:51:35.918749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29590): Terminating (SIGTERM) 13:51:35.960558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29593): Terminating (SIGTERM) 13:51:36.002767 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29596): Terminating (SIGTERM) 13:51:36.044556 --- ParallelTerminationStrategy: PID 29584 died... 13:51:36.064818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29584): Terminated: ok {rc=0} 13:51:36.110940 --- ParallelTerminationStrategy: PID 29585 died... 13:51:36.130581 run iperf3-srv_10.42.42.10(pid=29585): Terminated {rc=256} 13:51:36.176461 --- ParallelTerminationStrategy: PID 29586 died... 13:51:36.196095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29586): Terminated: ok {rc=0} 13:51:36.242599 --- ParallelTerminationStrategy: PID 29587 died... 13:51:36.262482 run iperf3-srv_10.42.42.10(pid=29587): Terminated {rc=256} 13:51:36.308318 --- ParallelTerminationStrategy: PID 29590 died... 13:51:36.328441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29590): Terminated: ok {rc=0} 13:51:36.374344 --- ParallelTerminationStrategy: PID 29593 died... 13:51:36.393977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29593): Terminated: ok {rc=0} 13:51:36.439823 --- ParallelTerminationStrategy: PID 29596 died... 13:51:36.459952 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29596): Terminated: ok {rc=0} 13:51:36.547262 bus /gobi_0: Setting Powered False 13:51:37.645818 bus /gobi_0: Setting Powered False 13:51:38.761465 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:51:39.904023 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:39.915785 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:51:39.986462 tst iperf3.py: using LAC 41339 13:51:40.115835 tst iperf3.py: using RAC 29 13:51:40.240677 tst iperf3.py: using CellId 41339 13:51:40.365141 tst iperf3.py: using BVCI 41340 13:51:40.482351 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:40.494049 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:40.505650 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:40.516895 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:40.528468 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:40.540139 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:40.551859 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:40.563315 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:40.575083 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:40.696346 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:51:40.915073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:41.238736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29598): Launched 13:51:41.519740 run iperf3-srv_10.42.42.10(pid=29599): Launched 13:51:41.640866 tst iperf3.py:8: start network... 13:51:41.860035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:42.358800 run create_hlr_db(pid=29600): Launched 13:51:42.481282 bus /gobi_6: Setting Powered False 13:51:43.544901 run create_hlr_db(pid=29600): Terminated: ok {rc=0} 13:51:43.975214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29602): Launched 13:51:44.275805 run osmo-hlr_10.42.42.2(pid=29603): Launched 13:51:44.389861 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:44.934887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29605): Launched 13:51:45.234798 run osmo-stp_10.42.42.5(pid=29606): Launched 13:51:45.349010 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:45.900531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29608): Launched 13:51:46.024538 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:46.297786 run patchelf(pid=29609): Launched 13:51:46.482978 run osmo-stp_10.42.42.5(pid=29606): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29606)] 13:51:46.613900 run osmo-stp_10.42.42.5(pid=29606): stdout: | (launched: 2022-12-14_13:51:45.179811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:46.745876 run osmo-stp_10.42.42.5(pid=29606): stderr: | 20221214135145348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135145348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135145348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135145349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135145351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135145351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135145351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:46.878329 run osmo-stp_10.42.42.5(pid=29606): stdout: | (launched: 2022-12-14_13:51:45.179811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:47.004824 run osmo-stp_10.42.42.5(pid=29606): stderr: | 20221214135145348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135145348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135145348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135145349 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135145351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135145351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135145351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:47.154013 run patchelf(pid=29609): Terminating (SIGINT) 13:51:47.324438 run patchelf(pid=29609): Terminated: ok {rc=0} 13:51:47.446857 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29606): Process ended prematurely: osmo-stp_10.42.42.5(pid=29606) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29606)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 13:51:47.456449 tst iperf3.py:8: Test FAILED (7.6 sec) 13:51:47.483714 run osmo-hlr_10.42.42.2(pid=29603): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29603)] 13:51:47.531497 run osmo-hlr_10.42.42.2(pid=29603): stdout: | (launched: 2022-12-14_13:51:44.220455) 13:51:47.580659 run osmo-hlr_10.42.42.2(pid=29603): stderr: | 20221214135144400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135144400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135144400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135144400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135144400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135144400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135144412 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135144421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135144421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135144421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:51:47.630422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29598): Terminating (SIGTERM) 13:51:47.670183 run iperf3-srv_10.42.42.10(pid=29599): Terminating (SIGTERM) 13:51:47.709586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29602): Terminating (SIGTERM) 13:51:47.748926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29605): Terminating (SIGTERM) 13:51:47.789158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29608): Terminating (SIGTERM) 13:51:47.829121 --- ParallelTerminationStrategy: PID 29598 died... 13:51:47.848247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29598): Terminated: ok {rc=0} 13:51:47.892490 --- ParallelTerminationStrategy: PID 29599 died... 13:51:47.911342 run iperf3-srv_10.42.42.10(pid=29599): Terminated {rc=256} 13:51:47.955471 --- ParallelTerminationStrategy: PID 29602 died... 13:51:47.974293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29602): Terminated: ok {rc=0} 13:51:48.018408 --- ParallelTerminationStrategy: PID 29605 died... 13:51:48.037199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29605): Terminated: ok {rc=0} 13:51:48.081344 --- ParallelTerminationStrategy: PID 29608 died... 13:51:48.099966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29608): Terminated: ok {rc=0} 13:51:48.185434 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:51:49.332070 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:49.343816 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:51:49.410432 tst iperf3m4.py: using LAC 41340 13:51:49.528894 tst iperf3m4.py: using RAC 30 13:51:49.646397 tst iperf3m4.py: using CellId 41340 13:51:49.764524 tst iperf3m4.py: using BVCI 41341 13:51:49.873601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:49.884458 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:49.895977 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:49.906912 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:49.917873 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:49.928635 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:49.939601 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:49.950508 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:51:49.961481 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:50.076143 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:50.196568 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:50.313459 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:51:50.433904 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:51:50.652024 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:50.976264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29610): Launched 13:51:51.258068 run iperf3-srv_10.42.42.10(pid=29611): Launched 13:51:51.379119 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:51:51.597410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:51.921800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29612): Launched 13:51:52.203516 run iperf3-srv_10.42.42.10(pid=29613): Launched 13:51:52.325109 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:51:52.543143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:52.867995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29614): Launched 13:51:53.148895 run iperf3-srv_10.42.42.10(pid=29615): Launched 13:51:53.269885 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:51:53.487361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:51:53.811724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29616): Launched 13:51:54.092634 run iperf3-srv_10.42.42.10(pid=29617): Launched 13:51:54.213732 tst iperf3m4.py:8: start network... 13:51:54.431198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:51:54.932713 run create_hlr_db(pid=29618): Launched 13:51:55.055620 bus /gobi_6: Setting Powered False 13:51:56.119456 run create_hlr_db(pid=29618): Terminated: ok {rc=0} 13:51:56.569018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29620): Launched 13:51:56.891539 run osmo-hlr_10.42.42.2(pid=29621): Launched 13:51:57.014946 run osmo-stp_10.42.42.5: Starting osmo-stp 13:51:57.535838 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29623): Launched 13:51:57.836701 run osmo-stp_10.42.42.5(pid=29624): Launched 13:51:57.951044 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:51:58.469048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29626): Launched 13:51:58.584458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:51:58.838994 run patchelf(pid=29627): Launched 13:51:59.006361 run osmo-stp_10.42.42.5(pid=29624): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29624)] 13:51:59.133275 run osmo-stp_10.42.42.5(pid=29624): stdout: | (launched: 2022-12-14_13:51:57.781435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:59.261996 run osmo-stp_10.42.42.5(pid=29624): stderr: | 20221214135157952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135157952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135157952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135157953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135157953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135157953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135157953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:59.390767 run osmo-stp_10.42.42.5(pid=29624): stdout: | (launched: 2022-12-14_13:51:57.781435) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:51:59.514232 run osmo-stp_10.42.42.5(pid=29624): stderr: | 20221214135157952 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135157952 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135157952 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135157953 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135157953 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135157953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135157953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:51:59.659909 run patchelf(pid=29627): Terminating (SIGINT) 13:51:59.828863 run patchelf(pid=29627): Terminated: ok {rc=0} 13:51:59.951422 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29624): Process ended prematurely: osmo-stp_10.42.42.5(pid=29624) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29624)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:51:59.960890 tst iperf3m4.py:8: Test FAILED (10.7 sec) 13:51:59.988100 run osmo-hlr_10.42.42.2(pid=29621): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29621)] 13:52:00.036018 run osmo-hlr_10.42.42.2(pid=29621): stdout: | (launched: 2022-12-14_13:51:56.832708) 13:52:00.085263 run osmo-hlr_10.42.42.2(pid=29621): stderr: | 20221214135157032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135157032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135157032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135157032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135157032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135157032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135157044 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135157052 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135157052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135157052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:00.134783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29610): Terminating (SIGTERM) 13:52:00.174354 run iperf3-srv_10.42.42.10(pid=29611): Terminating (SIGTERM) 13:52:00.214205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29612): Terminating (SIGTERM) 13:52:00.253903 run iperf3-srv_10.42.42.10(pid=29613): Terminating (SIGTERM) 13:52:00.293425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29614): Terminating (SIGTERM) 13:52:00.333357 run iperf3-srv_10.42.42.10(pid=29615): Terminating (SIGTERM) 13:52:00.372662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29616): Terminating (SIGTERM) 13:52:00.412118 run iperf3-srv_10.42.42.10(pid=29617): Terminating (SIGTERM) 13:52:00.451619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29620): Terminating (SIGTERM) 13:52:00.491217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29623): Terminating (SIGTERM) 13:52:00.530710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29626): Terminating (SIGTERM) 13:52:00.570601 --- ParallelTerminationStrategy: PID 29610 died... 13:52:00.589910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29610): Terminated: ok {rc=0} 13:52:00.634000 --- ParallelTerminationStrategy: PID 29611 died... 13:52:00.652702 run iperf3-srv_10.42.42.10(pid=29611): Terminated {rc=256} 13:52:00.696632 --- ParallelTerminationStrategy: PID 29612 died... 13:52:00.715329 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29612): Terminated: ok {rc=0} 13:52:00.759613 --- ParallelTerminationStrategy: PID 29613 died... 13:52:00.778462 run iperf3-srv_10.42.42.10(pid=29613): Terminated {rc=256} 13:52:00.822430 --- ParallelTerminationStrategy: PID 29614 died... 13:52:00.856485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29614): Terminated: ok {rc=0} 13:52:00.907094 --- ParallelTerminationStrategy: PID 29615 died... 13:52:00.927747 run iperf3-srv_10.42.42.10(pid=29615): Terminated {rc=256} 13:52:00.979172 --- ParallelTerminationStrategy: PID 29616 died... 13:52:01.000927 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29616): Terminated: ok {rc=0} 13:52:01.051150 --- ParallelTerminationStrategy: PID 29617 died... 13:52:01.071863 run iperf3-srv_10.42.42.10(pid=29617): Terminated {rc=256} 13:52:01.122108 --- ParallelTerminationStrategy: PID 29620 died... 13:52:01.142832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29620): Terminated: ok {rc=0} 13:52:01.194149 --- ParallelTerminationStrategy: PID 29623 died... 13:52:01.215008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29623): Terminated: ok {rc=0} 13:52:01.265666 --- ParallelTerminationStrategy: PID 29626 died... 13:52:01.286350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29626): Terminated: ok {rc=0} 13:52:01.379329 bus /gobi_4: Setting Powered False 13:52:02.479901 bus /gobi_4: Setting Powered False 13:52:03.592038 bus /gobi_1: Setting Powered False 13:52:04.690873 bus /gobi_1: Setting Powered False 13:52:05.810734 bus /gobi_0: Setting Powered False 13:52:06.910383 bus /gobi_0: Setting Powered False 13:52:08.026872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:52:09.126232 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:09.138160 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:52:09.202834 tst ping.py: using LAC 41341 13:52:09.318437 tst ping.py: using RAC 31 13:52:09.432800 tst ping.py: using CellId 41341 13:52:09.546872 tst ping.py: using BVCI 41342 13:52:09.653300 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:09.664489 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:09.675486 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:09.686570 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:09.697717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:09.708792 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:09.720063 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:09.731204 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:09.845076 tst ping.py:19: start network... 13:52:10.043546 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:10.499215 run create_hlr_db(pid=29628): Launched 13:52:10.620274 bus /gobi_6: Setting Powered False 13:52:11.679451 run create_hlr_db(pid=29628): Terminated: ok {rc=0} 13:52:12.091435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29630): Launched 13:52:12.386972 run osmo-hlr_10.42.42.2(pid=29631): Launched 13:52:12.498751 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:13.005548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29633): Launched 13:52:13.299756 run osmo-stp_10.42.42.5(pid=29634): Launched 13:52:13.411080 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:13.919806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29636): Launched 13:52:14.033685 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:14.283724 run patchelf(pid=29637): Launched 13:52:14.447899 run osmo-stp_10.42.42.5(pid=29634): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29634)] 13:52:14.572746 run osmo-stp_10.42.42.5(pid=29634): stdout: | (launched: 2022-12-14_13:52:13.245518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:14.699370 run osmo-stp_10.42.42.5(pid=29634): stderr: | 20221214135213416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135213416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135213416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135213417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135213417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135213417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135213417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:14.826446 run osmo-stp_10.42.42.5(pid=29634): stdout: | (launched: 2022-12-14_13:52:13.245518) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:14.947858 run osmo-stp_10.42.42.5(pid=29634): stderr: | 20221214135213416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135213416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135213416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135213417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135213417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135213417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135213417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:15.091652 run patchelf(pid=29637): Terminating (SIGINT) 13:52:15.257354 run patchelf(pid=29637): Terminated: ok {rc=0} 13:52:15.376245 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29634): Process ended prematurely: osmo-stp_10.42.42.5(pid=29634) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29634)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 13:52:15.385203 tst ping.py:22: Test FAILED (6.3 sec) 13:52:15.411776 run osmo-hlr_10.42.42.2(pid=29631): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29631)] 13:52:15.459541 run osmo-hlr_10.42.42.2(pid=29631): stdout: | (launched: 2022-12-14_13:52:12.331649) 13:52:15.508878 run osmo-hlr_10.42.42.2(pid=29631): stderr: | 20221214135212507 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135212508 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135212508 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135212508 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135212508 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135212508 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135212519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135212528 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135212528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135212528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:15.558497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29630): Terminating (SIGTERM) 13:52:15.597922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29633): Terminating (SIGTERM) 13:52:15.637561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29636): Terminating (SIGTERM) 13:52:15.677495 --- ParallelTerminationStrategy: PID 29630 died... 13:52:15.696630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29630): Terminated: ok {rc=0} 13:52:15.740752 --- ParallelTerminationStrategy: PID 29633 died... 13:52:15.759627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29633): Terminated: ok {rc=0} 13:52:15.803501 --- ParallelTerminationStrategy: PID 29636 died... 13:52:15.822472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29636): Terminated: ok {rc=0} 13:52:15.908209 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:52:17.002343 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:17.017380 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:52:17.096824 tst ping_idle_ping.py: using LAC 41342 13:52:17.236084 tst ping_idle_ping.py: using RAC 32 13:52:17.352842 tst ping_idle_ping.py: using CellId 41342 13:52:17.468569 tst ping_idle_ping.py: using BVCI 41343 13:52:17.576234 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:17.587437 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:17.598547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:17.609578 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:17.620692 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:17.631862 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:17.643083 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:52:17.654230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:52:17.768110 tst ping_idle_ping.py:24: start network... 13:52:17.966387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:18.426891 run create_hlr_db(pid=29638): Launched 13:52:18.548160 bus /gobi_6: Setting Powered False 13:52:19.606956 run create_hlr_db(pid=29638): Terminated: ok {rc=0} 13:52:20.040567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29640): Launched 13:52:20.359429 run osmo-hlr_10.42.42.2(pid=29641): Launched 13:52:20.480836 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:21.030863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29643): Launched 13:52:21.349252 run osmo-stp_10.42.42.5(pid=29644): Launched 13:52:21.471292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:22.021567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29646): Launched 13:52:22.143879 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:22.412873 run patchelf(pid=29647): Launched 13:52:22.589492 run osmo-stp_10.42.42.5(pid=29644): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29644)] 13:52:22.723899 run osmo-stp_10.42.42.5(pid=29644): stdout: | (launched: 2022-12-14_13:52:21.291007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:22.860574 run osmo-stp_10.42.42.5(pid=29644): stderr: | 20221214135221481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135221482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135221482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135221482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135221483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135221483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135221483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:22.996574 run osmo-stp_10.42.42.5(pid=29644): stdout: | (launched: 2022-12-14_13:52:21.291007) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:23.127189 run osmo-stp_10.42.42.5(pid=29644): stderr: | 20221214135221481 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135221482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135221482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135221482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135221483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135221483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135221483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:23.281504 run patchelf(pid=29647): Terminating (SIGINT) 13:52:23.459507 run patchelf(pid=29647): Terminated: ok {rc=0} 13:52:23.588263 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29644): Process ended prematurely: osmo-stp_10.42.42.5(pid=29644) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29644)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:52:23.597844 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:52:23.625735 run osmo-hlr_10.42.42.2(pid=29641): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29641)] 13:52:23.676737 run osmo-hlr_10.42.42.2(pid=29641): stdout: | (launched: 2022-12-14_13:52:20.301296) 13:52:23.728870 run osmo-hlr_10.42.42.2(pid=29641): stderr: | 20221214135220498 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135220498 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135220498 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135220498 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135220498 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135220499 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135220511 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135220521 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135220521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135220522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:23.781772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29640): Terminating (SIGTERM) 13:52:23.823656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29643): Terminating (SIGTERM) 13:52:23.865654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29646): Terminating (SIGTERM) 13:52:23.907934 --- ParallelTerminationStrategy: PID 29640 died... 13:52:23.928360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29640): Terminated: ok {rc=0} 13:52:23.975087 --- ParallelTerminationStrategy: PID 29643 died... 13:52:23.995083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29643): Terminated: ok {rc=0} 13:52:24.041315 --- ParallelTerminationStrategy: PID 29646 died... 13:52:24.061673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29646): Terminated: ok {rc=0} 13:52:24.150270 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 13:52:25.457140 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:52:25.464054 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 13:52:25.494436 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 13:52:25.534510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 13:52:25.622589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 13:52:25.652181 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 13:52:25.691769 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 13:52:26.289523 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 13:52:26.342541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:26.354289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:52:26.423148 tst cs_paging_gprs_active.py: using LAC 41343 13:52:26.550455 tst cs_paging_gprs_active.py: using RAC 33 13:52:26.678240 tst cs_paging_gprs_active.py: using CellId 41343 13:52:26.806880 tst cs_paging_gprs_active.py: using BVCI 41344 13:52:26.925666 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:26.937073 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:26.948137 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:26.959308 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:26.971235 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:26.983200 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:26.995208 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:27.006958 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:27.018967 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:27.141400 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:27.261418 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:52:27.480426 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:27.806152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29651): Launched 13:52:28.087361 run iperf3-srv_10.42.42.10(pid=29652): Launched 13:52:28.208913 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:52:28.427721 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:28.753133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29653): Launched 13:52:29.034336 run iperf3-srv_10.42.42.10(pid=29654): Launched 13:52:29.155891 tst cs_paging_gprs_active.py:38: start network... 13:52:29.374614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:29.875434 run create_hlr_db(pid=29655): Launched 13:52:29.998495 bus /gobi_6: Setting Powered False 13:52:31.058226 run create_hlr_db(pid=29655): Terminated: ok {rc=0} 13:52:31.505824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29657): Launched 13:52:31.837931 run osmo-hlr_10.42.42.2(pid=29658): Launched 13:52:32.078821 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:32.691014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29660): Launched 13:52:33.013997 run osmo-stp_10.42.42.5(pid=29661): Launched 13:52:33.136731 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:33.693549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29663): Launched 13:52:33.817481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:34.096771 run patchelf(pid=29664): Launched 13:52:34.277167 run osmo-stp_10.42.42.5(pid=29661): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29661)] 13:52:34.414189 run osmo-stp_10.42.42.5(pid=29661): stdout: | (launched: 2022-12-14_13:52:32.955227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:34.552688 run osmo-stp_10.42.42.5(pid=29661): stderr: | 20221214135233145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135233145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135233145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135233146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135233148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135233148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135233148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:34.691761 run osmo-stp_10.42.42.5(pid=29661): stdout: | (launched: 2022-12-14_13:52:32.955227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:34.825201 run osmo-stp_10.42.42.5(pid=29661): stderr: | 20221214135233145 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135233145 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135233145 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135233146 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135233148 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135233148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135233148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:34.983024 run patchelf(pid=29664): Terminating (SIGINT) 13:52:35.164374 run patchelf(pid=29664): Terminated: ok {rc=0} 13:52:35.295236 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=29661): Process ended prematurely: osmo-stp_10.42.42.5(pid=29661) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29661)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 13:52:35.305428 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 13:52:35.333799 run osmo-hlr_10.42.42.2(pid=29658): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29658)] 13:52:35.384459 run osmo-hlr_10.42.42.2(pid=29658): stdout: | (launched: 2022-12-14_13:52:31.769300) 13:52:35.436226 run osmo-hlr_10.42.42.2(pid=29658): stderr: | 20221214135232102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135232102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135232102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135232102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135232102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135232102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135232128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135232136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135232145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135232145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:35.488273 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29651): Terminating (SIGTERM) 13:52:35.529653 run iperf3-srv_10.42.42.10(pid=29652): Terminating (SIGTERM) 13:52:35.571427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29653): Terminating (SIGTERM) 13:52:35.613416 run iperf3-srv_10.42.42.10(pid=29654): Terminating (SIGTERM) 13:52:35.655124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29657): Terminating (SIGTERM) 13:52:35.696926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29660): Terminating (SIGTERM) 13:52:35.738780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29663): Terminating (SIGTERM) 13:52:35.781123 --- ParallelTerminationStrategy: PID 29651 died... 13:52:35.801661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29651): Terminated: ok {rc=0} 13:52:35.847916 --- ParallelTerminationStrategy: PID 29652 died... 13:52:35.867729 run iperf3-srv_10.42.42.10(pid=29652): Terminated {rc=256} 13:52:35.914016 --- ParallelTerminationStrategy: PID 29653 died... 13:52:35.933699 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29653): Terminated: ok {rc=0} 13:52:35.980000 --- ParallelTerminationStrategy: PID 29654 died... 13:52:35.999741 run iperf3-srv_10.42.42.10(pid=29654): Terminated {rc=256} 13:52:36.046081 --- ParallelTerminationStrategy: PID 29657 died... 13:52:36.066107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29657): Terminated: ok {rc=0} 13:52:36.112312 --- ParallelTerminationStrategy: PID 29660 died... 13:52:36.132243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29660): Terminated: ok {rc=0} 13:52:36.178724 --- ParallelTerminationStrategy: PID 29663 died... 13:52:36.198638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29663): Terminated: ok {rc=0} 13:52:36.286392 bus /gobi_0: Setting Powered False 13:52:37.384991 bus /gobi_0: Setting Powered False 13:52:38.499280 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 13:52:39.643940 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:39.655465 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:52:39.720065 tst iperf3.py: using LAC 41344 13:52:39.836390 tst iperf3.py: using RAC 34 13:52:39.951867 tst iperf3.py: using CellId 41344 13:52:40.068243 tst iperf3.py: using BVCI 41345 13:52:40.186766 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:40.198589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:40.210384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:40.222002 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:40.234461 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:40.246698 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:40.259076 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:40.271253 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:40.283753 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:40.400561 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:52:40.602387 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:40.903156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29665): Launched 13:52:41.165181 run iperf3-srv_10.42.42.10(pid=29666): Launched 13:52:41.277712 tst iperf3.py:8: start network... 13:52:41.478059 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:41.943595 run create_hlr_db(pid=29667): Launched 13:52:42.066598 bus /gobi_6: Setting Powered False 13:52:43.126867 run create_hlr_db(pid=29667): Terminated: ok {rc=0} 13:52:43.567270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29669): Launched 13:52:43.891206 run osmo-hlr_10.42.42.2(pid=29670): Launched 13:52:44.014302 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:44.572641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29672): Launched 13:52:44.895393 run osmo-stp_10.42.42.5(pid=29673): Launched 13:52:45.018442 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:45.579669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29675): Launched 13:52:45.703171 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:46.006428 run patchelf(pid=29676): Launched 13:52:46.197800 run osmo-stp_10.42.42.5(pid=29673): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29673)] 13:52:46.359239 run osmo-stp_10.42.42.5(pid=29673): stdout: | (launched: 2022-12-14_13:52:44.836563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:46.535587 run osmo-stp_10.42.42.5(pid=29673): stderr: | 20221214135245028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135245028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135245028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135245029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135245029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135245029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135245029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:46.710561 run osmo-stp_10.42.42.5(pid=29673): stdout: | (launched: 2022-12-14_13:52:44.836563) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:46.851284 run osmo-stp_10.42.42.5(pid=29673): stderr: | 20221214135245028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135245028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135245028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135245029 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135245029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135245029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135245029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:47.011651 run patchelf(pid=29676): Terminating (SIGINT) 13:52:47.195824 run patchelf(pid=29676): Terminated: ok {rc=0} 13:52:47.328498 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29673): Process ended prematurely: osmo-stp_10.42.42.5(pid=29673) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29673)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 13:52:47.339058 tst iperf3.py:8: Test FAILED (7.7 sec) 13:52:47.367969 run osmo-hlr_10.42.42.2(pid=29670): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29670)] 13:52:47.419744 run osmo-hlr_10.42.42.2(pid=29670): stdout: | (launched: 2022-12-14_13:52:43.832335) 13:52:47.472278 run osmo-hlr_10.42.42.2(pid=29670): stderr: | 20221214135244032 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135244032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135244033 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135244033 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135244033 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135244033 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135244045 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135244054 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135244054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135244054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:52:47.525902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29665): Terminating (SIGTERM) 13:52:47.568108 run iperf3-srv_10.42.42.10(pid=29666): Terminating (SIGTERM) 13:52:47.610854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29669): Terminating (SIGTERM) 13:52:47.653430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29672): Terminating (SIGTERM) 13:52:47.696066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29675): Terminating (SIGTERM) 13:52:47.738815 --- ParallelTerminationStrategy: PID 29665 died... 13:52:47.759805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29665): Terminated: ok {rc=0} 13:52:47.807438 --- ParallelTerminationStrategy: PID 29666 died... 13:52:47.827691 run iperf3-srv_10.42.42.10(pid=29666): Terminated {rc=256} 13:52:47.874718 --- ParallelTerminationStrategy: PID 29669 died... 13:52:47.894823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29669): Terminated: ok {rc=0} 13:52:47.941564 --- ParallelTerminationStrategy: PID 29672 died... 13:52:47.961520 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29672): Terminated: ok {rc=0} 13:52:48.008285 --- ParallelTerminationStrategy: PID 29675 died... 13:52:48.028451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29675): Terminated: ok {rc=0} 13:52:48.116863 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 13:52:49.268541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:49.280768 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:52:49.349905 tst iperf3m4.py: using LAC 41345 13:52:49.477984 tst iperf3m4.py: using RAC 35 13:52:49.605583 tst iperf3m4.py: using CellId 41345 13:52:49.725337 tst iperf3m4.py: using BVCI 41346 13:52:49.845193 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:49.856916 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:49.868510 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:49.879884 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:49.892226 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:49.904374 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:49.916838 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:49.928761 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:52:49.940323 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:50.056174 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:50.177754 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:50.294684 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:52:50.414256 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:52:50.617680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:50.919868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29677): Launched 13:52:51.182851 run iperf3-srv_10.42.42.10(pid=29678): Launched 13:52:51.305885 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:52:51.524247 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:51.849860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29679): Launched 13:52:52.131849 run iperf3-srv_10.42.42.10(pid=29680): Launched 13:52:52.253417 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:52:52.472353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:52.797548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29681): Launched 13:52:53.078999 run iperf3-srv_10.42.42.10(pid=29682): Launched 13:52:53.200332 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:52:53.418620 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:52:53.742815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29683): Launched 13:52:54.025348 run iperf3-srv_10.42.42.10(pid=29684): Launched 13:52:54.147086 tst iperf3m4.py:8: start network... 13:52:54.365684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:52:54.866901 run create_hlr_db(pid=29685): Launched 13:52:54.989951 bus /gobi_6: Setting Powered False 13:52:56.054374 run create_hlr_db(pid=29685): Terminated: ok {rc=0} 13:52:56.487555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29687): Launched 13:52:56.790013 run osmo-hlr_10.42.42.2(pid=29688): Launched 13:52:56.904928 run osmo-stp_10.42.42.5: Starting osmo-stp 13:52:57.424431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29690): Launched 13:52:57.726550 run osmo-stp_10.42.42.5(pid=29691): Launched 13:52:57.841363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:52:58.360887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29693): Launched 13:52:58.475892 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:52:58.730195 run patchelf(pid=29694): Launched 13:52:58.897602 run osmo-stp_10.42.42.5(pid=29691): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29691)] 13:52:59.024607 run osmo-stp_10.42.42.5(pid=29691): stdout: | (launched: 2022-12-14_13:52:57.671169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:59.153318 run osmo-stp_10.42.42.5(pid=29691): stderr: | 20221214135257841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135257841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135257841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135257842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135257842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135257842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135257842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:59.281790 run osmo-stp_10.42.42.5(pid=29691): stdout: | (launched: 2022-12-14_13:52:57.671169) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:52:59.404699 run osmo-stp_10.42.42.5(pid=29691): stderr: | 20221214135257841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135257841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135257841 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135257842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135257842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135257842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135257842 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:52:59.550812 run patchelf(pid=29694): Terminating (SIGINT) 13:52:59.719491 run patchelf(pid=29694): Terminated: ok {rc=0} 13:52:59.840834 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=29691): Process ended prematurely: osmo-stp_10.42.42.5(pid=29691) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29691)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 13:52:59.850388 tst iperf3m4.py:8: Test FAILED (10.6 sec) 13:52:59.877616 run osmo-hlr_10.42.42.2(pid=29688): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29688)] 13:52:59.924857 run osmo-hlr_10.42.42.2(pid=29688): stdout: | (launched: 2022-12-14_13:52:56.734464) 13:52:59.974101 run osmo-hlr_10.42.42.2(pid=29688): stderr: | 20221214135256910 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135256910 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135256910 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135256910 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135256910 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135256910 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135256922 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135256931 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135256931 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135256931 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:00.023260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29677): Terminating (SIGTERM) 13:53:00.062688 run iperf3-srv_10.42.42.10(pid=29678): Terminating (SIGTERM) 13:53:00.101837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29679): Terminating (SIGTERM) 13:53:00.141659 run iperf3-srv_10.42.42.10(pid=29680): Terminating (SIGTERM) 13:53:00.180889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29681): Terminating (SIGTERM) 13:53:00.220236 run iperf3-srv_10.42.42.10(pid=29682): Terminating (SIGTERM) 13:53:00.259233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29683): Terminating (SIGTERM) 13:53:00.298479 run iperf3-srv_10.42.42.10(pid=29684): Terminating (SIGTERM) 13:53:00.338773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29687): Terminating (SIGTERM) 13:53:00.378255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29690): Terminating (SIGTERM) 13:53:00.417956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29693): Terminating (SIGTERM) 13:53:00.457586 --- ParallelTerminationStrategy: PID 29677 died... 13:53:00.476633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29677): Terminated: ok {rc=0} 13:53:00.520229 --- ParallelTerminationStrategy: PID 29678 died... 13:53:00.538629 run iperf3-srv_10.42.42.10(pid=29678): Terminated {rc=256} 13:53:00.581960 --- ParallelTerminationStrategy: PID 29679 died... 13:53:00.600791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29679): Terminated: ok {rc=0} 13:53:00.644028 --- ParallelTerminationStrategy: PID 29680 died... 13:53:00.662376 run iperf3-srv_10.42.42.10(pid=29680): Terminated {rc=256} 13:53:00.705482 --- ParallelTerminationStrategy: PID 29681 died... 13:53:00.723837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29681): Terminated: ok {rc=0} 13:53:00.767054 --- ParallelTerminationStrategy: PID 29682 died... 13:53:00.785516 run iperf3-srv_10.42.42.10(pid=29682): Terminated {rc=256} 13:53:00.838731 --- ParallelTerminationStrategy: PID 29683 died... 13:53:00.868469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=29683): Terminated: ok {rc=0} 13:53:00.925671 --- ParallelTerminationStrategy: PID 29684 died... 13:53:00.944584 run iperf3-srv_10.42.42.10(pid=29684): Terminated {rc=256} 13:53:00.990113 --- ParallelTerminationStrategy: PID 29687 died... 13:53:01.010500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29687): Terminated: ok {rc=0} 13:53:01.055458 --- ParallelTerminationStrategy: PID 29690 died... 13:53:01.074596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29690): Terminated: ok {rc=0} 13:53:01.119741 --- ParallelTerminationStrategy: PID 29693 died... 13:53:01.139360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29693): Terminated: ok {rc=0} 13:53:01.222432 bus /gobi_4: Setting Powered False 13:53:02.319069 bus /gobi_4: Setting Powered False 13:53:03.436071 bus /gobi_1: Setting Powered False 13:53:04.533880 bus /gobi_1: Setting Powered False 13:53:05.653362 bus /gobi_0: Setting Powered False 13:53:06.752408 bus /gobi_0: Setting Powered False 13:53:07.867587 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 13:53:08.971201 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:08.982943 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:53:09.054779 tst ping.py: using LAC 41346 13:53:09.169930 tst ping.py: using RAC 36 13:53:09.286451 tst ping.py: using CellId 41346 13:53:09.403906 tst ping.py: using BVCI 41347 13:53:09.511904 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:09.523036 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:09.533856 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:09.544595 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:09.555424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:09.566438 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:09.577424 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:09.588259 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:53:09.705041 tst ping.py:19: start network... 13:53:09.918791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:10.408275 run create_hlr_db(pid=29696): Launched 13:53:10.531100 bus /gobi_6: Setting Powered False 13:53:11.593600 run create_hlr_db(pid=29696): Terminated: ok {rc=0} 13:53:12.035928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29698): Launched 13:53:12.353645 run osmo-hlr_10.42.42.2(pid=29699): Launched 13:53:12.475164 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:13.030085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29701): Launched 13:53:13.348263 run osmo-stp_10.42.42.5(pid=29702): Launched 13:53:13.469755 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:14.017415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29704): Launched 13:53:14.138915 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:14.407015 run patchelf(pid=29705): Launched 13:53:14.583412 run osmo-stp_10.42.42.5(pid=29702): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29702)] 13:53:14.717617 run osmo-stp_10.42.42.5(pid=29702): stdout: | (launched: 2022-12-14_13:53:13.289683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:14.853982 run osmo-stp_10.42.42.5(pid=29702): stderr: | 20221214135313483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135313483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135313483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135313484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135313484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135313484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135313484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:14.989879 run osmo-stp_10.42.42.5(pid=29702): stdout: | (launched: 2022-12-14_13:53:13.289683) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:15.120503 run osmo-stp_10.42.42.5(pid=29702): stderr: | 20221214135313483 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135313483 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135313483 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135313484 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135313484 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135313484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135313484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:15.275205 run patchelf(pid=29705): Terminating (SIGINT) 13:53:15.452707 run patchelf(pid=29705): Terminated: ok {rc=0} 13:53:15.580736 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=29702): Process ended prematurely: osmo-stp_10.42.42.5(pid=29702) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29702)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 13:53:15.590716 tst ping.py:22: Test FAILED (6.6 sec) 13:53:15.618723 run osmo-hlr_10.42.42.2(pid=29699): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29699)] 13:53:15.668841 run osmo-hlr_10.42.42.2(pid=29699): stdout: | (launched: 2022-12-14_13:53:12.295442) 13:53:15.720927 run osmo-hlr_10.42.42.2(pid=29699): stderr: | 20221214135312492 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135312492 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135312492 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135312492 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135312492 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135312492 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135312504 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135312512 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135312512 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135312512 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:15.773502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29698): Terminating (SIGTERM) 13:53:15.815080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29701): Terminating (SIGTERM) 13:53:15.872383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29704): Terminating (SIGTERM) 13:53:15.927575 --- ParallelTerminationStrategy: PID 29698 died... 13:53:15.947151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29698): Terminated: ok {rc=0} 13:53:15.994931 --- ParallelTerminationStrategy: PID 29701 died... 13:53:16.014243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29701): Terminated: ok {rc=0} 13:53:16.064910 --- ParallelTerminationStrategy: PID 29704 died... 13:53:16.085808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29704): Terminated: ok {rc=0} 13:53:16.177141 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 13:53:17.269308 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:17.282228 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 13:53:17.352539 tst ping_idle_ping.py: using LAC 41347 13:53:17.476776 tst ping_idle_ping.py: using RAC 37 13:53:17.603205 tst ping_idle_ping.py: using CellId 41347 13:53:17.729404 tst ping_idle_ping.py: using BVCI 41348 13:53:17.845377 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:17.857277 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:17.868758 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:17.880389 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:17.891935 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:17.903667 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:17.915448 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 13:53:17.927131 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 13:53:18.041430 tst ping_idle_ping.py:24: start network... 13:53:18.240528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:18.703520 run create_hlr_db(pid=29706): Launched 13:53:18.825622 bus /gobi_6: Setting Powered False 13:53:19.885266 run create_hlr_db(pid=29706): Terminated: ok {rc=0} 13:53:20.319741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Launched 13:53:20.638823 run osmo-hlr_10.42.42.2(pid=29709): Launched 13:53:20.760522 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:21.309065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Launched 13:53:21.627125 run osmo-stp_10.42.42.5(pid=29712): Launched 13:53:21.748645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:22.298213 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Launched 13:53:22.419956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:22.689033 run patchelf(pid=29715): Launched 13:53:22.866094 run osmo-stp_10.42.42.5(pid=29712): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] 13:53:23.000251 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-14_13:53:21.568625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:23.136574 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221214135321759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135321759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135321759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135321760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135321760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135321760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135321760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:23.272736 run osmo-stp_10.42.42.5(pid=29712): stdout: | (launched: 2022-12-14_13:53:21.568625) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:23.403277 run osmo-stp_10.42.42.5(pid=29712): stderr: | 20221214135321759 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135321759 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135321759 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135321760 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135321760 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135321760 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135321760 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:23.558717 run patchelf(pid=29715): Terminating (SIGINT) 13:53:23.736487 run patchelf(pid=29715): Terminated: ok {rc=0} 13:53:23.865341 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=29712): Process ended prematurely: osmo-stp_10.42.42.5(pid=29712) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 13:53:23.874844 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 13:53:23.902974 run osmo-hlr_10.42.42.2(pid=29709): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29709)] 13:53:23.953804 run osmo-hlr_10.42.42.2(pid=29709): stdout: | (launched: 2022-12-14_13:53:20.580417) 13:53:24.005892 run osmo-hlr_10.42.42.2(pid=29709): stderr: | 20221214135320777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135320777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135320777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135320777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135320778 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135320778 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135320790 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135320798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135320798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135320798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:24.058468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminating (SIGTERM) 13:53:24.100198 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminating (SIGTERM) 13:53:24.142365 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Terminating (SIGTERM) 13:53:24.184656 --- ParallelTerminationStrategy: PID 29708 died... 13:53:24.205150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29708): Terminated: ok {rc=0} 13:53:24.251694 --- ParallelTerminationStrategy: PID 29711 died... 13:53:24.271670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29711): Terminated: ok {rc=0} 13:53:24.318253 --- ParallelTerminationStrategy: PID 29714 died... 13:53:24.338220 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29714): Terminated: ok {rc=0} 13:53:24.425622 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:53:25.729445 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:25.736362 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:53:25.766064 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:53:25.801500 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:53:25.855636 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:53:25.885075 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:53:25.919996 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:53:26.480049 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:53:26.485441 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:26.496911 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:53:26.563701 tst switch_tch_pdch.py: using LAC 41348 13:53:26.688670 tst switch_tch_pdch.py: using RAC 38 13:53:26.813212 tst switch_tch_pdch.py: using CellId 41348 13:53:26.930257 tst switch_tch_pdch.py: using BVCI 41349 13:53:27.038878 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:27.050452 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:27.061889 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:27.073280 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:27.084561 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:27.096061 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:27.107497 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:53:27.118782 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:53:27.235582 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:53:27.351090 tst switch_tch_pdch.py:51: start network... 13:53:27.548929 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:28.006583 run create_hlr_db(pid=29719): Launched 13:53:28.130716 bus /gobi_6: Setting Powered False 13:53:29.193431 run create_hlr_db(pid=29719): Terminated: ok {rc=0} 13:53:29.634525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29721): Launched 13:53:29.952570 run osmo-hlr_10.42.42.2(pid=29722): Launched 13:53:30.074514 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:30.590348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29724): Launched 13:53:30.909784 run osmo-stp_10.42.42.5(pid=29725): Launched 13:53:31.187686 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:31.787515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29727): Launched 13:53:31.910212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:32.171600 run patchelf(pid=29728): Launched 13:53:32.353479 run osmo-stp_10.42.42.5(pid=29725): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29725)] 13:53:32.480090 run osmo-stp_10.42.42.5(pid=29725): stdout: | (launched: 2022-12-14_13:53:30.836684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:32.607963 run osmo-stp_10.42.42.5(pid=29725): stderr: | 20221214135331104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135331104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135331104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135331104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135331105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135331105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135331105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:32.735304 run osmo-stp_10.42.42.5(pid=29725): stdout: | (launched: 2022-12-14_13:53:30.836684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:32.856793 run osmo-stp_10.42.42.5(pid=29725): stderr: | 20221214135331104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135331104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135331104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135331104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135331105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135331105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135331105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:33.001067 run patchelf(pid=29728): Terminating (SIGINT) 13:53:33.166555 run patchelf(pid=29728): Terminated: ok {rc=0} 13:53:33.285971 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29725): Process ended prematurely: osmo-stp_10.42.42.5(pid=29725) [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29725)] [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:53:33.295074 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 13:53:33.321916 run osmo-hlr_10.42.42.2(pid=29722): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29722)] 13:53:33.369720 run osmo-hlr_10.42.42.2(pid=29722): stdout: | (launched: 2022-12-14_13:53:29.894270) 13:53:33.419169 run osmo-hlr_10.42.42.2(pid=29722): stderr: | 20221214135330091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135330091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135330092 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135330092 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135330092 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135330092 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135330118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135330127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135330127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135330127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:33.469602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29721): Terminating (SIGTERM) 13:53:33.509418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29724): Terminating (SIGTERM) 13:53:33.549731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29727): Terminating (SIGTERM) 13:53:33.589757 --- ParallelTerminationStrategy: PID 29721 died... 13:53:33.608779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29721): Terminated: ok {rc=0} 13:53:33.652775 --- ParallelTerminationStrategy: PID 29724 died... 13:53:33.671266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29724): Terminated: ok {rc=0} 13:53:33.715292 --- ParallelTerminationStrategy: PID 29727 died... 13:53:33.733908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29727): Terminated: ok {rc=0} 13:53:33.819451 bus /gobi_0: Setting Powered False 13:53:34.918502 bus /gobi_0: Setting Powered False 13:53:36.033556 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 13:53:37.288642 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:37.294240 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 13:53:37.322753 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 13:53:37.356982 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 13:53:37.410969 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 13:53:37.439971 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 13:53:37.473466 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 13:53:38.029843 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 13:53:38.037361 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:38.050228 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 13:53:38.120669 tst switch_tch_pdch.py: using LAC 41349 13:53:38.246750 tst switch_tch_pdch.py: using RAC 39 13:53:38.375114 tst switch_tch_pdch.py: using CellId 41349 13:53:38.498885 tst switch_tch_pdch.py: using BVCI 41350 13:53:38.613925 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:38.625513 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:38.636800 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:38.648214 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:38.659870 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:38.671584 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:38.683317 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 13:53:38.694945 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:53:38.808348 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 13:53:38.926738 tst switch_tch_pdch.py:51: start network... 13:53:39.140310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:39.603524 run create_hlr_db(pid=29733): Launched 13:53:39.725094 bus /gobi_6: Setting Powered False 13:53:40.788668 run create_hlr_db(pid=29733): Terminated: ok {rc=0} 13:53:41.189113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29735): Launched 13:53:41.506560 run osmo-hlr_10.42.42.2(pid=29736): Launched 13:53:41.628222 run osmo-stp_10.42.42.5: Starting osmo-stp 13:53:42.150830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29738): Launched 13:53:42.468517 run osmo-stp_10.42.42.5(pid=29739): Launched 13:53:42.589519 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:53:43.079866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29741): Launched 13:53:43.192692 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:53:43.442143 run patchelf(pid=29742): Launched 13:53:43.607508 run osmo-stp_10.42.42.5(pid=29739): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29739)] 13:53:43.733166 run osmo-stp_10.42.42.5(pid=29739): stdout: | (launched: 2022-12-14_13:53:42.410374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:43.859821 run osmo-stp_10.42.42.5(pid=29739): stderr: | 20221214135342605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135342605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135342605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135342606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135342606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135342606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135342606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:43.986473 run osmo-stp_10.42.42.5(pid=29739): stdout: | (launched: 2022-12-14_13:53:42.410374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:53:44.107782 run osmo-stp_10.42.42.5(pid=29739): stderr: | 20221214135342605 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135342605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135342605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135342606 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135342606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135342606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135342606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:53:44.251419 run patchelf(pid=29742): Terminating (SIGINT) 13:53:44.417325 run patchelf(pid=29742): Terminated: ok {rc=0} 13:53:44.536687 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=29739): Process ended prematurely: osmo-stp_10.42.42.5(pid=29739) [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29739)] [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 13:53:44.545457 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:53:44.571920 run osmo-hlr_10.42.42.2(pid=29736): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29736)] 13:53:44.619231 run osmo-hlr_10.42.42.2(pid=29736): stdout: | (launched: 2022-12-14_13:53:41.448543) 13:53:44.668339 run osmo-hlr_10.42.42.2(pid=29736): stderr: | 20221214135341647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135341647 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135341647 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135341647 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135341647 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135341647 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135341658 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135341667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135341667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135341667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:53:44.718168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29735): Terminating (SIGTERM) 13:53:44.757599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29738): Terminating (SIGTERM) 13:53:44.797631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29741): Terminating (SIGTERM) 13:53:44.837356 --- ParallelTerminationStrategy: PID 29735 died... 13:53:44.856320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29735): Terminated: ok {rc=0} 13:53:44.900155 --- ParallelTerminationStrategy: PID 29738 died... 13:53:44.918722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29738): Terminated: ok {rc=0} 13:53:44.962261 --- ParallelTerminationStrategy: PID 29741 died... 13:53:44.980770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=29741): Terminated: ok {rc=0} 13:53:45.065781 bus /gobi_0: Setting Powered False 13:53:46.170740 bus /gobi_0: Setting Powered False 13:53:47.303793 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_sms:nanobts --------------------------------------------------------------------- 13:53:48.559839 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:48.563858 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 13:53:48.588149 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 13:53:48.595232 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 13:53:48.648060 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 13:53:48.672182 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 13:53:48.679035 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 13:53:49.216172 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 13:53:49.221388 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 13:53:49.232086 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 13:53:49.271875 tst mo_mt_sms.py: using LAC 41350 13:53:49.395508 tst mo_mt_sms.py: using RAC 40 13:53:49.511424 tst mo_mt_sms.py: using CellId 41350 13:53:49.626745 tst mo_mt_sms.py: using BVCI 41351 13:53:49.735522 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 13:53:49.854390 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 13:53:49.968669 tst mo_mt_sms.py:9: start nitb and bts... 13:53:50.166670 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:53:50.771647 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29746): Launched 13:53:51.067660 run osmo-nitb_10.42.42.2(pid=29747): Launched 13:53:51.232176 run osmo-nitb_10.42.42.2(pid=29747): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29747)] 13:53:51.365199 run osmo-nitb_10.42.42.2(pid=29747): stdout: | (launched: 2022-12-14_13:53:51.013144) 13:53:51.499264 run osmo-nitb_10.42.42.2(pid=29747): stderr: | (launched: 2022-12-14_13:53:51.057350) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:53:51.633291 run osmo-nitb_10.42.42.2(pid=29747): stdout: | (launched: 2022-12-14_13:53:51.013144) 13:53:51.761843 run osmo-nitb_10.42.42.2(pid=29747): stderr: | (launched: 2022-12-14_13:53:51.057350) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=29747): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29747) [trial-2405↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29747)] 13:53:52.179976 tst osmo-nitb_10.42.42.2(pid=29747): stdout: | (launched: 2022-12-14_13:53:51.013144) 13:53:52.299332 tst osmo-nitb_10.42.42.2(pid=29747): stderr: | (launched: 2022-12-14_13:53:51.057350) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:53:52.440198 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=29747): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29747) [trial-2405↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29747)] [trial-2405↪nitb_sms:nanobts↪mo_mt_sms.py:11] 13:53:52.448462 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 13:53:52.455007 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29746): Terminating (SIGTERM) 13:53:52.663147 --- ParallelTerminationStrategy: PID 29746 died... 13:53:52.683753 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=29746): Terminated: ok {rc=0} 13:53:52.769983 bus /sierra_3: Setting Powered False 13:53:53.869779 bus /sierra_3: Setting Powered False 13:53:54.987469 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 sms:nanobts+band-1900 --------------------------------------------------------------------- 13:53:56.172906 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:53:56.178303 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:53:56.202245 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 13:53:56.229970 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 13:53:56.283046 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:53:56.306747 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 13:53:56.332556 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 13:53:56.882517 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 13:53:56.887618 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:53:56.898740 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:53:56.936791 tst mo_mt_sms.py: using LAC 41351 13:53:57.060399 tst mo_mt_sms.py: using RAC 41 13:53:57.184712 tst mo_mt_sms.py: using CellId 41351 13:53:57.309966 tst mo_mt_sms.py: using BVCI 41352 13:53:57.424791 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:53:57.436055 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:53:57.447049 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:53:57.457990 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:53:57.469210 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:53:57.480258 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 13:53:57.593650 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 13:53:57.711314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:53:58.204203 run create_hlr_db(pid=29751): Launched 13:53:58.325598 bus /sierra_2: Setting Powered False 13:53:59.388719 run create_hlr_db(pid=29751): Terminated: ok {rc=0} 13:53:59.812554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29753): Launched 13:54:00.108284 run osmo-hlr_10.42.42.2(pid=29754): Launched 13:54:00.220918 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:00.746208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29756): Launched 13:54:01.093932 run osmo-stp_10.42.42.5(pid=29757): Launched 13:54:01.248283 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:02.113602 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29791): Launched 13:54:02.537666 run osmo-msc_10.42.42.6(pid=29808): Launched 13:54:02.842253 run osmo-stp_10.42.42.5(pid=29757): ERR: Terminated: ERROR {rc=1} [trial-2405↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29757)] 13:54:03.057556 run osmo-stp_10.42.42.5(pid=29757): stdout: | (launched: 2022-12-14_13:54:01.020341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:03.444888 run osmo-stp_10.42.42.5(pid=29757): stderr: | 20221214135401386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135401388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135401390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135401392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135401394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135401395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135401395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:03.650127 run osmo-stp_10.42.42.5(pid=29757): stdout: | (launched: 2022-12-14_13:54:01.020341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:03.798779 run osmo-stp_10.42.42.5(pid=29757): stderr: | 20221214135401386 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135401388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135401390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135401392 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135401394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135401395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135401395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:03.981929 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=29757): Process ended prematurely: osmo-stp_10.42.42.5(pid=29757) [trial-2405↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29757)] [trial-2405↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 13:54:03.995888 tst mo_mt_sms.py:16: Test FAILED (7.1 sec) 13:54:04.024668 run osmo-hlr_10.42.42.2(pid=29754): ERR: Terminated: ERROR {rc=237} [trial-2405↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=29754)] 13:54:04.087126 run osmo-hlr_10.42.42.2(pid=29754): stdout: | (launched: 2022-12-14_13:54:00.053881) 13:54:04.153509 run osmo-hlr_10.42.42.2(pid=29754): stderr: | 20221214135400230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135400230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135400230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135400230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135400230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135400230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135400242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135400253 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135400253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135400253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:04.234688 run osmo-msc_10.42.42.6(pid=29808): ERR: Terminated: ERROR {rc=2} [trial-2405↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=29808)] 13:54:04.296583 run osmo-msc_10.42.42.6(pid=29808): stdout: | (launched: 2022-12-14_13:54:02.472746) 13:54:04.360482 run osmo-msc_10.42.42.6(pid=29808): stderr: | 20221214135403017 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135403018 DLGLOBAL DEBUG validating counter group 0x7f12e6b2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135403018 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135403018 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135403018 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135403018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135403020 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135403020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135403020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135403029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:04.430124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29753): Terminating (SIGTERM) 13:54:04.479009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29756): Terminating (SIGTERM) 13:54:04.528842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29791): Terminating (SIGTERM) 13:54:04.580580 --- ParallelTerminationStrategy: PID 29753 died... 13:54:04.606299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=29753): Terminated: ok {rc=0} 13:54:04.670090 --- ParallelTerminationStrategy: PID 29756 died... 13:54:04.690253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=29756): Terminated: ok {rc=0} 13:54:04.745889 --- ParallelTerminationStrategy: PID 29791 died... 13:54:04.770095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=29791): Terminated: ok {rc=0} 13:54:04.873958 bus /sierra_3: Setting Powered False 13:54:05.994684 bus /sierra_3: Setting Powered False 13:54:07.115524 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 13:54:08.342862 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:08.347763 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:54:08.371505 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 13:54:08.378557 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 13:54:08.413417 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:54:08.437392 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 13:54:08.444390 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 13:54:08.962374 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 13:54:08.968787 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 13:54:08.980898 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:54:09.021222 tst assert_extension.py: using LAC 41352 13:54:09.138266 tst assert_extension.py: using RAC 42 13:54:09.256439 tst assert_extension.py: using CellId 41352 13:54:09.375821 tst assert_extension.py: using BVCI 41353 13:54:09.486268 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 13:54:09.604052 tst assert_extension.py:10: start nitb and bts... 13:54:09.807223 run osmo-nitb_10.42.42.2: Starting osmo-nitb 13:54:10.439105 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30036): Launched 13:54:10.766293 run osmo-nitb_10.42.42.2(pid=30037): Launched 13:54:10.955591 run osmo-nitb_10.42.42.2(pid=30037): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30037)] 13:54:11.093548 run osmo-nitb_10.42.42.2(pid=30037): stdout: | (launched: 2022-12-14_13:54:10.701580) 13:54:11.232030 run osmo-nitb_10.42.42.2(pid=30037): stderr: | (launched: 2022-12-14_13:54:10.746531) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:54:11.369796 run osmo-nitb_10.42.42.2(pid=30037): stdout: | (launched: 2022-12-14_13:54:10.701580) 13:54:11.502492 run osmo-nitb_10.42.42.2(pid=30037): stderr: | (launched: 2022-12-14_13:54:10.746531) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30037): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30037) [trial-2405↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30037)] 13:54:11.900867 tst osmo-nitb_10.42.42.2(pid=30037): stdout: | (launched: 2022-12-14_13:54:10.701580) 13:54:12.037554 tst osmo-nitb_10.42.42.2(pid=30037): stderr: | (launched: 2022-12-14_13:54:10.746531) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 13:54:12.181848 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30037): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30037) [trial-2405↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30037)] [trial-2405↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 13:54:12.190771 tst assert_extension.py:12: Test FAILED (3.2 sec) 13:54:12.197893 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30036): Terminating (SIGTERM) 13:54:12.408020 --- ParallelTerminationStrategy: PID 30036 died... 13:54:12.430062 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30036): Terminated: ok {rc=0} 13:54:12.518115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 ussd:nanobts+band-1900 --------------------------------------------------------------------- 13:54:13.700597 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:13.706601 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:54:13.731375 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 13:54:13.760319 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 13:54:13.800942 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:54:13.826054 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 13:54:13.853707 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 13:54:14.376446 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 13:54:14.383124 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:54:14.395358 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:54:14.435395 tst assert_extension.py: using LAC 41353 13:54:14.554395 tst assert_extension.py: using RAC 43 13:54:14.675600 tst assert_extension.py: using CellId 41353 13:54:14.796683 tst assert_extension.py: using BVCI 41354 13:54:14.908602 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:54:14.920251 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:54:14.932353 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:54:14.944076 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:54:14.956348 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:54:14.968326 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 13:54:15.086727 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:15.568989 run create_hlr_db(pid=30041): Launched 13:54:15.728086 bus /sierra_2: Setting Powered False 13:54:16.813040 run create_hlr_db(pid=30041): Terminated: ok {rc=0} 13:54:17.274206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30043): Launched 13:54:17.604009 run osmo-hlr_10.42.42.2(pid=30044): Launched 13:54:17.775500 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:18.415365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30046): Launched 13:54:18.728242 run osmo-stp_10.42.42.5(pid=30047): Launched 13:54:18.970030 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:19.691802 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30049): Launched 13:54:20.022545 run osmo-msc_10.42.42.6(pid=30050): Launched 13:54:20.368590 run osmo-stp_10.42.42.5(pid=30047): ERR: Terminated: ERROR {rc=1} [trial-2405↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30047)] 13:54:20.633821 run osmo-stp_10.42.42.5(pid=30047): stdout: | (launched: 2022-12-14_13:54:18.665926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:20.907728 run osmo-stp_10.42.42.5(pid=30047): stderr: | 20221214135419004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135419004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135419004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135419005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135419005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135419005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135419005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:21.096617 run osmo-stp_10.42.42.5(pid=30047): stdout: | (launched: 2022-12-14_13:54:18.665926) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:21.220720 run osmo-stp_10.42.42.5(pid=30047): stderr: | 20221214135419004 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135419004 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135419004 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135419005 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135419005 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135419005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135419005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:21.367051 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30047): Process ended prematurely: osmo-stp_10.42.42.5(pid=30047) [trial-2405↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30047)] [trial-2405↪ussd:nanobts+band-1900↪assert_extension.py:17] 13:54:21.376427 tst assert_extension.py:17: Test FAILED (7.0 sec) 13:54:21.403834 run osmo-hlr_10.42.42.2(pid=30044): ERR: Terminated: ERROR {rc=237} [trial-2405↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30044)] 13:54:21.455088 run osmo-hlr_10.42.42.2(pid=30044): stdout: | (launched: 2022-12-14_13:54:17.538990) 13:54:21.508844 run osmo-hlr_10.42.42.2(pid=30044): stderr: | 20221214135417898 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135417898 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135417899 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135417899 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135417899 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135417899 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135417916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135417924 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135417925 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135417925 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:21.581840 run osmo-msc_10.42.42.6(pid=30050): ERR: Terminated: ERROR {rc=2} [trial-2405↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30050)] 13:54:21.633170 run osmo-msc_10.42.42.6(pid=30050): stdout: | (launched: 2022-12-14_13:54:19.953957) 13:54:21.686161 run osmo-msc_10.42.42.6(pid=30050): stderr: | 20221214135420558 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135420559 DLGLOBAL DEBUG validating counter group 0x7fb417a80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135420559 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135420559 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135420559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135420559 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135420561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135420561 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135420561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135420562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:21.738782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30043): Terminating (SIGTERM) 13:54:21.780525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30046): Terminating (SIGTERM) 13:54:21.826486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30049): Terminating (SIGTERM) 13:54:21.872434 --- ParallelTerminationStrategy: PID 30043 died... 13:54:21.894362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30043): Terminated: ok {rc=0} 13:54:21.942994 --- ParallelTerminationStrategy: PID 30046 died... 13:54:21.963556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30046): Terminated: ok {rc=0} 13:54:22.013106 --- ParallelTerminationStrategy: PID 30049 died... 13:54:22.033116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30049): Terminated: ok {rc=0} 13:54:22.122455 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 13:54:23.322171 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:23.330740 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 13:54:23.355791 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 13:54:23.386418 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 13:54:23.440548 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 13:54:23.465480 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 13:54:23.496255 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 13:54:24.045648 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 13:54:24.099591 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:24.111921 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:54:24.174466 tst mo_mt_call.py: using LAC 41354 13:54:24.299691 tst mo_mt_call.py: using RAC 44 13:54:24.425196 tst mo_mt_call.py: using CellId 41354 13:54:24.551713 tst mo_mt_call.py: using BVCI 41355 13:54:24.668176 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:24.680535 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:24.693331 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:24.705706 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:24.717965 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:24.730477 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:54:24.850828 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:54:24.969885 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:25.468930 run create_hlr_db(pid=30056): Launched 13:54:25.592130 bus /sierra_2: Setting Powered False 13:54:26.656807 run create_hlr_db(pid=30056): Terminated: ok {rc=0} 13:54:27.089649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30058): Launched 13:54:27.391576 run osmo-hlr_10.42.42.2(pid=30059): Launched 13:54:27.507054 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:28.041305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30061): Launched 13:54:28.341652 run osmo-stp_10.42.42.5(pid=30062): Launched 13:54:28.455402 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:28.999198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30064): Launched 13:54:29.302099 run osmo-msc_10.42.42.6(pid=30065): Launched 13:54:29.470386 run osmo-stp_10.42.42.5(pid=30062): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30062)] 13:54:29.598409 run osmo-stp_10.42.42.5(pid=30062): stdout: | (launched: 2022-12-14_13:54:28.286528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:29.725832 run osmo-stp_10.42.42.5(pid=30062): stderr: | 20221214135428456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135428457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135428457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135428457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135428459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135428460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135428460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:29.851957 run osmo-stp_10.42.42.5(pid=30062): stdout: | (launched: 2022-12-14_13:54:28.286528) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:29.972317 run osmo-stp_10.42.42.5(pid=30062): stderr: | 20221214135428456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135428457 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135428457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135428457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135428459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135428460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135428460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:30.116405 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30062): Process ended prematurely: osmo-stp_10.42.42.5(pid=30062) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30062)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 13:54:30.125376 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 13:54:30.151827 run osmo-hlr_10.42.42.2(pid=30059): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30059)] 13:54:30.199333 run osmo-hlr_10.42.42.2(pid=30059): stdout: | (launched: 2022-12-14_13:54:27.336166) 13:54:30.249179 run osmo-hlr_10.42.42.2(pid=30059): stderr: | 20221214135427514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135427515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135427515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135427515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135427515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135427515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135427527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135427538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135427538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135427538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:30.318052 run osmo-msc_10.42.42.6(pid=30065): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30065)] 13:54:30.365658 run osmo-msc_10.42.42.6(pid=30065): stdout: | (launched: 2022-12-14_13:54:29.246584) 13:54:30.414581 run osmo-msc_10.42.42.6(pid=30065): stderr: | 20221214135429517 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135429517 DLGLOBAL DEBUG validating counter group 0x7f0413e8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135429518 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135429518 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135429518 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135429518 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135429522 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135429522 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135429522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135429522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:30.463725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30058): Terminating (SIGTERM) 13:54:30.502889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30061): Terminating (SIGTERM) 13:54:30.542510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30064): Terminating (SIGTERM) 13:54:30.581950 --- ParallelTerminationStrategy: PID 30058 died... 13:54:30.601054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30058): Terminated: ok {rc=0} 13:54:30.644893 --- ParallelTerminationStrategy: PID 30061 died... 13:54:30.663692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30061): Terminated: ok {rc=0} 13:54:30.707163 --- ParallelTerminationStrategy: PID 30064 died... 13:54:30.725603 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30064): Terminated: ok {rc=0} 13:54:30.811025 bus /sierra_3: Setting Powered False 13:54:31.934806 bus /sierra_3: Setting Powered False 13:54:33.047978 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 13:54:34.196869 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:34.209201 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 13:54:34.270673 tst mo_mt_call_osmux.py: using LAC 41355 13:54:34.399918 tst mo_mt_call_osmux.py: using RAC 45 13:54:34.525578 tst mo_mt_call_osmux.py: using CellId 41355 13:54:34.644325 tst mo_mt_call_osmux.py: using BVCI 41356 13:54:34.753618 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:34.764840 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:34.775958 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:34.787129 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:34.799180 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 13:54:34.810950 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:54:34.931161 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 13:54:35.047773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:35.514986 run create_hlr_db(pid=30067): Launched 13:54:35.638626 bus /sierra_2: Setting Powered False 13:54:36.699133 run create_hlr_db(pid=30067): Terminated: ok {rc=0} 13:54:37.140674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30069): Launched 13:54:37.463964 run osmo-hlr_10.42.42.2(pid=30070): Launched 13:54:37.587361 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:38.144823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30072): Launched 13:54:38.467575 run osmo-stp_10.42.42.5(pid=30073): Launched 13:54:38.591093 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:39.176902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30075): Launched 13:54:39.501247 run osmo-msc_10.42.42.6(pid=30076): Launched 13:54:39.682891 run osmo-stp_10.42.42.5(pid=30073): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30073)] 13:54:39.819829 run osmo-stp_10.42.42.5(pid=30073): stdout: | (launched: 2022-12-14_13:54:38.408779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:39.958560 run osmo-stp_10.42.42.5(pid=30073): stderr: | 20221214135438599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135438599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135438600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135438600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135438601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135438601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135438601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:40.095516 run osmo-stp_10.42.42.5(pid=30073): stdout: | (launched: 2022-12-14_13:54:38.408779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:40.224889 run osmo-stp_10.42.42.5(pid=30073): stderr: | 20221214135438599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135438599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135438600 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135438600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135438601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135438601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135438601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:40.379708 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30073): Process ended prematurely: osmo-stp_10.42.42.5(pid=30073) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30073)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 13:54:40.389347 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:54:40.417149 run osmo-hlr_10.42.42.2(pid=30070): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30070)] 13:54:40.468088 run osmo-hlr_10.42.42.2(pid=30070): stdout: | (launched: 2022-12-14_13:54:37.405230) 13:54:40.520521 run osmo-hlr_10.42.42.2(pid=30070): stderr: | 20221214135437604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135437604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135437604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135437604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135437604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135437604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135437616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135437624 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135437625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135437625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:40.593572 run osmo-msc_10.42.42.6(pid=30076): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30076)] 13:54:40.643849 run osmo-msc_10.42.42.6(pid=30076): stdout: | (launched: 2022-12-14_13:54:39.442150) 13:54:40.695845 run osmo-msc_10.42.42.6(pid=30076): stderr: | 20221214135439764 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135439764 DLGLOBAL DEBUG validating counter group 0x7fad41e98c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135439764 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135439764 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135439764 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135439765 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135439766 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135439767 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135439767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135439767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:40.748261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30069): Terminating (SIGTERM) 13:54:40.790168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30072): Terminating (SIGTERM) 13:54:40.832536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30075): Terminating (SIGTERM) 13:54:40.875351 --- ParallelTerminationStrategy: PID 30069 died... 13:54:40.895668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30069): Terminated: ok {rc=0} 13:54:40.942053 --- ParallelTerminationStrategy: PID 30072 died... 13:54:40.961825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30072): Terminated: ok {rc=0} 13:54:41.008032 --- ParallelTerminationStrategy: PID 30075 died... 13:54:41.027861 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30075): Terminated: ok {rc=0} 13:54:41.115655 bus /sierra_3: Setting Powered False 13:54:42.213519 bus /sierra_3: Setting Powered False 13:54:43.328230 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 13:54:44.571268 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:54:44.578415 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 13:54:44.602060 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 13:54:44.628416 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 13:54:44.679414 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 13:54:44.703041 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 13:54:44.728842 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 13:54:45.284731 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 13:54:45.334759 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:45.346095 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:54:45.403539 tst mo_mt_call.py: using LAC 41356 13:54:45.521539 tst mo_mt_call.py: using RAC 46 13:54:45.640455 tst mo_mt_call.py: using CellId 41356 13:54:45.756025 tst mo_mt_call.py: using BVCI 41357 13:54:45.865813 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:45.877525 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:45.888831 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:45.900522 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:45.912254 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:45.923664 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:54:46.050135 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:54:46.167064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:46.702478 run create_hlr_db(pid=30082): Launched 13:54:46.862042 bus /sierra_2: Setting Powered False 13:54:47.921952 run create_hlr_db(pid=30082): Terminated: ok {rc=0} 13:54:48.362909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30084): Launched 13:54:48.686035 run osmo-hlr_10.42.42.2(pid=30085): Launched 13:54:48.809282 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:49.364351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30087): Launched 13:54:49.687220 run osmo-stp_10.42.42.5(pid=30088): Launched 13:54:49.810442 run osmo-msc_10.42.42.6: Starting osmo-msc 13:54:50.394098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30090): Launched 13:54:50.717505 run osmo-msc_10.42.42.6(pid=30091): Launched 13:54:50.898412 run osmo-stp_10.42.42.5(pid=30088): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30088)] 13:54:51.034798 run osmo-stp_10.42.42.5(pid=30088): stdout: | (launched: 2022-12-14_13:54:49.628539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:51.172750 run osmo-stp_10.42.42.5(pid=30088): stderr: | 20221214135449821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135449822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135449822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135449822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135449823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135449823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135449823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:51.309955 run osmo-stp_10.42.42.5(pid=30088): stdout: | (launched: 2022-12-14_13:54:49.628539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:54:51.439608 run osmo-stp_10.42.42.5(pid=30088): stderr: | 20221214135449821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135449822 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135449822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135449822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135449823 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135449823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135449823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:54:51.594306 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30088): Process ended prematurely: osmo-stp_10.42.42.5(pid=30088) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30088)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 13:54:51.603903 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 13:54:51.631735 run osmo-hlr_10.42.42.2(pid=30085): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30085)] 13:54:51.682441 run osmo-hlr_10.42.42.2(pid=30085): stdout: | (launched: 2022-12-14_13:54:48.627177) 13:54:51.734419 run osmo-hlr_10.42.42.2(pid=30085): stderr: | 20221214135448827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135448827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135448827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135448827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135448827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135448827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135448840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135448848 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135448848 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135448848 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:54:51.806823 run osmo-msc_10.42.42.6(pid=30091): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30091)] 13:54:51.856942 run osmo-msc_10.42.42.6(pid=30091): stdout: | (launched: 2022-12-14_13:54:50.658631) 13:54:51.908766 run osmo-msc_10.42.42.6(pid=30091): stderr: | 20221214135450979 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135450979 DLGLOBAL DEBUG validating counter group 0x7ff624285c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135450979 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135450979 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135450979 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135450980 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135450983 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135450984 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135450984 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135450984 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:54:51.960878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30084): Terminating (SIGTERM) 13:54:52.002336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30087): Terminating (SIGTERM) 13:54:52.044077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30090): Terminating (SIGTERM) 13:54:52.086195 --- ParallelTerminationStrategy: PID 30084 died... 13:54:52.106732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30084): Terminated: ok {rc=0} 13:54:52.153226 --- ParallelTerminationStrategy: PID 30087 died... 13:54:52.172846 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30087): Terminated: ok {rc=0} 13:54:52.219149 --- ParallelTerminationStrategy: PID 30090 died... 13:54:52.238888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30090): Terminated: ok {rc=0} 13:54:52.327798 bus /sierra_3: Setting Powered False 13:54:53.426790 bus /sierra_3: Setting Powered False 13:54:54.545104 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 13:54:55.689547 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:55.701215 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 13:54:55.760683 tst mo_mt_call_osmux.py: using LAC 41357 13:54:55.880303 tst mo_mt_call_osmux.py: using RAC 47 13:54:56.000833 tst mo_mt_call_osmux.py: using CellId 41357 13:54:56.120389 tst mo_mt_call_osmux.py: using BVCI 41358 13:54:56.238821 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:56.250592 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:56.262204 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:56.273903 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:56.285945 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 13:54:56.297686 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:54:56.417462 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 13:54:56.534465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:54:57.002144 run create_hlr_db(pid=30093): Launched 13:54:57.126652 bus /sierra_2: Setting Powered False 13:54:58.186753 run create_hlr_db(pid=30093): Terminated: ok {rc=0} 13:54:58.628419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30095): Launched 13:54:58.952229 run osmo-hlr_10.42.42.2(pid=30096): Launched 13:54:59.075293 run osmo-stp_10.42.42.5: Starting osmo-stp 13:54:59.631814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30098): Launched 13:54:59.956643 run osmo-stp_10.42.42.5(pid=30099): Launched 13:55:00.080392 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:00.665294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30101): Launched 13:55:01.010801 run osmo-msc_10.42.42.6(pid=30102): Launched 13:55:01.480230 run osmo-stp_10.42.42.5(pid=30099): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30099)] 13:55:01.848036 run osmo-stp_10.42.42.5(pid=30099): stdout: | (launched: 2022-12-14_13:54:59.897451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:02.035013 run osmo-stp_10.42.42.5(pid=30099): stderr: | 20221214135500093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135500093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135500093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135500094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135500094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135500094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135500094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:02.163122 run osmo-stp_10.42.42.5(pid=30099): stdout: | (launched: 2022-12-14_13:54:59.897451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:02.286689 run osmo-stp_10.42.42.5(pid=30099): stderr: | 20221214135500093 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135500093 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135500093 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135500094 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135500094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135500094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135500094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:02.435459 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30099): Process ended prematurely: osmo-stp_10.42.42.5(pid=30099) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30099)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 13:55:02.444679 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 13:55:02.471787 run osmo-hlr_10.42.42.2(pid=30096): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30096)] 13:55:02.520851 run osmo-hlr_10.42.42.2(pid=30096): stdout: | (launched: 2022-12-14_13:54:58.893542) 13:55:02.570533 run osmo-hlr_10.42.42.2(pid=30096): stderr: | 20221214135459094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135459094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135459094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135459094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135459094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135459094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135459107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135459117 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135459117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135459117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:02.639532 run osmo-msc_10.42.42.6(pid=30102): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30102)] 13:55:02.687209 run osmo-msc_10.42.42.6(pid=30102): stdout: | (launched: 2022-12-14_13:55:00.947497) 13:55:02.736392 run osmo-msc_10.42.42.6(pid=30102): stderr: | 20221214135501558 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135501558 DLGLOBAL DEBUG validating counter group 0x7ff2b14c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135501558 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135501558 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135501559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135501559 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135501560 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135501564 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135501564 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135501564 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:02.786074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30095): Terminating (SIGTERM) 13:55:02.826364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30098): Terminating (SIGTERM) 13:55:02.866314 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30101): Terminating (SIGTERM) 13:55:02.906074 --- ParallelTerminationStrategy: PID 30095 died... 13:55:02.924846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30095): Terminated: ok {rc=0} 13:55:02.968864 --- ParallelTerminationStrategy: PID 30098 died... 13:55:02.987432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30098): Terminated: ok {rc=0} 13:55:03.031213 --- ParallelTerminationStrategy: PID 30101 died... 13:55:03.049865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30101): Terminated: ok {rc=0} 13:55:03.133070 bus /sierra_3: Setting Powered False 13:55:04.229667 bus /sierra_3: Setting Powered False 13:55:05.340904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 13:55:06.578808 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:06.585990 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 13:55:06.609341 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 13:55:06.636931 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 13:55:06.692324 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 13:55:06.716259 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 13:55:06.742220 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 13:55:07.296155 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 13:55:07.350955 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:07.362742 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:55:07.422058 tst mo_mt_call.py: using LAC 41358 13:55:07.546667 tst mo_mt_call.py: using RAC 48 13:55:07.671936 tst mo_mt_call.py: using CellId 41358 13:55:07.795946 tst mo_mt_call.py: using BVCI 41359 13:55:07.913475 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:07.925100 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:07.936470 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:07.947966 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:07.959962 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:07.971826 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:55:08.088643 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:55:08.207603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:08.708282 run create_hlr_db(pid=30110): Launched 13:55:08.831596 bus /sierra_2: Setting Powered False 13:55:09.895930 run create_hlr_db(pid=30110): Terminated: ok {rc=0} 13:55:10.327819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30112): Launched 13:55:10.630529 run osmo-hlr_10.42.42.2(pid=30113): Launched 13:55:10.745875 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:11.263070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30115): Launched 13:55:11.565248 run osmo-stp_10.42.42.5(pid=30116): Launched 13:55:11.680076 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:12.223652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30118): Launched 13:55:12.525076 run osmo-msc_10.42.42.6(pid=30119): Launched 13:55:12.693784 run osmo-stp_10.42.42.5(pid=30116): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30116)] 13:55:12.820862 run osmo-stp_10.42.42.5(pid=30116): stdout: | (launched: 2022-12-14_13:55:11.509486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:12.948003 run osmo-stp_10.42.42.5(pid=30116): stderr: | 20221214135511682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135511682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135511682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135511683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135511683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135511683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135511683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:13.073204 run osmo-stp_10.42.42.5(pid=30116): stdout: | (launched: 2022-12-14_13:55:11.509486) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:13.192684 run osmo-stp_10.42.42.5(pid=30116): stderr: | 20221214135511682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135511682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135511682 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135511683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135511683 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135511683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135511683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:13.335982 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30116): Process ended prematurely: osmo-stp_10.42.42.5(pid=30116) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30116)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 13:55:13.344726 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 13:55:13.370857 run osmo-hlr_10.42.42.2(pid=30113): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30113)] 13:55:13.418320 run osmo-hlr_10.42.42.2(pid=30113): stdout: | (launched: 2022-12-14_13:55:10.575020) 13:55:13.467276 run osmo-hlr_10.42.42.2(pid=30113): stderr: | 20221214135510752 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135510752 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135510752 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135510752 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135510752 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135510752 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135510764 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135510773 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135510774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135510774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:13.536138 run osmo-msc_10.42.42.6(pid=30119): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30119)] 13:55:13.582994 run osmo-msc_10.42.42.6(pid=30119): stdout: | (launched: 2022-12-14_13:55:12.469087) 13:55:13.631296 run osmo-msc_10.42.42.6(pid=30119): stderr: | 20221214135512741 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135512741 DLGLOBAL DEBUG validating counter group 0x7f6d77439c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135512741 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135512741 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135512741 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135512741 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135512743 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135512743 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135512743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135512744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:13.679996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30112): Terminating (SIGTERM) 13:55:13.718941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30115): Terminating (SIGTERM) 13:55:13.758031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30118): Terminating (SIGTERM) 13:55:13.797470 --- ParallelTerminationStrategy: PID 30112 died... 13:55:13.816434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30112): Terminated: ok {rc=0} 13:55:13.859716 --- ParallelTerminationStrategy: PID 30115 died... 13:55:13.878199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30115): Terminated: ok {rc=0} 13:55:13.921644 --- ParallelTerminationStrategy: PID 30118 died... 13:55:13.939944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30118): Terminated: ok {rc=0} 13:55:14.024556 bus /sierra_3: Setting Powered False 13:55:15.122380 bus /sierra_3: Setting Powered False 13:55:16.247959 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 13:55:17.390253 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:17.402347 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 13:55:17.462572 tst mo_mt_call_osmux.py: using LAC 41359 13:55:17.580810 tst mo_mt_call_osmux.py: using RAC 49 13:55:17.698771 tst mo_mt_call_osmux.py: using CellId 41359 13:55:17.818240 tst mo_mt_call_osmux.py: using BVCI 41360 13:55:17.928352 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:17.940408 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:17.951629 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:17.962947 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:17.974159 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 13:55:17.985396 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:55:18.101189 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 13:55:18.216572 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:18.682563 run create_hlr_db(pid=30121): Launched 13:55:18.805225 bus /sierra_2: Setting Powered False 13:55:19.865462 run create_hlr_db(pid=30121): Terminated: ok {rc=0} 13:55:20.306494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30123): Launched 13:55:20.630465 run osmo-hlr_10.42.42.2(pid=30124): Launched 13:55:20.754743 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:21.314319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30126): Launched 13:55:21.638424 run osmo-stp_10.42.42.5(pid=30127): Launched 13:55:21.761977 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:22.352240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30129): Launched 13:55:22.676064 run osmo-msc_10.42.42.6(pid=30130): Launched 13:55:22.855482 run osmo-stp_10.42.42.5(pid=30127): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30127)] 13:55:22.991508 run osmo-stp_10.42.42.5(pid=30127): stdout: | (launched: 2022-12-14_13:55:21.579333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:23.128233 run osmo-stp_10.42.42.5(pid=30127): stderr: | 20221214135521773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135521773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135521773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135521774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135521774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135521774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135521774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:23.263822 run osmo-stp_10.42.42.5(pid=30127): stdout: | (launched: 2022-12-14_13:55:21.579333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:23.393181 run osmo-stp_10.42.42.5(pid=30127): stderr: | 20221214135521773 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135521773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135521773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135521774 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135521774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135521774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135521774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:23.547986 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30127): Process ended prematurely: osmo-stp_10.42.42.5(pid=30127) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30127)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 13:55:23.557610 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:55:23.585210 run osmo-hlr_10.42.42.2(pid=30124): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30124)] 13:55:23.636136 run osmo-hlr_10.42.42.2(pid=30124): stdout: | (launched: 2022-12-14_13:55:20.571720) 13:55:23.687947 run osmo-hlr_10.42.42.2(pid=30124): stderr: | 20221214135520770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135520770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135520770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135520770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135520770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135520770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135520785 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135520793 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135520793 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135520793 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:23.759900 run osmo-msc_10.42.42.6(pid=30130): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30130)] 13:55:23.809560 run osmo-msc_10.42.42.6(pid=30130): stdout: | (launched: 2022-12-14_13:55:22.616836) 13:55:23.861503 run osmo-msc_10.42.42.6(pid=30130): stderr: | 20221214135522940 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135522941 DLGLOBAL DEBUG validating counter group 0x7f7ca1f19c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135522941 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135522941 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135522941 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135522941 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135522943 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135522943 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135522943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135522943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:23.913578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30123): Terminating (SIGTERM) 13:55:23.954868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30126): Terminating (SIGTERM) 13:55:23.996437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30129): Terminating (SIGTERM) 13:55:24.038789 --- ParallelTerminationStrategy: PID 30123 died... 13:55:24.059026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30123): Terminated: ok {rc=0} 13:55:24.105155 --- ParallelTerminationStrategy: PID 30126 died... 13:55:24.124888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30126): Terminated: ok {rc=0} 13:55:24.171230 --- ParallelTerminationStrategy: PID 30129 died... 13:55:24.190945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30129): Terminated: ok {rc=0} 13:55:24.278574 bus /sierra_3: Setting Powered False 13:55:25.375183 bus /sierra_3: Setting Powered False 13:55:26.487237 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 13:55:27.728046 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:27.735951 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 13:55:27.760124 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 13:55:27.787604 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 13:55:27.842061 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 13:55:27.866090 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 13:55:27.892528 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 13:55:28.443016 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 13:55:28.491443 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:28.502753 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:55:28.564932 tst mo_mt_call.py: using LAC 41360 13:55:28.683478 tst mo_mt_call.py: using RAC 50 13:55:28.800247 tst mo_mt_call.py: using CellId 41360 13:55:28.927109 tst mo_mt_call.py: using BVCI 41361 13:55:29.043729 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:29.055321 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:29.066742 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:29.078204 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:29.089986 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:29.101751 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:55:29.217571 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:55:29.337459 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:29.837293 run create_hlr_db(pid=30135): Launched 13:55:29.961076 bus /sierra_2: Setting Powered False 13:55:31.041137 run create_hlr_db(pid=30135): Terminated: ok {rc=0} 13:55:31.542314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30137): Launched 13:55:31.866055 run osmo-hlr_10.42.42.2(pid=30138): Launched 13:55:32.109424 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:32.702588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30140): Launched 13:55:33.024358 run osmo-stp_10.42.42.5(pid=30141): Launched 13:55:33.147152 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:33.730606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30143): Launched 13:55:34.053540 run osmo-msc_10.42.42.6(pid=30144): Launched 13:55:34.234205 run osmo-stp_10.42.42.5(pid=30141): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30141)] 13:55:34.370932 run osmo-stp_10.42.42.5(pid=30141): stdout: | (launched: 2022-12-14_13:55:32.965722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:34.507917 run osmo-stp_10.42.42.5(pid=30141): stderr: | 20221214135533157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135533157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135533157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135533158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135533158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135533158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135533158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:34.644247 run osmo-stp_10.42.42.5(pid=30141): stdout: | (launched: 2022-12-14_13:55:32.965722) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:34.773185 run osmo-stp_10.42.42.5(pid=30141): stderr: | 20221214135533157 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135533157 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135533157 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135533158 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135533158 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135533158 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135533158 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:34.927873 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30141): Process ended prematurely: osmo-stp_10.42.42.5(pid=30141) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30141)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 13:55:34.937520 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 13:55:34.965361 run osmo-hlr_10.42.42.2(pid=30138): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30138)] 13:55:35.016148 run osmo-hlr_10.42.42.2(pid=30138): stdout: | (launched: 2022-12-14_13:55:31.806683) 13:55:35.068247 run osmo-hlr_10.42.42.2(pid=30138): stderr: | 20221214135532151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135532151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135532151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135532151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135532151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135532151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135532170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135532179 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135532179 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135532179 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:35.140308 run osmo-msc_10.42.42.6(pid=30144): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30144)] 13:55:35.189871 run osmo-msc_10.42.42.6(pid=30144): stdout: | (launched: 2022-12-14_13:55:33.994779) 13:55:35.241722 run osmo-msc_10.42.42.6(pid=30144): stderr: | 20221214135534316 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135534316 DLGLOBAL DEBUG validating counter group 0x7f7800165c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135534316 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135534316 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135534316 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135534317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135534318 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135534319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135534319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135534319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:35.293854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30137): Terminating (SIGTERM) 13:55:35.335118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30140): Terminating (SIGTERM) 13:55:35.377212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30143): Terminating (SIGTERM) 13:55:35.419309 --- ParallelTerminationStrategy: PID 30137 died... 13:55:35.439838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30137): Terminated: ok {rc=0} 13:55:35.486155 --- ParallelTerminationStrategy: PID 30140 died... 13:55:35.505990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30140): Terminated: ok {rc=0} 13:55:35.551971 --- ParallelTerminationStrategy: PID 30143 died... 13:55:35.571943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30143): Terminated: ok {rc=0} 13:55:35.659931 bus /sierra_3: Setting Powered False 13:55:36.758612 bus /sierra_3: Setting Powered False 13:55:37.871695 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 13:55:39.020711 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:39.033068 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 13:55:39.095308 tst mo_mt_call_osmux.py: using LAC 41361 13:55:39.220622 tst mo_mt_call_osmux.py: using RAC 51 13:55:39.348251 tst mo_mt_call_osmux.py: using CellId 41361 13:55:39.473490 tst mo_mt_call_osmux.py: using BVCI 41362 13:55:39.583167 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:39.594964 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:39.606279 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:39.617727 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:39.629266 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 13:55:39.640504 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:55:39.759344 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 13:55:39.875774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:40.341682 run create_hlr_db(pid=30146): Launched 13:55:40.465699 bus /sierra_2: Setting Powered False 13:55:41.525925 run create_hlr_db(pid=30146): Terminated: ok {rc=0} 13:55:41.946812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30148): Launched 13:55:42.248363 run osmo-hlr_10.42.42.2(pid=30149): Launched 13:55:42.362190 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:42.892815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30151): Launched 13:55:43.193954 run osmo-stp_10.42.42.5(pid=30152): Launched 13:55:43.308478 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:43.854797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30154): Launched 13:55:44.155977 run osmo-msc_10.42.42.6(pid=30155): Launched 13:55:44.324402 run osmo-stp_10.42.42.5(pid=30152): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30152)] 13:55:44.451697 run osmo-stp_10.42.42.5(pid=30152): stdout: | (launched: 2022-12-14_13:55:43.138036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:44.579417 run osmo-stp_10.42.42.5(pid=30152): stderr: | 20221214135543309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135543309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135543309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135543310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135543310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135543310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135543310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:44.704745 run osmo-stp_10.42.42.5(pid=30152): stdout: | (launched: 2022-12-14_13:55:43.138036) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:44.824522 run osmo-stp_10.42.42.5(pid=30152): stderr: | 20221214135543309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135543309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135543309 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135543310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135543310 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135543310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135543310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:44.968055 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30152): Process ended prematurely: osmo-stp_10.42.42.5(pid=30152) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30152)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 13:55:44.977158 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 13:55:45.003352 run osmo-hlr_10.42.42.2(pid=30149): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30149)] 13:55:45.050659 run osmo-hlr_10.42.42.2(pid=30149): stdout: | (launched: 2022-12-14_13:55:42.192872) 13:55:45.099638 run osmo-hlr_10.42.42.2(pid=30149): stderr: | 20221214135542368 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135542368 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135542368 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135542368 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135542368 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135542368 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135542380 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135542389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135542390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135542390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:45.168390 run osmo-msc_10.42.42.6(pid=30155): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30155)] 13:55:45.215777 run osmo-msc_10.42.42.6(pid=30155): stdout: | (launched: 2022-12-14_13:55:44.100285) 13:55:45.264799 run osmo-msc_10.42.42.6(pid=30155): stderr: | 20221214135544372 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135544372 DLGLOBAL DEBUG validating counter group 0x7fb31140fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135544372 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135544372 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135544372 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135544372 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135544374 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135544375 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135544375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135544375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:45.313938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30148): Terminating (SIGTERM) 13:55:45.353306 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30151): Terminating (SIGTERM) 13:55:45.392447 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30154): Terminating (SIGTERM) 13:55:45.432067 --- ParallelTerminationStrategy: PID 30148 died... 13:55:45.451113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30148): Terminated: ok {rc=0} 13:55:45.494864 --- ParallelTerminationStrategy: PID 30151 died... 13:55:45.513406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30151): Terminated: ok {rc=0} 13:55:45.556747 --- ParallelTerminationStrategy: PID 30154 died... 13:55:45.575297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30154): Terminated: ok {rc=0} 13:55:45.658061 bus /sierra_3: Setting Powered False 13:55:46.755689 bus /sierra_3: Setting Powered False 13:55:47.872301 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 13:55:49.109510 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:55:49.116726 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:55:49.140083 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 13:55:49.166569 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:55:49.218461 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:55:49.243085 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 13:55:49.271046 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:55:49.822376 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 13:55:49.875310 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:55:49.887256 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:55:49.949156 tst mo_mt_call.py: using LAC 41362 13:55:50.075748 tst mo_mt_call.py: using RAC 52 13:55:50.200773 tst mo_mt_call.py: using CellId 41362 13:55:50.326124 tst mo_mt_call.py: using BVCI 41363 13:55:50.444561 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:55:50.456428 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:55:50.468192 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:55:50.479884 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:55:50.492024 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:55:50.504118 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:55:50.622595 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:55:50.738812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:55:51.204385 run create_hlr_db(pid=30160): Launched 13:55:51.327132 bus /sierra_2: Setting Powered False 13:55:52.387216 run create_hlr_db(pid=30160): Terminated: ok {rc=0} 13:55:52.829995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30163): Launched 13:55:53.154056 run osmo-hlr_10.42.42.2(pid=30164): Launched 13:55:53.278456 run osmo-stp_10.42.42.5: Starting osmo-stp 13:55:53.838440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30166): Launched 13:55:54.161644 run osmo-stp_10.42.42.5(pid=30167): Launched 13:55:54.284147 run osmo-msc_10.42.42.6: Starting osmo-msc 13:55:54.872211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30169): Launched 13:55:55.196700 run osmo-msc_10.42.42.6(pid=30170): Launched 13:55:55.377655 run osmo-stp_10.42.42.5(pid=30167): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30167)] 13:55:55.514303 run osmo-stp_10.42.42.5(pid=30167): stdout: | (launched: 2022-12-14_13:55:54.102503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:55.651474 run osmo-stp_10.42.42.5(pid=30167): stderr: | 20221214135554297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135554297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135554297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135554298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135554298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135554298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135554298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:55.788263 run osmo-stp_10.42.42.5(pid=30167): stdout: | (launched: 2022-12-14_13:55:54.102503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:55:55.918727 run osmo-stp_10.42.42.5(pid=30167): stderr: | 20221214135554297 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135554297 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135554297 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135554298 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135554298 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135554298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135554298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:55:56.073908 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30167): Process ended prematurely: osmo-stp_10.42.42.5(pid=30167) [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30167)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 13:55:56.083439 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 13:55:56.111433 run osmo-hlr_10.42.42.2(pid=30164): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30164)] 13:55:56.162242 run osmo-hlr_10.42.42.2(pid=30164): stdout: | (launched: 2022-12-14_13:55:53.095456) 13:55:56.214740 run osmo-hlr_10.42.42.2(pid=30164): stderr: | 20221214135553292 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135553292 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135553292 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135553292 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135553292 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135553292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135553309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135553318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135553319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135553319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:55:56.288041 run osmo-msc_10.42.42.6(pid=30170): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30170)] 13:55:56.338170 run osmo-msc_10.42.42.6(pid=30170): stdout: | (launched: 2022-12-14_13:55:55.137551) 13:55:56.390479 run osmo-msc_10.42.42.6(pid=30170): stderr: | 20221214135555462 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135555462 DLGLOBAL DEBUG validating counter group 0x7fd818cf7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135555462 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135555462 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135555462 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135555462 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135555464 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135555464 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135555465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135555465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:55:56.442820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30163): Terminating (SIGTERM) 13:55:56.484237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30166): Terminating (SIGTERM) 13:55:56.526596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30169): Terminating (SIGTERM) 13:55:56.568875 --- ParallelTerminationStrategy: PID 30163 died... 13:55:56.589327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30163): Terminated: ok {rc=0} 13:55:56.636049 --- ParallelTerminationStrategy: PID 30166 died... 13:55:56.655996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30166): Terminated: ok {rc=0} 13:55:56.702416 --- ParallelTerminationStrategy: PID 30169 died... 13:55:56.722329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30169): Terminated: ok {rc=0} 13:55:56.810772 bus /sierra_3: Setting Powered False 13:55:57.908592 bus /sierra_3: Setting Powered False 13:55:59.025596 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 13:56:00.174679 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:00.186927 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:56:00.249088 tst mo_mt_call_osmux.py: using LAC 41363 13:56:00.376135 tst mo_mt_call_osmux.py: using RAC 53 13:56:00.503777 tst mo_mt_call_osmux.py: using CellId 41363 13:56:00.631721 tst mo_mt_call_osmux.py: using BVCI 41364 13:56:00.748799 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:00.760441 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:00.771851 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:00.783278 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:00.795645 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 13:56:00.807469 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:56:00.961895 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:56:01.084888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:01.597964 run create_hlr_db(pid=30172): Launched 13:56:01.752255 bus /sierra_2: Setting Powered False 13:56:02.811737 run create_hlr_db(pid=30172): Terminated: ok {rc=0} 13:56:03.265624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30174): Launched 13:56:03.587625 run osmo-hlr_10.42.42.2(pid=30175): Launched 13:56:03.711419 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:04.270438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30177): Launched 13:56:04.573739 run osmo-stp_10.42.42.5(pid=30178): Launched 13:56:04.689146 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:05.235643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30180): Launched 13:56:05.537566 run osmo-msc_10.42.42.6(pid=30181): Launched 13:56:05.706699 run osmo-stp_10.42.42.5(pid=30178): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30178)] 13:56:05.834678 run osmo-stp_10.42.42.5(pid=30178): stdout: | (launched: 2022-12-14_13:56:04.518144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:05.962015 run osmo-stp_10.42.42.5(pid=30178): stderr: | 20221214135604689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135604689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135604689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135604690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135604692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135604692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135604692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:06.087424 run osmo-stp_10.42.42.5(pid=30178): stdout: | (launched: 2022-12-14_13:56:04.518144) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:06.207515 run osmo-stp_10.42.42.5(pid=30178): stderr: | 20221214135604689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135604689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135604689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135604690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135604692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135604692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135604692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:06.351370 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30178): Process ended prematurely: osmo-stp_10.42.42.5(pid=30178) [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30178)] [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 13:56:06.360212 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 13:56:06.386691 run osmo-hlr_10.42.42.2(pid=30175): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30175)] 13:56:06.434371 run osmo-hlr_10.42.42.2(pid=30175): stdout: | (launched: 2022-12-14_13:56:03.529213) 13:56:06.483481 run osmo-hlr_10.42.42.2(pid=30175): stderr: | 20221214135603728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135603728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135603728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135603728 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135603728 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135603728 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135603741 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135603749 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135603749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135603749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:06.552398 run osmo-msc_10.42.42.6(pid=30181): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30181)] 13:56:06.599472 run osmo-msc_10.42.42.6(pid=30181): stdout: | (launched: 2022-12-14_13:56:05.481720) 13:56:06.648263 run osmo-msc_10.42.42.6(pid=30181): stderr: | 20221214135605753 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135605753 DLGLOBAL DEBUG validating counter group 0x7fb31bccfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135605753 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135605753 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135605753 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135605753 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135605755 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135605755 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135605756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135605756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:06.697467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30174): Terminating (SIGTERM) 13:56:06.736713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30177): Terminating (SIGTERM) 13:56:06.775966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30180): Terminating (SIGTERM) 13:56:06.815711 --- ParallelTerminationStrategy: PID 30174 died... 13:56:06.835063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30174): Terminated: ok {rc=0} 13:56:06.879038 --- ParallelTerminationStrategy: PID 30177 died... 13:56:06.897840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30177): Terminated: ok {rc=0} 13:56:06.941808 --- ParallelTerminationStrategy: PID 30180 died... 13:56:06.960619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30180): Terminated: ok {rc=0} 13:56:07.043692 bus /sierra_3: Setting Powered False 13:56:08.141128 bus /sierra_3: Setting Powered False 13:56:09.258503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 emergency:nanobts+band-1900 --------------------------------------------------------------------- 13:56:10.496413 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:56:10.501682 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:56:10.525305 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 13:56:10.551971 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 13:56:10.635616 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:56:10.658871 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 13:56:10.684806 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 13:56:11.269271 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2405 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 13:56:11.274266 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:11.284807 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:56:11.323269 tst emergency_mo_mt_call.py: using LAC 41364 13:56:11.438994 tst emergency_mo_mt_call.py: using RAC 54 13:56:11.554828 tst emergency_mo_mt_call.py: using CellId 41364 13:56:11.675498 tst emergency_mo_mt_call.py: using BVCI 41365 13:56:11.781836 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:11.792384 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:11.802980 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:11.813445 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:11.824273 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:11.835240 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:56:11.953869 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:56:12.068270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:12.526919 run create_hlr_db(pid=30186): Launched 13:56:12.647611 bus /sierra_2: Setting Powered False 13:56:13.707249 run create_hlr_db(pid=30186): Terminated: ok {rc=0} 13:56:14.121432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30188): Launched 13:56:14.417784 run osmo-hlr_10.42.42.2(pid=30189): Launched 13:56:14.531092 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:15.043144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30191): Launched 13:56:15.339382 run osmo-stp_10.42.42.5(pid=30192): Launched 13:56:15.460334 tst emergency_mo_mt_call.py: using MSISDN 8714 13:56:15.615753 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:16.179759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30194): Launched 13:56:16.500541 run osmo-msc_10.42.42.6(pid=30195): Launched 13:56:16.846850 run osmo-stp_10.42.42.5(pid=30192): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30192)] 13:56:17.151145 run osmo-stp_10.42.42.5(pid=30192): stdout: | (launched: 2022-12-14_13:56:15.284278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:17.291038 run osmo-stp_10.42.42.5(pid=30192): stderr: | 20221214135615456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135615456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135615456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135615457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135615457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135615458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135615458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:17.427047 run osmo-stp_10.42.42.5(pid=30192): stdout: | (launched: 2022-12-14_13:56:15.284278) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:17.554467 run osmo-stp_10.42.42.5(pid=30192): stderr: | 20221214135615456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135615456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135615456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135615457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135615457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135615458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135615458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:17.707560 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30192): Process ended prematurely: osmo-stp_10.42.42.5(pid=30192) [trial-2405↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30192)] [trial-2405↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 13:56:17.717273 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 13:56:17.745318 run osmo-hlr_10.42.42.2(pid=30189): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30189)] 13:56:17.796238 run osmo-hlr_10.42.42.2(pid=30189): stdout: | (launched: 2022-12-14_13:56:14.361994) 13:56:17.849110 run osmo-hlr_10.42.42.2(pid=30189): stderr: | 20221214135614539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135614539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135614539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135614539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135614539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135614539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135614550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135614559 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135614559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135614559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:17.922037 run osmo-msc_10.42.42.6(pid=30195): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30195)] 13:56:17.972410 run osmo-msc_10.42.42.6(pid=30195): stdout: | (launched: 2022-12-14_13:56:16.434337) 13:56:18.024469 run osmo-msc_10.42.42.6(pid=30195): stderr: | 20221214135616886 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135616886 DLGLOBAL DEBUG validating counter group 0x7f885a973c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135616886 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135616886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135616886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135616887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135616888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135616893 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135616893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135616893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:18.076561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30188): Terminating (SIGTERM) 13:56:18.118557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30191): Terminating (SIGTERM) 13:56:18.160584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30194): Terminating (SIGTERM) 13:56:18.202769 --- ParallelTerminationStrategy: PID 30188 died... 13:56:18.223202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30188): Terminated: ok {rc=0} 13:56:18.269859 --- ParallelTerminationStrategy: PID 30191 died... 13:56:18.289918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30191): Terminated: ok {rc=0} 13:56:18.336553 --- ParallelTerminationStrategy: PID 30194 died... 13:56:18.356667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30194): Terminated: ok {rc=0} 13:56:18.444221 bus /sierra_3: Setting Powered False 13:56:19.543368 bus /sierra_3: Setting Powered False 13:56:20.658678 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 13:56:21.746342 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:21.758446 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:56:21.801280 tst emergency_preemptive_call.py: using LAC 41365 13:56:21.926100 tst emergency_preemptive_call.py: using RAC 55 13:56:22.041591 tst emergency_preemptive_call.py: using CellId 41365 13:56:22.158825 tst emergency_preemptive_call.py: using BVCI 41366 13:56:22.266828 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:22.277587 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:22.288152 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:22.298649 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:22.309259 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 13:56:22.320191 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:56:22.438211 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:56:22.554390 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:56:22.672272 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:56:22.785518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:23.247331 run create_hlr_db(pid=30197): Launched 13:56:23.369769 bus /sierra_2: Setting Powered False 13:56:24.430025 run create_hlr_db(pid=30197): Terminated: ok {rc=0} 13:56:24.865839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30199): Launched 13:56:25.185434 run osmo-hlr_10.42.42.2(pid=30200): Launched 13:56:25.307771 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:25.859321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30202): Launched 13:56:26.178384 run osmo-stp_10.42.42.5(pid=30203): Launched 13:56:26.311483 tst emergency_preemptive_call.py: using MSISDN 8715 13:56:26.477002 run osmo-msc_10.42.42.6: Starting osmo-msc 13:56:27.047135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30205): Launched 13:56:27.365137 run osmo-msc_10.42.42.6(pid=30206): Launched 13:56:27.542654 run osmo-stp_10.42.42.5(pid=30203): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30203)] 13:56:27.677342 run osmo-stp_10.42.42.5(pid=30203): stdout: | (launched: 2022-12-14_13:56:26.119833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:27.812837 run osmo-stp_10.42.42.5(pid=30203): stderr: | 20221214135626312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135626312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135626312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135626313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135626313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135626313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135626313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:27.947718 run osmo-stp_10.42.42.5(pid=30203): stdout: | (launched: 2022-12-14_13:56:26.119833) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:28.075182 run osmo-stp_10.42.42.5(pid=30203): stderr: | 20221214135626312 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135626312 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135626312 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135626313 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135626313 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135626313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135626313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:28.226958 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30203): Process ended prematurely: osmo-stp_10.42.42.5(pid=30203) [trial-2405↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30203)] [trial-2405↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 13:56:28.235688 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 13:56:28.263110 run osmo-hlr_10.42.42.2(pid=30200): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30200)] 13:56:28.313522 run osmo-hlr_10.42.42.2(pid=30200): stdout: | (launched: 2022-12-14_13:56:25.126886) 13:56:28.365381 run osmo-hlr_10.42.42.2(pid=30200): stderr: | 20221214135625324 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135625324 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135625324 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135625324 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135625324 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135625325 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135625337 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135625345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135625345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135625345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:28.438085 run osmo-msc_10.42.42.6(pid=30206): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30206)] 13:56:28.487899 run osmo-msc_10.42.42.6(pid=30206): stdout: | (launched: 2022-12-14_13:56:27.306447) 13:56:28.539494 run osmo-msc_10.42.42.6(pid=30206): stderr: | 20221214135627631 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135627631 DLGLOBAL DEBUG validating counter group 0x7facaa5b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135627631 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135627631 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135627631 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135627632 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135627633 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135627634 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135627634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135627634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:56:28.591560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30199): Terminating (SIGTERM) 13:56:28.633478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30202): Terminating (SIGTERM) 13:56:28.675520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30205): Terminating (SIGTERM) 13:56:28.718220 --- ParallelTerminationStrategy: PID 30199 died... 13:56:28.738566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30199): Terminated: ok {rc=0} 13:56:28.784909 --- ParallelTerminationStrategy: PID 30202 died... 13:56:28.804783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30202): Terminated: ok {rc=0} 13:56:28.850988 --- ParallelTerminationStrategy: PID 30205 died... 13:56:28.871160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30205): Terminated: ok {rc=0} 13:56:28.959129 bus /sierra_9: Setting Powered False 13:56:30.057639 bus /sierra_9: Setting Powered False 13:56:31.188714 bus /sierra_8: Setting Powered False 13:56:32.294811 bus /sierra_8: Setting Powered False 13:56:33.410060 bus /sierra_3: Setting Powered False 13:56:34.509088 bus /sierra_3: Setting Powered False 13:56:35.626069 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-1900 --------------------------------------------------------------------- 13:56:36.904503 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:56:36.911449 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 13:56:36.936344 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 13:56:36.975768 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 13:56:37.063320 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 13:56:37.086556 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 13:56:37.123849 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 13:56:37.714819 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 13:56:37.764190 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:37.775027 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:56:37.811480 tst cs_paging_gprs_active.py: using LAC 41366 13:56:37.928041 tst cs_paging_gprs_active.py: using RAC 56 13:56:38.044821 tst cs_paging_gprs_active.py: using CellId 41366 13:56:38.161997 tst cs_paging_gprs_active.py: using BVCI 41367 13:56:38.271180 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:38.281888 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:38.292254 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:38.302662 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:38.313042 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:38.323366 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:38.333941 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:38.344637 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:38.355079 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:56:38.469142 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:56:38.589109 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:56:38.808760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:39.135304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30212): Launched 13:56:39.417920 run iperf3-srv_10.42.42.10(pid=30213): Launched 13:56:39.539407 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:56:39.758543 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:40.085132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30214): Launched 13:56:40.367690 run iperf3-srv_10.42.42.10(pid=30215): Launched 13:56:40.489410 tst cs_paging_gprs_active.py:38: start network... 13:56:40.708362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:41.210780 run create_hlr_db(pid=30216): Launched 13:56:41.335362 bus /sierra_2: Setting Powered False 13:56:42.400267 run create_hlr_db(pid=30216): Terminated: ok {rc=0} 13:56:42.833159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30218): Launched 13:56:43.136241 run osmo-hlr_10.42.42.2(pid=30219): Launched 13:56:43.251312 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:43.771665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30221): Launched 13:56:44.074467 run osmo-stp_10.42.42.5(pid=30222): Launched 13:56:44.190355 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:56:44.712658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30224): Launched 13:56:44.828603 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:56:45.085068 run patchelf(pid=30225): Launched 13:56:45.253791 run osmo-stp_10.42.42.5(pid=30222): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30222)] 13:56:45.382247 run osmo-stp_10.42.42.5(pid=30222): stdout: | (launched: 2022-12-14_13:56:44.018599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:45.512522 run osmo-stp_10.42.42.5(pid=30222): stderr: | 20221214135644189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135644189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135644189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135644189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135644192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135644192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135644192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:45.643175 run osmo-stp_10.42.42.5(pid=30222): stdout: | (launched: 2022-12-14_13:56:44.018599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:45.767354 run osmo-stp_10.42.42.5(pid=30222): stderr: | 20221214135644189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135644189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135644189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135644189 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135644192 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135644192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135644192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:45.939870 run patchelf(pid=30225): Terminating (SIGINT) 13:56:46.129478 run patchelf(pid=30225): Terminated: ok {rc=0} 13:56:46.265576 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30222): Process ended prematurely: osmo-stp_10.42.42.5(pid=30222) [trial-2405↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30222)] [trial-2405↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 13:56:46.276675 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:56:46.306902 run osmo-hlr_10.42.42.2(pid=30219): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30219)] 13:56:46.361683 run osmo-hlr_10.42.42.2(pid=30219): stdout: | (launched: 2022-12-14_13:56:43.080376) 13:56:46.416118 run osmo-hlr_10.42.42.2(pid=30219): stderr: | 20221214135643259 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135643259 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135643259 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135643259 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135643259 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135643259 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135643271 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135643280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135643280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135643280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:46.471853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30212): Terminating (SIGTERM) 13:56:46.515496 run iperf3-srv_10.42.42.10(pid=30213): Terminating (SIGTERM) 13:56:46.561600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30214): Terminating (SIGTERM) 13:56:46.606484 run iperf3-srv_10.42.42.10(pid=30215): Terminating (SIGTERM) 13:56:46.651590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30218): Terminating (SIGTERM) 13:56:46.696724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30221): Terminating (SIGTERM) 13:56:46.742812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30224): Terminating (SIGTERM) 13:56:46.789335 --- ParallelTerminationStrategy: PID 30212 died... 13:56:46.811279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30212): Terminated: ok {rc=0} 13:56:46.862158 --- ParallelTerminationStrategy: PID 30213 died... 13:56:46.883785 run iperf3-srv_10.42.42.10(pid=30213): Terminated {rc=256} 13:56:46.932235 --- ParallelTerminationStrategy: PID 30214 died... 13:56:46.953804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30214): Terminated: ok {rc=0} 13:56:47.002787 --- ParallelTerminationStrategy: PID 30215 died... 13:56:47.025257 run iperf3-srv_10.42.42.10(pid=30215): Terminated {rc=256} 13:56:47.073491 --- ParallelTerminationStrategy: PID 30218 died... 13:56:47.094986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30218): Terminated: ok {rc=0} 13:56:47.143218 --- ParallelTerminationStrategy: PID 30221 died... 13:56:47.164767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30221): Terminated: ok {rc=0} 13:56:47.214197 --- ParallelTerminationStrategy: PID 30224 died... 13:56:47.235570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30224): Terminated: ok {rc=0} 13:56:47.325940 bus /gobi_0: Setting Powered False 13:56:48.423990 bus /gobi_0: Setting Powered False 13:56:49.540184 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 13:56:50.689948 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:50.701664 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:56:50.745088 tst iperf3.py: using LAC 41367 13:56:50.873294 tst iperf3.py: using RAC 57 13:56:50.999663 tst iperf3.py: using CellId 41367 13:56:51.124702 tst iperf3.py: using BVCI 41368 13:56:51.242139 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:51.253271 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:51.264250 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:51.275155 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:51.286345 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:51.297532 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:51.308865 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:51.320056 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:56:51.331359 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:56:51.449488 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:56:51.651349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:56:51.954535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30226): Launched 13:56:52.218382 run iperf3-srv_10.42.42.10(pid=30227): Launched 13:56:52.331255 tst iperf3.py:8: start network... 13:56:52.533667 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:56:53.000557 run create_hlr_db(pid=30228): Launched 13:56:53.124932 bus /gobi_6: Setting Powered False 13:56:54.184146 run create_hlr_db(pid=30228): Terminated: ok {rc=0} 13:56:54.629684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30230): Launched 13:56:54.954195 run osmo-hlr_10.42.42.2(pid=30231): Launched 13:56:55.077434 run osmo-stp_10.42.42.5: Starting osmo-stp 13:56:55.637832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30233): Launched 13:56:55.961495 run osmo-stp_10.42.42.5(pid=30234): Launched 13:56:56.084578 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:56:56.643613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30236): Launched 13:56:56.767847 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:56:57.042184 run patchelf(pid=30237): Launched 13:56:57.222342 run osmo-stp_10.42.42.5(pid=30234): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30234)] 13:56:57.359504 run osmo-stp_10.42.42.5(pid=30234): stdout: | (launched: 2022-12-14_13:56:55.902143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:57.498400 run osmo-stp_10.42.42.5(pid=30234): stderr: | 20221214135656096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135656096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135656097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135656097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135656097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135656098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135656098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:57.636914 run osmo-stp_10.42.42.5(pid=30234): stdout: | (launched: 2022-12-14_13:56:55.902143) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:56:57.770006 run osmo-stp_10.42.42.5(pid=30234): stderr: | 20221214135656096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135656096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135656097 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135656097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135656097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135656098 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135656098 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:56:57.928177 run patchelf(pid=30237): Terminating (SIGINT) 13:56:58.109953 run patchelf(pid=30237): Terminated: ok {rc=0} 13:56:58.241000 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30234): Process ended prematurely: osmo-stp_10.42.42.5(pid=30234) [trial-2405↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30234)] [trial-2405↪gprs:nanobts+band-1900↪iperf3.py:8] 13:56:58.251092 tst iperf3.py:8: Test FAILED (7.6 sec) 13:56:58.279526 run osmo-hlr_10.42.42.2(pid=30231): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30231)] 13:56:58.330156 run osmo-hlr_10.42.42.2(pid=30231): stdout: | (launched: 2022-12-14_13:56:54.895315) 13:56:58.382116 run osmo-hlr_10.42.42.2(pid=30231): stderr: | 20221214135655096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135655097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135655097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135655097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135655097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135655097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135655108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135655116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135655116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135655116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:56:58.434593 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30226): Terminating (SIGTERM) 13:56:58.476490 run iperf3-srv_10.42.42.10(pid=30227): Terminating (SIGTERM) 13:56:58.518810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30230): Terminating (SIGTERM) 13:56:58.560611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30233): Terminating (SIGTERM) 13:56:58.602982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30236): Terminating (SIGTERM) 13:56:58.645235 --- ParallelTerminationStrategy: PID 30226 died... 13:56:58.665584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30226): Terminated: ok {rc=0} 13:56:58.712160 --- ParallelTerminationStrategy: PID 30227 died... 13:56:58.731914 run iperf3-srv_10.42.42.10(pid=30227): Terminated {rc=256} 13:56:58.778125 --- ParallelTerminationStrategy: PID 30230 died... 13:56:58.797968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30230): Terminated: ok {rc=0} 13:56:58.844107 --- ParallelTerminationStrategy: PID 30233 died... 13:56:58.864090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30233): Terminated: ok {rc=0} 13:56:58.910813 --- ParallelTerminationStrategy: PID 30236 died... 13:56:58.930849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30236): Terminated: ok {rc=0} 13:56:59.018321 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 13:57:00.163565 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:00.175154 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:57:00.211957 tst iperf3m4.py: using LAC 41368 13:57:00.329588 tst iperf3m4.py: using RAC 58 13:57:00.449083 tst iperf3m4.py: using CellId 41368 13:57:00.575203 tst iperf3m4.py: using BVCI 41369 13:57:00.692375 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:00.703550 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:00.714638 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:00.725583 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:00.736815 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:00.748025 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:00.759371 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:00.770554 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:00.781900 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:57:00.921414 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:57:01.060314 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:57:01.186979 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:57:01.309499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:57:01.537503 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:01.880313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30238): Launched 13:57:02.179655 run iperf3-srv_10.42.42.10(pid=30239): Launched 13:57:02.303664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:57:02.506571 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:02.812089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30240): Launched 13:57:03.075720 run iperf3-srv_10.42.42.10(pid=30241): Launched 13:57:03.188726 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:57:03.390743 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:03.693819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30242): Launched 13:57:03.957199 run iperf3-srv_10.42.42.10(pid=30243): Launched 13:57:04.070280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:57:04.272249 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:04.577643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30244): Launched 13:57:04.840672 run iperf3-srv_10.42.42.10(pid=30245): Launched 13:57:04.953514 tst iperf3m4.py:8: start network... 13:57:05.154927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:05.621920 run create_hlr_db(pid=30246): Launched 13:57:05.745937 bus /gobi_6: Setting Powered False 13:57:06.806875 run create_hlr_db(pid=30246): Terminated: ok {rc=0} 13:57:07.228731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Launched 13:57:07.531015 run osmo-hlr_10.42.42.2(pid=30249): Launched 13:57:07.645832 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:08.179017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Launched 13:57:08.482284 run osmo-stp_10.42.42.5(pid=30252): Launched 13:57:08.596821 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:09.117019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30254): Launched 13:57:09.232382 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:09.488536 run patchelf(pid=30255): Launched 13:57:09.658994 run osmo-stp_10.42.42.5(pid=30252): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] 13:57:09.787342 run osmo-stp_10.42.42.5(pid=30252): stdout: | (launched: 2022-12-14_13:57:08.426358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:09.917274 run osmo-stp_10.42.42.5(pid=30252): stderr: | 20221214135708598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135708598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135708598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135708599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135708599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135708599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135708599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:10.047522 run osmo-stp_10.42.42.5(pid=30252): stdout: | (launched: 2022-12-14_13:57:08.426358) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:10.171902 run osmo-stp_10.42.42.5(pid=30252): stderr: | 20221214135708598 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135708598 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135708598 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135708599 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135708599 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135708599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135708599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:10.319895 run patchelf(pid=30255): Terminating (SIGINT) 13:57:10.490923 run patchelf(pid=30255): Terminated: ok {rc=0} 13:57:10.613260 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30252): Process ended prematurely: osmo-stp_10.42.42.5(pid=30252) [trial-2405↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] [trial-2405↪gprs:nanobts+band-1900↪iperf3m4.py:8] 13:57:10.622645 tst iperf3m4.py:8: Test FAILED (10.5 sec) 13:57:10.649774 run osmo-hlr_10.42.42.2(pid=30249): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30249)] 13:57:10.697667 run osmo-hlr_10.42.42.2(pid=30249): stdout: | (launched: 2022-12-14_13:57:07.475049) 13:57:10.746777 run osmo-hlr_10.42.42.2(pid=30249): stderr: | 20221214135707654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135707654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135707654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135707654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135707654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135707654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135707666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135707675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135707675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135707675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:10.796363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30238): Terminating (SIGTERM) 13:57:10.837568 run iperf3-srv_10.42.42.10(pid=30239): Terminating (SIGTERM) 13:57:10.877555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30240): Terminating (SIGTERM) 13:57:10.917546 run iperf3-srv_10.42.42.10(pid=30241): Terminating (SIGTERM) 13:57:10.957428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30242): Terminating (SIGTERM) 13:57:10.997434 run iperf3-srv_10.42.42.10(pid=30243): Terminating (SIGTERM) 13:57:11.037294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30244): Terminating (SIGTERM) 13:57:11.077250 run iperf3-srv_10.42.42.10(pid=30245): Terminating (SIGTERM) 13:57:11.117090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Terminating (SIGTERM) 13:57:11.157043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Terminating (SIGTERM) 13:57:11.196752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30254): Terminating (SIGTERM) 13:57:11.236854 --- ParallelTerminationStrategy: PID 30238 died... 13:57:11.256461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30238): Terminated: ok {rc=0} 13:57:11.301297 --- ParallelTerminationStrategy: PID 30239 died... 13:57:11.320060 run iperf3-srv_10.42.42.10(pid=30239): Terminated {rc=256} 13:57:11.364501 --- ParallelTerminationStrategy: PID 30240 died... 13:57:11.383484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30240): Terminated: ok {rc=0} 13:57:11.428111 --- ParallelTerminationStrategy: PID 30241 died... 13:57:11.447565 run iperf3-srv_10.42.42.10(pid=30241): Terminated {rc=256} 13:57:11.491783 --- ParallelTerminationStrategy: PID 30242 died... 13:57:11.510686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30242): Terminated: ok {rc=0} 13:57:11.554895 --- ParallelTerminationStrategy: PID 30243 died... 13:57:11.573810 run iperf3-srv_10.42.42.10(pid=30243): Terminated {rc=256} 13:57:11.617803 --- ParallelTerminationStrategy: PID 30244 died... 13:57:11.636728 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30244): Terminated: ok {rc=0} 13:57:11.681083 --- ParallelTerminationStrategy: PID 30245 died... 13:57:11.699902 run iperf3-srv_10.42.42.10(pid=30245): Terminated {rc=256} 13:57:11.744022 --- ParallelTerminationStrategy: PID 30248 died... 13:57:11.762892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30248): Terminated: ok {rc=0} 13:57:11.807006 --- ParallelTerminationStrategy: PID 30251 died... 13:57:11.826102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30251): Terminated: ok {rc=0} 13:57:11.870279 --- ParallelTerminationStrategy: PID 30254 died... 13:57:11.889215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30254): Terminated: ok {rc=0} 13:57:11.975318 bus /gobi_4: Setting Powered False 13:57:13.074949 bus /gobi_4: Setting Powered False 13:57:14.189944 bus /gobi_1: Setting Powered False 13:57:15.289126 bus /gobi_1: Setting Powered False 13:57:16.408463 bus /gobi_0: Setting Powered False 13:57:17.506621 bus /gobi_0: Setting Powered False 13:57:18.623061 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 13:57:19.726985 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:19.738278 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:57:19.776177 tst ping.py: using LAC 41369 13:57:19.892940 tst ping.py: using RAC 59 13:57:20.009334 tst ping.py: using CellId 41369 13:57:20.125204 tst ping.py: using BVCI 41370 13:57:20.232157 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:20.242780 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:20.253303 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:20.263695 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:20.274022 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:20.284377 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:20.294884 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:20.305319 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:57:20.417081 tst ping.py:19: start network... 13:57:20.614716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:21.073332 run create_hlr_db(pid=30256): Launched 13:57:21.194440 bus /gobi_6: Setting Powered False 13:57:22.254983 run create_hlr_db(pid=30256): Terminated: ok {rc=0} 13:57:22.669463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30258): Launched 13:57:22.966252 run osmo-hlr_10.42.42.2(pid=30259): Launched 13:57:23.080915 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:23.611399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30261): Launched 13:57:23.909529 run osmo-stp_10.42.42.5(pid=30262): Launched 13:57:24.021913 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:24.536806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30264): Launched 13:57:24.650450 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:24.902369 run patchelf(pid=30265): Launched 13:57:25.067164 run osmo-stp_10.42.42.5(pid=30262): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30262)] 13:57:25.192562 run osmo-stp_10.42.42.5(pid=30262): stdout: | (launched: 2022-12-14_13:57:23.854274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:25.320280 run osmo-stp_10.42.42.5(pid=30262): stderr: | 20221214135724023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135724024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135724024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135724025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135724026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135724026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135724026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:25.447357 run osmo-stp_10.42.42.5(pid=30262): stdout: | (launched: 2022-12-14_13:57:23.854274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:25.568715 run osmo-stp_10.42.42.5(pid=30262): stderr: | 20221214135724023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135724024 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135724024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135724025 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135724026 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135724026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135724026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:25.712909 run patchelf(pid=30265): Terminating (SIGINT) 13:57:25.879517 run patchelf(pid=30265): Terminated: ok {rc=0} 13:57:25.999553 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30262): Process ended prematurely: osmo-stp_10.42.42.5(pid=30262) [trial-2405↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30262)] [trial-2405↪gprs:nanobts+band-1900↪ping.py:22] 13:57:26.008464 tst ping.py:22: Test FAILED (6.3 sec) 13:57:26.035281 run osmo-hlr_10.42.42.2(pid=30259): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30259)] 13:57:26.083209 run osmo-hlr_10.42.42.2(pid=30259): stdout: | (launched: 2022-12-14_13:57:22.911143) 13:57:26.132669 run osmo-hlr_10.42.42.2(pid=30259): stderr: | 20221214135723088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135723088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135723088 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135723088 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135723088 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135723088 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135723100 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135723108 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135723109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135723109 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:26.182437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30258): Terminating (SIGTERM) 13:57:26.222822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30261): Terminating (SIGTERM) 13:57:26.262823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30264): Terminating (SIGTERM) 13:57:26.303113 --- ParallelTerminationStrategy: PID 30258 died... 13:57:26.322591 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30258): Terminated: ok {rc=0} 13:57:26.367152 --- ParallelTerminationStrategy: PID 30261 died... 13:57:26.386130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30261): Terminated: ok {rc=0} 13:57:26.430614 --- ParallelTerminationStrategy: PID 30264 died... 13:57:26.449912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30264): Terminated: ok {rc=0} 13:57:26.536713 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 13:57:27.627492 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:27.639574 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 13:57:27.681679 tst ping_idle_ping.py: using LAC 41370 13:57:27.809349 tst ping_idle_ping.py: using RAC 60 13:57:27.936860 tst ping_idle_ping.py: using CellId 41370 13:57:28.055063 tst ping_idle_ping.py: using BVCI 41371 13:57:28.164345 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:28.175019 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:28.185554 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:28.196006 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:28.206424 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:28.216772 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:28.227332 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 13:57:28.237924 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 13:57:28.356162 tst ping_idle_ping.py:24: start network... 13:57:28.573761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:29.074024 run create_hlr_db(pid=30266): Launched 13:57:29.197642 bus /gobi_6: Setting Powered False 13:57:30.261185 run create_hlr_db(pid=30266): Terminated: ok {rc=0} 13:57:30.691879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30268): Launched 13:57:31.017731 run osmo-hlr_10.42.42.2(pid=30269): Launched 13:57:31.272368 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:31.955911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30271): Launched 13:57:32.303775 run osmo-stp_10.42.42.5(pid=30272): Launched 13:57:32.428102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:32.985675 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30274): Launched 13:57:33.108600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:33.380225 run patchelf(pid=30275): Launched 13:57:33.558628 run osmo-stp_10.42.42.5(pid=30272): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30272)] 13:57:33.694673 run osmo-stp_10.42.42.5(pid=30272): stdout: | (launched: 2022-12-14_13:57:32.234898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:33.832162 run osmo-stp_10.42.42.5(pid=30272): stderr: | 20221214135732437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135732438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135732438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135732438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135732441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135732441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135732441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:33.970637 run osmo-stp_10.42.42.5(pid=30272): stdout: | (launched: 2022-12-14_13:57:32.234898) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:34.103075 run osmo-stp_10.42.42.5(pid=30272): stderr: | 20221214135732437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135732438 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135732438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135732438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135732441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135732441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135732441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:34.259589 run patchelf(pid=30275): Terminating (SIGINT) 13:57:34.439064 run patchelf(pid=30275): Terminated: ok {rc=0} 13:57:34.568425 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30272): Process ended prematurely: osmo-stp_10.42.42.5(pid=30272) [trial-2405↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30272)] [trial-2405↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 13:57:34.578003 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 13:57:34.606145 run osmo-hlr_10.42.42.2(pid=30269): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30269)] 13:57:34.656823 run osmo-hlr_10.42.42.2(pid=30269): stdout: | (launched: 2022-12-14_13:57:30.952672) 13:57:34.709536 run osmo-hlr_10.42.42.2(pid=30269): stderr: | 20221214135731358 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135731358 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135731358 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135731358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135731358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135731358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135731379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135731392 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135731392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135731392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:34.762151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30268): Terminating (SIGTERM) 13:57:34.804517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30271): Terminating (SIGTERM) 13:57:34.847449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30274): Terminating (SIGTERM) 13:57:34.890742 --- ParallelTerminationStrategy: PID 30268 died... 13:57:34.911289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30268): Terminated: ok {rc=0} 13:57:34.958607 --- ParallelTerminationStrategy: PID 30271 died... 13:57:34.978833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30271): Terminated: ok {rc=0} 13:57:35.025753 --- ParallelTerminationStrategy: PID 30274 died... 13:57:35.046000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30274): Terminated: ok {rc=0} 13:57:35.134809 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 13:57:36.434734 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:57:36.441562 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 13:57:36.465464 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 13:57:36.503654 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 13:57:36.589922 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 13:57:36.613256 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 13:57:36.650946 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 13:57:37.245615 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 13:57:37.293874 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:37.304497 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:57:37.343821 tst cs_paging_gprs_active.py: using LAC 41371 13:57:37.463626 tst cs_paging_gprs_active.py: using RAC 61 13:57:37.583986 tst cs_paging_gprs_active.py: using CellId 41371 13:57:37.704858 tst cs_paging_gprs_active.py: using BVCI 41372 13:57:37.814454 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:37.825370 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:37.835925 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:37.846511 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:37.857526 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:37.868657 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:37.879996 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:37.891036 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:37.902347 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:57:38.017454 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:57:38.134232 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:57:38.338295 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:38.644485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30279): Launched 13:57:38.909518 run iperf3-srv_10.42.42.10(pid=30280): Launched 13:57:39.023525 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:57:39.226749 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:39.532319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30281): Launched 13:57:39.797653 run iperf3-srv_10.42.42.10(pid=30282): Launched 13:57:39.911082 tst cs_paging_gprs_active.py:38: start network... 13:57:40.113998 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:40.585406 run create_hlr_db(pid=30283): Launched 13:57:40.709499 bus /gobi_6: Setting Powered False 13:57:41.770367 run create_hlr_db(pid=30283): Terminated: ok {rc=0} 13:57:42.215697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30285): Launched 13:57:42.541664 run osmo-hlr_10.42.42.2(pid=30286): Launched 13:57:42.666792 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:43.229292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30288): Launched 13:57:43.553936 run osmo-stp_10.42.42.5(pid=30289): Launched 13:57:43.679292 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:44.239143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30291): Launched 13:57:44.363428 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:44.641704 run patchelf(pid=30292): Launched 13:57:44.810437 run osmo-stp_10.42.42.5(pid=30289): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30289)] 13:57:44.938927 run osmo-stp_10.42.42.5(pid=30289): stdout: | (launched: 2022-12-14_13:57:43.494724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:45.068621 run osmo-stp_10.42.42.5(pid=30289): stderr: | 20221214135743687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135743687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135743687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135743687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135743688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135743688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135743688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:45.198691 run osmo-stp_10.42.42.5(pid=30289): stdout: | (launched: 2022-12-14_13:57:43.494724) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:45.322952 run osmo-stp_10.42.42.5(pid=30289): stderr: | 20221214135743687 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135743687 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135743687 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135743687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135743688 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135743688 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135743688 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:45.470895 run patchelf(pid=30292): Terminating (SIGINT) 13:57:45.640838 run patchelf(pid=30292): Terminated: ok {rc=0} 13:57:45.763148 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30289): Process ended prematurely: osmo-stp_10.42.42.5(pid=30289) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30289)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 13:57:45.772571 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 13:57:45.799757 run osmo-hlr_10.42.42.2(pid=30286): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30286)] 13:57:45.868530 run osmo-hlr_10.42.42.2(pid=30286): stdout: | (launched: 2022-12-14_13:57:42.482649) 13:57:45.923569 run osmo-hlr_10.42.42.2(pid=30286): stderr: | 20221214135742683 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135742683 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135742683 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135742683 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135742683 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135742683 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135742695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135742705 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135742705 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135742705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:45.978985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30279): Terminating (SIGTERM) 13:57:46.023663 run iperf3-srv_10.42.42.10(pid=30280): Terminating (SIGTERM) 13:57:46.074082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30281): Terminating (SIGTERM) 13:57:46.119196 run iperf3-srv_10.42.42.10(pid=30282): Terminating (SIGTERM) 13:57:46.166598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30285): Terminating (SIGTERM) 13:57:46.211074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30288): Terminating (SIGTERM) 13:57:46.256465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30291): Terminating (SIGTERM) 13:57:46.301115 --- ParallelTerminationStrategy: PID 30279 died... 13:57:46.323154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30279): Terminated: ok {rc=0} 13:57:46.372431 --- ParallelTerminationStrategy: PID 30280 died... 13:57:46.394028 run iperf3-srv_10.42.42.10(pid=30280): Terminated {rc=256} 13:57:46.443638 --- ParallelTerminationStrategy: PID 30281 died... 13:57:46.465489 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30281): Terminated: ok {rc=0} 13:57:46.513965 --- ParallelTerminationStrategy: PID 30282 died... 13:57:46.535803 run iperf3-srv_10.42.42.10(pid=30282): Terminated {rc=256} 13:57:46.584841 --- ParallelTerminationStrategy: PID 30285 died... 13:57:46.606453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30285): Terminated: ok {rc=0} 13:57:46.656563 --- ParallelTerminationStrategy: PID 30288 died... 13:57:46.679974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30288): Terminated: ok {rc=0} 13:57:46.728561 --- ParallelTerminationStrategy: PID 30291 died... 13:57:46.750344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30291): Terminated: ok {rc=0} 13:57:46.842646 bus /gobi_0: Setting Powered False 13:57:47.944206 bus /gobi_0: Setting Powered False 13:57:49.061900 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 13:57:50.207648 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:50.219173 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:57:50.267207 tst iperf3.py: using LAC 41372 13:57:50.384575 tst iperf3.py: using RAC 62 13:57:50.501411 tst iperf3.py: using CellId 41372 13:57:50.628913 tst iperf3.py: using BVCI 41373 13:57:50.746854 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:50.758413 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:50.769792 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:50.781042 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:50.792504 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:50.803846 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:50.815366 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:50.826846 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:50.838425 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:57:50.954046 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:57:51.158166 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:57:51.461766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30293): Launched 13:57:51.725945 run iperf3-srv_10.42.42.10(pid=30294): Launched 13:57:51.839219 tst iperf3.py:8: start network... 13:57:52.042135 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:57:52.509676 run create_hlr_db(pid=30295): Launched 13:57:52.634144 bus /gobi_6: Setting Powered False 13:57:53.694861 run create_hlr_db(pid=30295): Terminated: ok {rc=0} 13:57:54.116485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30297): Launched 13:57:54.418940 run osmo-hlr_10.42.42.2(pid=30298): Launched 13:57:54.533463 run osmo-stp_10.42.42.5: Starting osmo-stp 13:57:55.055380 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30300): Launched 13:57:55.357953 run osmo-stp_10.42.42.5(pid=30301): Launched 13:57:55.472625 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:57:55.992132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30303): Launched 13:57:56.107363 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:57:56.362272 run patchelf(pid=30304): Launched 13:57:56.529600 run osmo-stp_10.42.42.5(pid=30301): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30301)] 13:57:56.657493 run osmo-stp_10.42.42.5(pid=30301): stdout: | (launched: 2022-12-14_13:57:55.302213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:56.788002 run osmo-stp_10.42.42.5(pid=30301): stderr: | 20221214135755473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135755473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135755473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135755474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135755476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135755476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135755476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:56.918780 run osmo-stp_10.42.42.5(pid=30301): stdout: | (launched: 2022-12-14_13:57:55.302213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:57:57.042498 run osmo-stp_10.42.42.5(pid=30301): stderr: | 20221214135755473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135755473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135755473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135755474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135755476 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135755476 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135755476 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:57:57.189925 run patchelf(pid=30304): Terminating (SIGINT) 13:57:57.359332 run patchelf(pid=30304): Terminated: ok {rc=0} 13:57:57.481187 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30301): Process ended prematurely: osmo-stp_10.42.42.5(pid=30301) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30301)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 13:57:57.490623 tst iperf3.py:8: Test FAILED (7.3 sec) 13:57:57.517708 run osmo-hlr_10.42.42.2(pid=30298): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30298)] 13:57:57.564777 run osmo-hlr_10.42.42.2(pid=30298): stdout: | (launched: 2022-12-14_13:57:54.363036) 13:57:57.613652 run osmo-hlr_10.42.42.2(pid=30298): stderr: | 20221214135754539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135754539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135754539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135754539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135754539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135754539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135754555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135754565 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135754565 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135754565 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:57:57.663023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30293): Terminating (SIGTERM) 13:57:57.702334 run iperf3-srv_10.42.42.10(pid=30294): Terminating (SIGTERM) 13:57:57.742142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30297): Terminating (SIGTERM) 13:57:57.781569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30300): Terminating (SIGTERM) 13:57:57.820826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30303): Terminating (SIGTERM) 13:57:57.860595 --- ParallelTerminationStrategy: PID 30293 died... 13:57:57.879571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30293): Terminated: ok {rc=0} 13:57:57.923276 --- ParallelTerminationStrategy: PID 30294 died... 13:57:57.941846 run iperf3-srv_10.42.42.10(pid=30294): Terminated {rc=256} 13:57:57.985359 --- ParallelTerminationStrategy: PID 30297 died... 13:57:58.003863 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30297): Terminated: ok {rc=0} 13:57:58.047432 --- ParallelTerminationStrategy: PID 30300 died... 13:57:58.066008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30300): Terminated: ok {rc=0} 13:57:58.109720 --- ParallelTerminationStrategy: PID 30303 died... 13:57:58.128238 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30303): Terminated: ok {rc=0} 13:57:58.213626 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 13:57:59.359886 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:59.371220 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:57:59.412769 tst iperf3m4.py: using LAC 41373 13:57:59.541233 tst iperf3m4.py: using RAC 63 13:57:59.669165 tst iperf3m4.py: using CellId 41373 13:57:59.795996 tst iperf3m4.py: using BVCI 41374 13:57:59.914245 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:59.925830 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:59.936824 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:59.947928 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:59.959864 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:59.971704 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:59.983929 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:57:59.995772 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:00.007839 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:58:00.128460 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:58:00.248544 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:58:00.367617 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:58:00.485284 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:58:00.688165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:01.038418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30305): Launched 13:58:01.341751 run iperf3-srv_10.42.42.10(pid=30306): Launched 13:58:01.476748 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:58:01.706037 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:02.052156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30307): Launched 13:58:02.351783 run iperf3-srv_10.42.42.10(pid=30308): Launched 13:58:02.473666 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:58:02.693350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:03.020223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30309): Launched 13:58:03.303384 run iperf3-srv_10.42.42.10(pid=30310): Launched 13:58:03.425347 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:58:03.644890 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:03.971759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30311): Launched 13:58:04.255220 run iperf3-srv_10.42.42.10(pid=30312): Launched 13:58:04.377820 tst iperf3m4.py:8: start network... 13:58:04.598153 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:05.104003 run create_hlr_db(pid=30313): Launched 13:58:05.228344 bus /gobi_6: Setting Powered False 13:58:06.292526 run create_hlr_db(pid=30313): Terminated: ok {rc=0} 13:58:06.746914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30315): Launched 13:58:07.073897 run osmo-hlr_10.42.42.2(pid=30316): Launched 13:58:07.200726 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:07.764388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30318): Launched 13:58:08.090564 run osmo-stp_10.42.42.5(pid=30319): Launched 13:58:08.215180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:08.776613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30321): Launched 13:58:08.901820 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:09.177321 run patchelf(pid=30322): Launched 13:58:09.357516 run osmo-stp_10.42.42.5(pid=30319): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30319)] 13:58:09.495248 run osmo-stp_10.42.42.5(pid=30319): stdout: | (launched: 2022-12-14_13:58:08.031086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:09.634352 run osmo-stp_10.42.42.5(pid=30319): stderr: | 20221214135808223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135808223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135808224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135808224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135808225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135808225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135808225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:09.773730 run osmo-stp_10.42.42.5(pid=30319): stdout: | (launched: 2022-12-14_13:58:08.031086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:09.907568 run osmo-stp_10.42.42.5(pid=30319): stderr: | 20221214135808223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135808223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135808224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135808224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135808225 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135808225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135808225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:10.066310 run patchelf(pid=30322): Terminating (SIGINT) 13:58:10.248788 run patchelf(pid=30322): Terminated: ok {rc=0} 13:58:10.380538 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30319): Process ended prematurely: osmo-stp_10.42.42.5(pid=30319) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30319)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 13:58:10.390717 tst iperf3m4.py:8: Test FAILED (11.1 sec) 13:58:10.419659 run osmo-hlr_10.42.42.2(pid=30316): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30316)] 13:58:10.470410 run osmo-hlr_10.42.42.2(pid=30316): stdout: | (launched: 2022-12-14_13:58:07.014236) 13:58:10.522393 run osmo-hlr_10.42.42.2(pid=30316): stderr: | 20221214135807214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135807214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135807214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135807214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135807214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135807214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135807227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135807235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135807235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135807235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:10.574982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30305): Terminating (SIGTERM) 13:58:10.616941 run iperf3-srv_10.42.42.10(pid=30306): Terminating (SIGTERM) 13:58:10.659218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30307): Terminating (SIGTERM) 13:58:10.701766 run iperf3-srv_10.42.42.10(pid=30308): Terminating (SIGTERM) 13:58:10.743666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30309): Terminating (SIGTERM) 13:58:10.785913 run iperf3-srv_10.42.42.10(pid=30310): Terminating (SIGTERM) 13:58:10.827892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30311): Terminating (SIGTERM) 13:58:10.870218 run iperf3-srv_10.42.42.10(pid=30312): Terminating (SIGTERM) 13:58:10.912828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30315): Terminating (SIGTERM) 13:58:10.954967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30318): Terminating (SIGTERM) 13:58:10.997019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30321): Terminating (SIGTERM) 13:58:11.039330 --- ParallelTerminationStrategy: PID 30305 died... 13:58:11.059838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30305): Terminated: ok {rc=0} 13:58:11.106613 --- ParallelTerminationStrategy: PID 30306 died... 13:58:11.126512 run iperf3-srv_10.42.42.10(pid=30306): Terminated {rc=256} 13:58:11.172748 --- ParallelTerminationStrategy: PID 30307 died... 13:58:11.192673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30307): Terminated: ok {rc=0} 13:58:11.239041 --- ParallelTerminationStrategy: PID 30308 died... 13:58:11.258758 run iperf3-srv_10.42.42.10(pid=30308): Terminated {rc=256} 13:58:11.304910 --- ParallelTerminationStrategy: PID 30309 died... 13:58:11.324710 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30309): Terminated: ok {rc=0} 13:58:11.371016 --- ParallelTerminationStrategy: PID 30310 died... 13:58:11.390802 run iperf3-srv_10.42.42.10(pid=30310): Terminated {rc=256} 13:58:11.437232 --- ParallelTerminationStrategy: PID 30311 died... 13:58:11.457516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30311): Terminated: ok {rc=0} 13:58:11.503810 --- ParallelTerminationStrategy: PID 30312 died... 13:58:11.523588 run iperf3-srv_10.42.42.10(pid=30312): Terminated {rc=256} 13:58:11.569749 --- ParallelTerminationStrategy: PID 30315 died... 13:58:11.589659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30315): Terminated: ok {rc=0} 13:58:11.636041 --- ParallelTerminationStrategy: PID 30318 died... 13:58:11.655965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30318): Terminated: ok {rc=0} 13:58:11.702834 --- ParallelTerminationStrategy: PID 30321 died... 13:58:11.722866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30321): Terminated: ok {rc=0} 13:58:11.811294 bus /gobi_4: Setting Powered False 13:58:12.910281 bus /gobi_4: Setting Powered False 13:58:14.026722 bus /gobi_1: Setting Powered False 13:58:15.124142 bus /gobi_1: Setting Powered False 13:58:16.240212 bus /gobi_0: Setting Powered False 13:58:17.341995 bus /gobi_0: Setting Powered False 13:58:18.460203 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 13:58:19.560848 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:19.572357 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:58:19.618113 tst ping.py: using LAC 41374 13:58:19.734424 tst ping.py: using RAC 64 13:58:19.848917 tst ping.py: using CellId 41374 13:58:19.964206 tst ping.py: using BVCI 41375 13:58:20.071444 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:20.082325 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:20.093075 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:20.103670 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:20.114303 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:20.124757 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:20.135506 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:20.146380 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:58:20.260097 tst ping.py:19: start network... 13:58:20.475740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:20.969993 run create_hlr_db(pid=30324): Launched 13:58:21.092219 bus /gobi_6: Setting Powered False 13:58:22.156101 run create_hlr_db(pid=30324): Terminated: ok {rc=0} 13:58:22.581948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30326): Launched 13:58:22.878122 run osmo-hlr_10.42.42.2(pid=30327): Launched 13:58:22.992204 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:23.522534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30329): Launched 13:58:23.844492 run osmo-stp_10.42.42.5(pid=30330): Launched 13:58:23.966551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:24.517597 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30332): Launched 13:58:24.639837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:24.909983 run patchelf(pid=30333): Launched 13:58:25.087386 run osmo-stp_10.42.42.5(pid=30330): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30330)] 13:58:25.222524 run osmo-stp_10.42.42.5(pid=30330): stdout: | (launched: 2022-12-14_13:58:23.784656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:25.359322 run osmo-stp_10.42.42.5(pid=30330): stderr: | 20221214135823976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135823976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135823976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135823977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135823977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135823977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135823977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:25.496072 run osmo-stp_10.42.42.5(pid=30330): stdout: | (launched: 2022-12-14_13:58:23.784656) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:25.627158 run osmo-stp_10.42.42.5(pid=30330): stderr: | 20221214135823976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135823976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135823976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135823977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135823977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135823977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135823977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:25.782115 run patchelf(pid=30333): Terminating (SIGINT) 13:58:25.960557 run patchelf(pid=30333): Terminated: ok {rc=0} 13:58:26.089016 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30330): Process ended prematurely: osmo-stp_10.42.42.5(pid=30330) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30330)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 13:58:26.098532 tst ping.py:22: Test FAILED (6.5 sec) 13:58:26.126330 run osmo-hlr_10.42.42.2(pid=30327): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30327)] 13:58:26.176627 run osmo-hlr_10.42.42.2(pid=30327): stdout: | (launched: 2022-12-14_13:58:22.823132) 13:58:26.228399 run osmo-hlr_10.42.42.2(pid=30327): stderr: | 20221214135823000 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135823000 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135823000 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135823000 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135823000 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135823000 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135823012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135823023 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135823023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135823023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:26.280786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30326): Terminating (SIGTERM) 13:58:26.322614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30329): Terminating (SIGTERM) 13:58:26.364507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30332): Terminating (SIGTERM) 13:58:26.407069 --- ParallelTerminationStrategy: PID 30326 died... 13:58:26.427409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30326): Terminated: ok {rc=0} 13:58:26.474113 --- ParallelTerminationStrategy: PID 30329 died... 13:58:26.494038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30329): Terminated: ok {rc=0} 13:58:26.540353 --- ParallelTerminationStrategy: PID 30332 died... 13:58:26.560303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30332): Terminated: ok {rc=0} 13:58:26.647228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 13:58:27.735623 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:27.748090 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 13:58:27.792437 tst ping_idle_ping.py: using LAC 41375 13:58:27.919486 tst ping_idle_ping.py: using RAC 65 13:58:28.044251 tst ping_idle_ping.py: using CellId 41375 13:58:28.168915 tst ping_idle_ping.py: using BVCI 41376 13:58:28.286162 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:28.297661 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:28.308732 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:28.319901 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:28.331383 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:28.342796 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:28.354503 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 13:58:28.365963 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 13:58:28.481478 tst ping_idle_ping.py:24: start network... 13:58:28.682954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:29.154636 run create_hlr_db(pid=30334): Launched 13:58:29.278354 bus /gobi_6: Setting Powered False 13:58:30.337626 run create_hlr_db(pid=30334): Terminated: ok {rc=0} 13:58:30.775180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30336): Launched 13:58:31.125163 run osmo-hlr_10.42.42.2(pid=30337): Launched 13:58:31.410399 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:32.171248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30339): Launched 13:58:32.500122 run osmo-stp_10.42.42.5(pid=30340): Launched 13:58:32.615631 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:33.132841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30342): Launched 13:58:33.246985 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:33.499288 run patchelf(pid=30343): Launched 13:58:33.665572 run osmo-stp_10.42.42.5(pid=30340): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30340)] 13:58:33.792045 run osmo-stp_10.42.42.5(pid=30340): stdout: | (launched: 2022-12-14_13:58:32.444400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:33.920408 run osmo-stp_10.42.42.5(pid=30340): stderr: | 20221214135832613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135832613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135832613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135832614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135832616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135832616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135832616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:34.048778 run osmo-stp_10.42.42.5(pid=30340): stdout: | (launched: 2022-12-14_13:58:32.444400) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:34.171839 run osmo-stp_10.42.42.5(pid=30340): stderr: | 20221214135832613 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135832613 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135832613 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135832614 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135832616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135832616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135832616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:34.317438 run patchelf(pid=30343): Terminating (SIGINT) 13:58:34.484585 run patchelf(pid=30343): Terminated: ok {rc=0} 13:58:34.604803 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30340): Process ended prematurely: osmo-stp_10.42.42.5(pid=30340) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30340)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 13:58:34.613579 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 13:58:34.640104 run osmo-hlr_10.42.42.2(pid=30337): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30337)] 13:58:34.688325 run osmo-hlr_10.42.42.2(pid=30337): stdout: | (launched: 2022-12-14_13:58:31.058271) 13:58:34.737907 run osmo-hlr_10.42.42.2(pid=30337): stderr: | 20221214135831388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135831388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135831388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135831388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135831388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135831388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135831410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135831428 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135831428 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135831429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:34.787181 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30336): Terminating (SIGTERM) 13:58:34.826788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30339): Terminating (SIGTERM) 13:58:34.866204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30342): Terminating (SIGTERM) 13:58:34.906001 --- ParallelTerminationStrategy: PID 30336 died... 13:58:34.925333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30336): Terminated: ok {rc=0} 13:58:34.969480 --- ParallelTerminationStrategy: PID 30339 died... 13:58:34.988317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30339): Terminated: ok {rc=0} 13:58:35.032602 --- ParallelTerminationStrategy: PID 30342 died... 13:58:35.051336 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30342): Terminated: ok {rc=0} 13:58:35.136418 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 13:58:36.430204 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:58:36.438934 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 13:58:36.463609 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 13:58:36.504264 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 13:58:36.594104 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 13:58:36.618248 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 13:58:36.657556 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 13:58:37.255035 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 13:58:37.305478 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:37.316564 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:58:37.375034 tst cs_paging_gprs_active.py: using LAC 41376 13:58:37.493135 tst cs_paging_gprs_active.py: using RAC 66 13:58:37.611677 tst cs_paging_gprs_active.py: using CellId 41376 13:58:37.731941 tst cs_paging_gprs_active.py: using BVCI 41377 13:58:37.842570 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:37.853462 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:37.864197 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:37.875223 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:37.886398 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:37.897382 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:37.908158 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:37.919341 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:37.930452 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:58:38.047193 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:58:38.168057 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 13:58:38.371480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:38.675378 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30347): Launched 13:58:38.938796 run iperf3-srv_10.42.42.10(pid=30348): Launched 13:58:39.053145 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 13:58:39.255810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:39.559722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30349): Launched 13:58:39.823485 run iperf3-srv_10.42.42.10(pid=30350): Launched 13:58:39.936253 tst cs_paging_gprs_active.py:38: start network... 13:58:40.138597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:40.607229 run create_hlr_db(pid=30351): Launched 13:58:40.730552 bus /gobi_6: Setting Powered False 13:58:41.791435 run create_hlr_db(pid=30351): Terminated: ok {rc=0} 13:58:42.235098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30353): Launched 13:58:42.560209 run osmo-hlr_10.42.42.2(pid=30354): Launched 13:58:42.685340 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:43.245694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30356): Launched 13:58:43.570475 run osmo-stp_10.42.42.5(pid=30357): Launched 13:58:43.694898 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:44.255878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30359): Launched 13:58:44.380467 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:44.655977 run patchelf(pid=30360): Launched 13:58:44.837117 run osmo-stp_10.42.42.5(pid=30357): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30357)] 13:58:44.975489 run osmo-stp_10.42.42.5(pid=30357): stdout: | (launched: 2022-12-14_13:58:43.511236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:45.115596 run osmo-stp_10.42.42.5(pid=30357): stderr: | 20221214135843703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135843703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135843703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135843704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135843704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135843704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135843704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:45.256032 run osmo-stp_10.42.42.5(pid=30357): stdout: | (launched: 2022-12-14_13:58:43.511236) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:45.390092 run osmo-stp_10.42.42.5(pid=30357): stderr: | 20221214135843703 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135843703 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135843703 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135843704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135843704 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135843704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135843704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:45.548518 run patchelf(pid=30360): Terminating (SIGINT) 13:58:45.731340 run patchelf(pid=30360): Terminated: ok {rc=0} 13:58:45.872854 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30357): Process ended prematurely: osmo-stp_10.42.42.5(pid=30357) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30357)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 13:58:45.884321 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 13:58:45.927888 run osmo-hlr_10.42.42.2(pid=30354): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30354)] 13:58:45.978656 run osmo-hlr_10.42.42.2(pid=30354): stdout: | (launched: 2022-12-14_13:58:42.501230) 13:58:46.032064 run osmo-hlr_10.42.42.2(pid=30354): stderr: | 20221214135842700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135842700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135842700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135842700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135842700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135842700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135842715 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135842724 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135842724 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135842724 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:46.095261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30347): Terminating (SIGTERM) 13:58:46.150626 run iperf3-srv_10.42.42.10(pid=30348): Terminating (SIGTERM) 13:58:46.208811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30349): Terminating (SIGTERM) 13:58:46.264184 run iperf3-srv_10.42.42.10(pid=30350): Terminating (SIGTERM) 13:58:46.322818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30353): Terminating (SIGTERM) 13:58:46.378472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30356): Terminating (SIGTERM) 13:58:46.428612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30359): Terminating (SIGTERM) 13:58:46.474926 --- ParallelTerminationStrategy: PID 30347 died... 13:58:46.496115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30347): Terminated: ok {rc=0} 13:58:46.544385 --- ParallelTerminationStrategy: PID 30348 died... 13:58:46.565478 run iperf3-srv_10.42.42.10(pid=30348): Terminated {rc=256} 13:58:46.612563 --- ParallelTerminationStrategy: PID 30349 died... 13:58:46.633414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30349): Terminated: ok {rc=0} 13:58:46.681341 --- ParallelTerminationStrategy: PID 30350 died... 13:58:46.701298 run iperf3-srv_10.42.42.10(pid=30350): Terminated {rc=256} 13:58:46.747898 --- ParallelTerminationStrategy: PID 30353 died... 13:58:46.769008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30353): Terminated: ok {rc=0} 13:58:46.815464 --- ParallelTerminationStrategy: PID 30356 died... 13:58:46.836539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30356): Terminated: ok {rc=0} 13:58:46.884532 --- ParallelTerminationStrategy: PID 30359 died... 13:58:46.905460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30359): Terminated: ok {rc=0} 13:58:46.993406 bus /gobi_0: Setting Powered False 13:58:48.090517 bus /gobi_0: Setting Powered False 13:58:49.206002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 13:58:50.353576 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:50.365177 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:58:50.426608 tst iperf3.py: using LAC 41377 13:58:50.544900 tst iperf3.py: using RAC 67 13:58:50.664571 tst iperf3.py: using CellId 41377 13:58:50.784368 tst iperf3.py: using BVCI 41378 13:58:50.895002 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:50.905984 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:50.916621 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:50.927396 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:50.938200 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:50.949001 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:50.959786 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:50.970425 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:50.981347 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:58:51.094399 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 13:58:51.297945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:58:51.601326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30361): Launched 13:58:51.865399 run iperf3-srv_10.42.42.10(pid=30362): Launched 13:58:51.979115 tst iperf3.py:8: start network... 13:58:52.181713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:58:52.650279 run create_hlr_db(pid=30363): Launched 13:58:52.773528 bus /gobi_6: Setting Powered False 13:58:53.833935 run create_hlr_db(pid=30363): Terminated: ok {rc=0} 13:58:54.278618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30365): Launched 13:58:54.604150 run osmo-hlr_10.42.42.2(pid=30366): Launched 13:58:54.728486 run osmo-stp_10.42.42.5: Starting osmo-stp 13:58:55.292019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30368): Launched 13:58:55.617536 run osmo-stp_10.42.42.5(pid=30369): Launched 13:58:55.742335 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:58:56.303770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30371): Launched 13:58:56.428025 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:58:56.701878 run patchelf(pid=30372): Launched 13:58:56.881888 run osmo-stp_10.42.42.5(pid=30369): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30369)] 13:58:57.020079 run osmo-stp_10.42.42.5(pid=30369): stdout: | (launched: 2022-12-14_13:58:55.557943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:57.159467 run osmo-stp_10.42.42.5(pid=30369): stderr: | 20221214135855749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135855749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135855750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135855750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135855750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135855751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135855751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:57.299416 run osmo-stp_10.42.42.5(pid=30369): stdout: | (launched: 2022-12-14_13:58:55.557943) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:58:57.432908 run osmo-stp_10.42.42.5(pid=30369): stderr: | 20221214135855749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135855749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135855750 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135855750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135855750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135855751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135855751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:58:57.591440 run patchelf(pid=30372): Terminating (SIGINT) 13:58:57.772747 run patchelf(pid=30372): Terminated: ok {rc=0} 13:58:57.903911 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30369): Process ended prematurely: osmo-stp_10.42.42.5(pid=30369) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30369)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 13:58:57.914170 tst iperf3.py:8: Test FAILED (7.6 sec) 13:58:57.942997 run osmo-hlr_10.42.42.2(pid=30366): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30366)] 13:58:57.994072 run osmo-hlr_10.42.42.2(pid=30366): stdout: | (launched: 2022-12-14_13:58:54.544827) 13:58:58.046172 run osmo-hlr_10.42.42.2(pid=30366): stderr: | 20221214135854743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135854743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135854743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135854743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135854743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135854743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135854756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135854764 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135854765 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135854765 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:58:58.098738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30361): Terminating (SIGTERM) 13:58:58.140772 run iperf3-srv_10.42.42.10(pid=30362): Terminating (SIGTERM) 13:58:58.183365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30365): Terminating (SIGTERM) 13:58:58.225581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30368): Terminating (SIGTERM) 13:58:58.268161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30371): Terminating (SIGTERM) 13:58:58.310619 --- ParallelTerminationStrategy: PID 30361 died... 13:58:58.331027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30361): Terminated: ok {rc=0} 13:58:58.378000 --- ParallelTerminationStrategy: PID 30362 died... 13:58:58.397910 run iperf3-srv_10.42.42.10(pid=30362): Terminated {rc=256} 13:58:58.444383 --- ParallelTerminationStrategy: PID 30365 died... 13:58:58.464389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30365): Terminated: ok {rc=0} 13:58:58.510833 --- ParallelTerminationStrategy: PID 30368 died... 13:58:58.530844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30368): Terminated: ok {rc=0} 13:58:58.577466 --- ParallelTerminationStrategy: PID 30371 died... 13:58:58.597449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30371): Terminated: ok {rc=0} 13:58:58.685374 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 13:58:59.832492 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:58:59.844441 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:58:59.903174 tst iperf3m4.py: using LAC 41378 13:59:00.020454 tst iperf3m4.py: using RAC 68 13:59:00.137761 tst iperf3m4.py: using CellId 41378 13:59:00.254647 tst iperf3m4.py: using BVCI 41379 13:59:00.363765 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:00.374973 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:00.385876 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:00.396656 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:00.407634 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:00.418618 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:00.429807 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:00.440800 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:00.451923 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:59:00.565681 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:59:00.683136 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:59:00.797844 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:59:00.922760 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 13:59:01.129659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:01.454169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30373): Launched 13:59:01.737711 run iperf3-srv_10.42.42.10(pid=30374): Launched 13:59:01.858015 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 13:59:02.063377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:02.372011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30375): Launched 13:59:02.634943 run iperf3-srv_10.42.42.10(pid=30376): Launched 13:59:02.748350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 13:59:02.950680 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:03.255034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30377): Launched 13:59:03.518724 run iperf3-srv_10.42.42.10(pid=30378): Launched 13:59:03.632048 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 13:59:03.833946 run iperf3-srv_10.42.42.10: Starting iperf3-srv 13:59:04.137271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30379): Launched 13:59:04.401353 run iperf3-srv_10.42.42.10(pid=30380): Launched 13:59:04.515091 tst iperf3m4.py:8: start network... 13:59:04.717405 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:05.186249 run create_hlr_db(pid=30381): Launched 13:59:05.311730 bus /gobi_6: Setting Powered False 13:59:06.371943 run create_hlr_db(pid=30381): Terminated: ok {rc=0} 13:59:06.795411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30383): Launched 13:59:07.098647 run osmo-hlr_10.42.42.2(pid=30384): Launched 13:59:07.213664 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:07.734517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30386): Launched 13:59:08.037075 run osmo-stp_10.42.42.5(pid=30387): Launched 13:59:08.152175 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:08.673376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30389): Launched 13:59:08.789121 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:09.045056 run patchelf(pid=30390): Launched 13:59:09.213662 run osmo-stp_10.42.42.5(pid=30387): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30387)] 13:59:09.342568 run osmo-stp_10.42.42.5(pid=30387): stdout: | (launched: 2022-12-14_13:59:07.980905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:09.473369 run osmo-stp_10.42.42.5(pid=30387): stderr: | 20221214135908154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135908154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135908154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135908155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135908155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135908155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135908155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:09.603741 run osmo-stp_10.42.42.5(pid=30387): stdout: | (launched: 2022-12-14_13:59:07.980905) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:09.727950 run osmo-stp_10.42.42.5(pid=30387): stderr: | 20221214135908154 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135908154 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135908154 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135908155 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135908155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135908155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135908155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:09.875492 run patchelf(pid=30390): Terminating (SIGINT) 13:59:10.045693 run patchelf(pid=30390): Terminated: ok {rc=0} 13:59:10.168358 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30387): Process ended prematurely: osmo-stp_10.42.42.5(pid=30387) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30387)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 13:59:10.177868 tst iperf3m4.py:8: Test FAILED (10.4 sec) 13:59:10.204917 run osmo-hlr_10.42.42.2(pid=30384): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30384)] 13:59:10.252777 run osmo-hlr_10.42.42.2(pid=30384): stdout: | (launched: 2022-12-14_13:59:07.042981) 13:59:10.302097 run osmo-hlr_10.42.42.2(pid=30384): stderr: | 20221214135907218 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135907218 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135907219 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135907219 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135907219 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135907219 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135907231 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135907240 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135907240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135907240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:10.351592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30373): Terminating (SIGTERM) 13:59:10.391201 run iperf3-srv_10.42.42.10(pid=30374): Terminating (SIGTERM) 13:59:10.430711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30375): Terminating (SIGTERM) 13:59:10.470123 run iperf3-srv_10.42.42.10(pid=30376): Terminating (SIGTERM) 13:59:10.509410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30377): Terminating (SIGTERM) 13:59:10.548719 run iperf3-srv_10.42.42.10(pid=30378): Terminating (SIGTERM) 13:59:10.588288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30379): Terminating (SIGTERM) 13:59:10.627657 run iperf3-srv_10.42.42.10(pid=30380): Terminating (SIGTERM) 13:59:10.666826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30383): Terminating (SIGTERM) 13:59:10.706278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30386): Terminating (SIGTERM) 13:59:10.745534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30389): Terminating (SIGTERM) 13:59:10.785191 --- ParallelTerminationStrategy: PID 30373 died... 13:59:10.804370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30373): Terminated: ok {rc=0} 13:59:10.848623 --- ParallelTerminationStrategy: PID 30374 died... 13:59:10.867462 run iperf3-srv_10.42.42.10(pid=30374): Terminated {rc=256} 13:59:10.911329 --- ParallelTerminationStrategy: PID 30375 died... 13:59:10.930227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30375): Terminated: ok {rc=0} 13:59:10.974060 --- ParallelTerminationStrategy: PID 30376 died... 13:59:10.992870 run iperf3-srv_10.42.42.10(pid=30376): Terminated {rc=256} 13:59:11.036510 --- ParallelTerminationStrategy: PID 30377 died... 13:59:11.055448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30377): Terminated: ok {rc=0} 13:59:11.099377 --- ParallelTerminationStrategy: PID 30378 died... 13:59:11.118201 run iperf3-srv_10.42.42.10(pid=30378): Terminated {rc=256} 13:59:11.162035 --- ParallelTerminationStrategy: PID 30379 died... 13:59:11.181039 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30379): Terminated: ok {rc=0} 13:59:11.224904 --- ParallelTerminationStrategy: PID 30380 died... 13:59:11.244061 run iperf3-srv_10.42.42.10(pid=30380): Terminated {rc=256} 13:59:11.288455 --- ParallelTerminationStrategy: PID 30383 died... 13:59:11.307383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30383): Terminated: ok {rc=0} 13:59:11.351218 --- ParallelTerminationStrategy: PID 30386 died... 13:59:11.370029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30386): Terminated: ok {rc=0} 13:59:11.413721 --- ParallelTerminationStrategy: PID 30389 died... 13:59:11.432465 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30389): Terminated: ok {rc=0} 13:59:11.515731 bus /gobi_4: Setting Powered False 13:59:12.614410 bus /gobi_4: Setting Powered False 13:59:13.729943 bus /gobi_1: Setting Powered False 13:59:14.828668 bus /gobi_1: Setting Powered False 13:59:15.954486 bus /gobi_0: Setting Powered False 13:59:17.059644 bus /gobi_0: Setting Powered False 13:59:18.174969 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 13:59:19.278134 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:19.290162 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:59:19.352034 tst ping.py: using LAC 41379 13:59:19.477590 tst ping.py: using RAC 69 13:59:19.601268 tst ping.py: using CellId 41379 13:59:19.727213 tst ping.py: using BVCI 41380 13:59:19.843973 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:19.855403 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:19.866584 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:19.877779 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:19.889247 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:19.900684 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:19.912320 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:19.923840 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:59:20.039054 tst ping.py:19: start network... 13:59:20.238554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:20.730043 run create_hlr_db(pid=30391): Launched 13:59:20.851390 bus /gobi_6: Setting Powered False 13:59:21.914254 run create_hlr_db(pid=30391): Terminated: ok {rc=0} 13:59:22.341016 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30393): Launched 13:59:22.641505 run osmo-hlr_10.42.42.2(pid=30394): Launched 13:59:22.755713 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:23.275732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30396): Launched 13:59:23.574636 run osmo-stp_10.42.42.5(pid=30397): Launched 13:59:23.687559 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:24.214331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30399): Launched 13:59:24.327203 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:24.577842 run patchelf(pid=30400): Launched 13:59:24.742204 run osmo-stp_10.42.42.5(pid=30397): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30397)] 13:59:24.867149 run osmo-stp_10.42.42.5(pid=30397): stdout: | (launched: 2022-12-14_13:59:23.519246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:24.993866 run osmo-stp_10.42.42.5(pid=30397): stderr: | 20221214135923690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135923691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135923691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135923691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135923692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135923692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135923692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:25.120147 run osmo-stp_10.42.42.5(pid=30397): stdout: | (launched: 2022-12-14_13:59:23.519246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:25.241539 run osmo-stp_10.42.42.5(pid=30397): stderr: | 20221214135923690 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135923691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135923691 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135923691 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135923692 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135923692 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135923692 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:25.385592 run patchelf(pid=30400): Terminating (SIGINT) 13:59:25.551923 run patchelf(pid=30400): Terminated: ok {rc=0} 13:59:25.671762 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30397): Process ended prematurely: osmo-stp_10.42.42.5(pid=30397) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30397)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 13:59:25.680627 tst ping.py:22: Test FAILED (6.4 sec) 13:59:25.707068 run osmo-hlr_10.42.42.2(pid=30394): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30394)] 13:59:25.753876 run osmo-hlr_10.42.42.2(pid=30394): stdout: | (launched: 2022-12-14_13:59:22.586140) 13:59:25.802675 run osmo-hlr_10.42.42.2(pid=30394): stderr: | 20221214135922761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135922761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135922761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135922761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135922761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135922761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135922773 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135922782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135922782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135922783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:25.851548 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30393): Terminating (SIGTERM) 13:59:25.890786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30396): Terminating (SIGTERM) 13:59:25.930019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30399): Terminating (SIGTERM) 13:59:25.969837 --- ParallelTerminationStrategy: PID 30393 died... 13:59:25.988551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30393): Terminated: ok {rc=0} 13:59:26.031977 --- ParallelTerminationStrategy: PID 30396 died... 13:59:26.050564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30396): Terminated: ok {rc=0} 13:59:26.093901 --- ParallelTerminationStrategy: PID 30399 died... 13:59:26.112514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30399): Terminated: ok {rc=0} 13:59:26.195253 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 13:59:27.278203 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:27.289881 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 13:59:27.349273 tst ping_idle_ping.py: using LAC 41380 13:59:27.466460 tst ping_idle_ping.py: using RAC 70 13:59:27.583221 tst ping_idle_ping.py: using CellId 41380 13:59:27.701188 tst ping_idle_ping.py: using BVCI 41381 13:59:27.808748 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:27.819970 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:27.830905 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:27.841804 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:27.852511 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:27.863387 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:27.874434 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 13:59:27.885322 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 13:59:28.001864 tst ping_idle_ping.py:24: start network... 13:59:28.217713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:28.717579 run create_hlr_db(pid=30401): Launched 13:59:28.839494 bus /gobi_6: Setting Powered False 13:59:29.902937 run create_hlr_db(pid=30401): Terminated: ok {rc=0} 13:59:30.347408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30403): Launched 13:59:30.667289 run osmo-hlr_10.42.42.2(pid=30404): Launched 13:59:30.790027 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:31.481794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30406): Launched 13:59:31.822440 run osmo-stp_10.42.42.5(pid=30407): Launched 13:59:32.066164 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:32.679417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30409): Launched 13:59:32.801360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:33.071350 run patchelf(pid=30410): Launched 13:59:33.247391 run osmo-stp_10.42.42.5(pid=30407): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30407)] 13:59:33.381881 run osmo-stp_10.42.42.5(pid=30407): stdout: | (launched: 2022-12-14_13:59:31.756309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:33.518087 run osmo-stp_10.42.42.5(pid=30407): stderr: | 20221214135932052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135932053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135932053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135932053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135932054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135932054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135932054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:33.654254 run osmo-stp_10.42.42.5(pid=30407): stdout: | (launched: 2022-12-14_13:59:31.756309) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:33.785034 run osmo-stp_10.42.42.5(pid=30407): stderr: | 20221214135932052 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135932053 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135932053 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135932053 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135932054 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135932054 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135932054 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:33.939677 run patchelf(pid=30410): Terminating (SIGINT) 13:59:34.118264 run patchelf(pid=30410): Terminated: ok {rc=0} 13:59:34.247717 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30407): Process ended prematurely: osmo-stp_10.42.42.5(pid=30407) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30407)] [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 13:59:34.257620 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 13:59:34.285560 run osmo-hlr_10.42.42.2(pid=30404): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30404)] 13:59:34.335886 run osmo-hlr_10.42.42.2(pid=30404): stdout: | (launched: 2022-12-14_13:59:30.608275) 13:59:34.387390 run osmo-hlr_10.42.42.2(pid=30404): stderr: | 20221214135930806 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135930806 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135930806 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135930806 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135930806 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135930806 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135930819 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135930834 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135930834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135930834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:34.439481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30403): Terminating (SIGTERM) 13:59:34.480989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30406): Terminating (SIGTERM) 13:59:34.522861 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30409): Terminating (SIGTERM) 13:59:34.565409 --- ParallelTerminationStrategy: PID 30403 died... 13:59:34.585713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30403): Terminated: ok {rc=0} 13:59:34.631739 --- ParallelTerminationStrategy: PID 30406 died... 13:59:34.651451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30406): Terminated: ok {rc=0} 13:59:34.697492 --- ParallelTerminationStrategy: PID 30409 died... 13:59:34.717115 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30409): Terminated: ok {rc=0} 13:59:34.804197 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 13:59:36.087967 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:36.095159 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 13:59:36.118441 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 13:59:36.152224 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 13:59:36.203830 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 13:59:36.227167 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 13:59:36.261147 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 13:59:36.822979 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 13:59:36.828065 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:36.839537 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 13:59:36.898251 tst switch_tch_pdch.py: using LAC 41381 13:59:37.014285 tst switch_tch_pdch.py: using RAC 71 13:59:37.132761 tst switch_tch_pdch.py: using CellId 41381 13:59:37.249362 tst switch_tch_pdch.py: using BVCI 41382 13:59:37.356809 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:37.368341 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:37.379683 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:37.390983 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:37.402304 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:37.413615 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:37.425061 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 13:59:37.436406 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:59:37.554711 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 13:59:37.672383 tst switch_tch_pdch.py:51: start network... 13:59:37.888438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:38.385888 run create_hlr_db(pid=30417): Launched 13:59:38.507895 bus /gobi_6: Setting Powered False 13:59:39.571953 run create_hlr_db(pid=30417): Terminated: ok {rc=0} 13:59:39.999079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30419): Launched 13:59:40.299015 run osmo-hlr_10.42.42.2(pid=30420): Launched 13:59:40.412724 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:40.924877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30422): Launched 13:59:41.223307 run osmo-stp_10.42.42.5(pid=30423): Launched 13:59:41.336438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 13:59:41.849913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30425): Launched 13:59:41.963126 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 13:59:42.214583 run patchelf(pid=30426): Launched 13:59:42.379474 run osmo-stp_10.42.42.5(pid=30423): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30423)] 13:59:42.504849 run osmo-stp_10.42.42.5(pid=30423): stdout: | (launched: 2022-12-14_13:59:41.168264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:42.632060 run osmo-stp_10.42.42.5(pid=30423): stderr: | 20221214135941337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135941337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135941338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135941338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135941339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135941339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135941339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:42.759394 run osmo-stp_10.42.42.5(pid=30423): stdout: | (launched: 2022-12-14_13:59:41.168264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:42.880911 run osmo-stp_10.42.42.5(pid=30423): stderr: | 20221214135941337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135941337 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135941338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135941338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135941339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135941339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135941339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:43.025400 run patchelf(pid=30426): Terminating (SIGINT) 13:59:43.191907 run patchelf(pid=30426): Terminated: ok {rc=0} 13:59:43.311681 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30423): Process ended prematurely: osmo-stp_10.42.42.5(pid=30423) [trial-2405↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30423)] [trial-2405↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 13:59:43.320694 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 13:59:43.347373 run osmo-hlr_10.42.42.2(pid=30420): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30420)] 13:59:43.394729 run osmo-hlr_10.42.42.2(pid=30420): stdout: | (launched: 2022-12-14_13:59:40.243820) 13:59:43.443669 run osmo-hlr_10.42.42.2(pid=30420): stderr: | 20221214135940419 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135940419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135940419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135940419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135940419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135940419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135940431 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135940440 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135940440 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135940440 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:43.493190 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30419): Terminating (SIGTERM) 13:59:43.533060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30422): Terminating (SIGTERM) 13:59:43.572494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30425): Terminating (SIGTERM) 13:59:43.612121 --- ParallelTerminationStrategy: PID 30419 died... 13:59:43.631219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30419): Terminated: ok {rc=0} 13:59:43.674866 --- ParallelTerminationStrategy: PID 30422 died... 13:59:43.693458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30422): Terminated: ok {rc=0} 13:59:43.737236 --- ParallelTerminationStrategy: PID 30425 died... 13:59:43.755827 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30425): Terminated: ok {rc=0} 13:59:43.840728 bus /gobi_0: Setting Powered False 13:59:44.938798 bus /gobi_0: Setting Powered False 13:59:46.067720 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 sms:nanobts+band-900 --------------------------------------------------------------------- 13:59:47.331256 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:47.335887 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:59:47.367499 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 13:59:47.393856 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 13:59:47.444329 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:59:47.476547 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 13:59:47.502840 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 13:59:48.048605 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 13:59:48.053944 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:59:48.064413 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 13:59:48.109728 tst mo_mt_sms.py: using LAC 41382 13:59:48.228459 tst mo_mt_sms.py: using RAC 72 13:59:48.344817 tst mo_mt_sms.py: using CellId 41382 13:59:48.460755 tst mo_mt_sms.py: using BVCI 41383 13:59:48.567565 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:59:48.578066 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:59:48.588399 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:59:48.598759 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:59:48.609058 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 13:59:48.619879 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 13:59:48.738843 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 13:59:48.852505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 13:59:49.313222 run create_hlr_db(pid=30430): Launched 13:59:49.435280 bus /gobi_6: Setting Powered False 13:59:50.498561 run create_hlr_db(pid=30430): Terminated: ok {rc=0} 13:59:50.942098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30432): Launched 13:59:51.262285 run osmo-hlr_10.42.42.2(pid=30433): Launched 13:59:51.384361 run osmo-stp_10.42.42.5: Starting osmo-stp 13:59:51.934625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30435): Launched 13:59:52.254282 run osmo-stp_10.42.42.5(pid=30436): Launched 13:59:52.376049 run osmo-msc_10.42.42.6: Starting osmo-msc 13:59:52.957511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30438): Launched 13:59:53.275898 run osmo-msc_10.42.42.6(pid=30439): Launched 13:59:53.453673 run osmo-stp_10.42.42.5(pid=30436): ERR: Terminated: ERROR {rc=1} [trial-2405↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30436)] 13:59:53.588226 run osmo-stp_10.42.42.5(pid=30436): stdout: | (launched: 2022-12-14_13:59:52.194981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:53.723582 run osmo-stp_10.42.42.5(pid=30436): stderr: | 20221214135952387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135952388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135952388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135952388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135952389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135952389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135952389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:53.857930 run osmo-stp_10.42.42.5(pid=30436): stdout: | (launched: 2022-12-14_13:59:52.194981) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 13:59:53.985408 run osmo-stp_10.42.42.5(pid=30436): stderr: | 20221214135952387 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214135952388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214135952388 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214135952388 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214135952389 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214135952389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214135952389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 13:59:54.137689 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30436): Process ended prematurely: osmo-stp_10.42.42.5(pid=30436) [trial-2405↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30436)] [trial-2405↪sms:nanobts+band-900↪mo_mt_sms.py:16] 13:59:54.146532 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 13:59:54.173732 run osmo-hlr_10.42.42.2(pid=30433): ERR: Terminated: ERROR {rc=237} [trial-2405↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30433)] 13:59:54.224080 run osmo-hlr_10.42.42.2(pid=30433): stdout: | (launched: 2022-12-14_13:59:51.204019) 13:59:54.276128 run osmo-hlr_10.42.42.2(pid=30433): stderr: | 20221214135951401 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214135951401 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214135951401 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214135951401 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214135951401 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214135951401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214135951414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214135951422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214135951422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214135951422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 13:59:54.348273 run osmo-msc_10.42.42.6(pid=30439): ERR: Terminated: ERROR {rc=2} [trial-2405↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30439)] 13:59:54.397774 run osmo-msc_10.42.42.6(pid=30439): stdout: | (launched: 2022-12-14_13:59:53.217394) 13:59:54.449529 run osmo-msc_10.42.42.6(pid=30439): stderr: | 20221214135953537 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214135953537 DLGLOBAL DEBUG validating counter group 0x7f47227f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214135953537 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214135953537 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214135953537 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214135953538 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214135953539 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214135953540 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214135953540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214135953540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 13:59:54.501716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30432): Terminating (SIGTERM) 13:59:54.543184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30435): Terminating (SIGTERM) 13:59:54.585349 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30438): Terminating (SIGTERM) 13:59:54.627387 --- ParallelTerminationStrategy: PID 30432 died... 13:59:54.647725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30432): Terminated: ok {rc=0} 13:59:54.694162 --- ParallelTerminationStrategy: PID 30435 died... 13:59:54.713909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30435): Terminated: ok {rc=0} 13:59:54.760066 --- ParallelTerminationStrategy: PID 30438 died... 13:59:54.779892 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30438): Terminated: ok {rc=0} 13:59:54.867687 bus /sierra_3: Setting Powered False 13:59:55.966054 bus /sierra_3: Setting Powered False 13:59:57.082491 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 13:59:58.321224 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 13:59:58.326224 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 13:59:58.358729 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 13:59:58.366862 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 13:59:58.402986 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 13:59:58.435835 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 13:59:58.442750 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 13:59:58.961345 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 13:59:58.966493 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 13:59:58.977789 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 13:59:59.029946 tst assert_extension.py: using LAC 41383 13:59:59.147002 tst assert_extension.py: using RAC 73 13:59:59.262722 tst assert_extension.py: using CellId 41383 13:59:59.378528 tst assert_extension.py: using BVCI 41384 13:59:59.486658 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 13:59:59.602852 tst assert_extension.py:10: start nitb and bts... 13:59:59.819149 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:00:00.470574 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30444): Launched 14:00:00.790797 run osmo-nitb_10.42.42.2(pid=30445): Launched 14:00:00.986497 run osmo-nitb_10.42.42.2(pid=30445): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30445)] 14:00:01.131304 run osmo-nitb_10.42.42.2(pid=30445): stdout: | (launched: 2022-12-14_14:00:00.732204) 14:00:01.278026 run osmo-nitb_10.42.42.2(pid=30445): stderr: | (launched: 2022-12-14_14:00:00.779955) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:00:01.424473 run osmo-nitb_10.42.42.2(pid=30445): stdout: | (launched: 2022-12-14_14:00:00.732204) 14:00:01.565640 run osmo-nitb_10.42.42.2(pid=30445): stderr: | (launched: 2022-12-14_14:00:00.779955) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30445): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30445) [trial-2405↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30445)] 14:00:01.925727 tst osmo-nitb_10.42.42.2(pid=30445): stdout: | (launched: 2022-12-14_14:00:00.732204) 14:00:02.103674 tst osmo-nitb_10.42.42.2(pid=30445): stderr: | (launched: 2022-12-14_14:00:00.779955) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:00:02.273123 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=30445): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30445) [trial-2405↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30445)] [trial-2405↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 14:00:02.283692 tst assert_extension.py:12: Test FAILED (3.3 sec) 14:00:02.291189 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30444): Terminating (SIGTERM) 14:00:02.503964 --- ParallelTerminationStrategy: PID 30444 died... 14:00:02.525441 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30444): Terminated: ok {rc=0} 14:00:02.614667 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 ussd:nanobts+band-900 --------------------------------------------------------------------- 14:00:03.790959 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:03.796073 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 14:00:03.827995 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 14:00:03.854917 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 14:00:03.889071 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 14:00:03.920437 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 14:00:03.946324 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 14:00:04.478911 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 14:00:04.484450 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:00:04.495938 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 14:00:04.541938 tst assert_extension.py: using LAC 41384 14:00:04.657714 tst assert_extension.py: using RAC 74 14:00:04.771952 tst assert_extension.py: using CellId 41384 14:00:04.886598 tst assert_extension.py: using BVCI 41385 14:00:04.995300 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:00:05.005946 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:00:05.016370 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:00:05.026754 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:00:05.037220 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:00:05.047504 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 14:00:05.165243 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:05.660277 run create_hlr_db(pid=30452): Launched 14:00:05.783106 bus /sierra_2: Setting Powered False 14:00:06.845901 run create_hlr_db(pid=30452): Terminated: ok {rc=0} 14:00:07.292619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30454): Launched 14:00:07.612919 run osmo-hlr_10.42.42.2(pid=30455): Launched 14:00:07.736070 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:08.290370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30457): Launched 14:00:08.609112 run osmo-stp_10.42.42.5(pid=30458): Launched 14:00:08.731334 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:09.306944 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30460): Launched 14:00:09.625367 run osmo-msc_10.42.42.6(pid=30461): Launched 14:00:09.803624 run osmo-stp_10.42.42.5(pid=30458): ERR: Terminated: ERROR {rc=1} [trial-2405↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30458)] 14:00:09.938590 run osmo-stp_10.42.42.5(pid=30458): stdout: | (launched: 2022-12-14_14:00:08.550626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:10.075407 run osmo-stp_10.42.42.5(pid=30458): stderr: | 20221214140008742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140008742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140008742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140008743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140008743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140008743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140008743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:10.210182 run osmo-stp_10.42.42.5(pid=30458): stdout: | (launched: 2022-12-14_14:00:08.550626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:10.337462 run osmo-stp_10.42.42.5(pid=30458): stderr: | 20221214140008742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140008742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140008742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140008743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140008743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140008743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140008743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:10.489458 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=30458): Process ended prematurely: osmo-stp_10.42.42.5(pid=30458) [trial-2405↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30458)] [trial-2405↪ussd:nanobts+band-900↪assert_extension.py:17] 14:00:10.498315 tst assert_extension.py:17: Test FAILED (6.0 sec) 14:00:10.525607 run osmo-hlr_10.42.42.2(pid=30455): ERR: Terminated: ERROR {rc=237} [trial-2405↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30455)] 14:00:10.576488 run osmo-hlr_10.42.42.2(pid=30455): stdout: | (launched: 2022-12-14_14:00:07.554284) 14:00:10.629110 run osmo-hlr_10.42.42.2(pid=30455): stderr: | 20221214140007754 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140007754 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140007754 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140007754 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140007754 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140007754 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140007766 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140007774 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140007774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140007774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:10.701608 run osmo-msc_10.42.42.6(pid=30461): ERR: Terminated: ERROR {rc=2} [trial-2405↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30461)] 14:00:10.751403 run osmo-msc_10.42.42.6(pid=30461): stdout: | (launched: 2022-12-14_14:00:09.566860) 14:00:10.803510 run osmo-msc_10.42.42.6(pid=30461): stderr: | 20221214140009889 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140009889 DLGLOBAL DEBUG validating counter group 0x7f175c5c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140009890 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140009890 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140009890 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140009890 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140009892 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140009892 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140009892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140009892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:10.855804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30454): Terminating (SIGTERM) 14:00:10.897770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30457): Terminating (SIGTERM) 14:00:10.940092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30460): Terminating (SIGTERM) 14:00:10.982683 --- ParallelTerminationStrategy: PID 30454 died... 14:00:11.003009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30454): Terminated: ok {rc=0} 14:00:11.049698 --- ParallelTerminationStrategy: PID 30457 died... 14:00:11.069491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30457): Terminated: ok {rc=0} 14:00:11.115731 --- ParallelTerminationStrategy: PID 30460 died... 14:00:11.135599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30460): Terminated: ok {rc=0} 14:00:11.223602 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 14:00:12.450927 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:12.459993 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 14:00:12.492937 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 14:00:12.520795 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 14:00:12.577564 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 14:00:12.610486 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 14:00:12.637473 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 14:00:13.185973 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 14:00:13.240207 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:13.251924 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:00:13.321494 tst mo_mt_call.py: using LAC 41385 14:00:13.449995 tst mo_mt_call.py: using RAC 75 14:00:13.576212 tst mo_mt_call.py: using CellId 41385 14:00:13.703095 tst mo_mt_call.py: using BVCI 41386 14:00:13.822805 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:13.834544 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:13.846020 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:13.857586 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:13.870134 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:13.882476 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:00:14.000239 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:00:14.115219 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:14.617835 run create_hlr_db(pid=30466): Launched 14:00:14.741230 bus /sierra_2: Setting Powered False 14:00:15.805686 run create_hlr_db(pid=30466): Terminated: ok {rc=0} 14:00:16.265687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30468): Launched 14:00:16.593658 run osmo-hlr_10.42.42.2(pid=30469): Launched 14:00:16.823732 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:17.482564 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30471): Launched 14:00:17.786870 run osmo-stp_10.42.42.5(pid=30472): Launched 14:00:17.903205 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:18.447793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30474): Launched 14:00:18.750291 run osmo-msc_10.42.42.6(pid=30475): Launched 14:00:18.918851 run osmo-stp_10.42.42.5(pid=30472): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30472)] 14:00:19.046090 run osmo-stp_10.42.42.5(pid=30472): stdout: | (launched: 2022-12-14_14:00:17.730875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:19.173660 run osmo-stp_10.42.42.5(pid=30472): stderr: | 20221214140017901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140017901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140017901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140017901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140017902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140017902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140017902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:19.299296 run osmo-stp_10.42.42.5(pid=30472): stdout: | (launched: 2022-12-14_14:00:17.730875) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:19.419387 run osmo-stp_10.42.42.5(pid=30472): stderr: | 20221214140017901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140017901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140017901 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140017901 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140017902 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140017902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140017902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:19.563211 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30472): Process ended prematurely: osmo-stp_10.42.42.5(pid=30472) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30472)] [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 14:00:19.571992 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 14:00:19.598342 run osmo-hlr_10.42.42.2(pid=30469): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30469)] 14:00:19.645765 run osmo-hlr_10.42.42.2(pid=30469): stdout: | (launched: 2022-12-14_14:00:16.524479) 14:00:19.694805 run osmo-hlr_10.42.42.2(pid=30469): stderr: | 20221214140016738 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140016738 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140016738 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140016738 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140016738 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140016738 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140016756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140016785 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140016785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140016786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:19.763611 run osmo-msc_10.42.42.6(pid=30475): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30475)] 14:00:19.810925 run osmo-msc_10.42.42.6(pid=30475): stdout: | (launched: 2022-12-14_14:00:18.694582) 14:00:19.860532 run osmo-msc_10.42.42.6(pid=30475): stderr: | 20221214140018967 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140018967 DLGLOBAL DEBUG validating counter group 0x7f962f9aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140018967 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140018967 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140018967 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140018967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140018969 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140018970 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140018970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140018970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:19.909970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30468): Terminating (SIGTERM) 14:00:19.949083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30471): Terminating (SIGTERM) 14:00:19.988076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30474): Terminating (SIGTERM) 14:00:20.027636 --- ParallelTerminationStrategy: PID 30468 died... 14:00:20.046706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30468): Terminated: ok {rc=0} 14:00:20.090233 --- ParallelTerminationStrategy: PID 30471 died... 14:00:20.108719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30471): Terminated: ok {rc=0} 14:00:20.151996 --- ParallelTerminationStrategy: PID 30474 died... 14:00:20.170615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30474): Terminated: ok {rc=0} 14:00:20.253666 bus /sierra_3: Setting Powered False 14:00:21.348702 bus /sierra_3: Setting Powered False 14:00:22.463667 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 14:00:23.608660 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:23.620695 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:00:23.688021 tst mo_mt_call_osmux.py: using LAC 41386 14:00:23.807959 tst mo_mt_call_osmux.py: using RAC 76 14:00:23.927625 tst mo_mt_call_osmux.py: using CellId 41386 14:00:24.048109 tst mo_mt_call_osmux.py: using BVCI 41387 14:00:24.157363 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:24.168342 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:24.179237 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:24.190116 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:24.201036 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:00:24.211878 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:00:24.326624 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:00:24.445968 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:24.949417 run create_hlr_db(pid=30477): Launched 14:00:25.074552 bus /sierra_2: Setting Powered False 14:00:26.139163 run create_hlr_db(pid=30477): Terminated: ok {rc=0} 14:00:26.573559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30479): Launched 14:00:26.876729 run osmo-hlr_10.42.42.2(pid=30480): Launched 14:00:26.991589 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:27.553994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30482): Launched 14:00:27.880414 run osmo-stp_10.42.42.5(pid=30483): Launched 14:00:28.006425 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:28.594000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30485): Launched 14:00:28.918837 run osmo-msc_10.42.42.6(pid=30486): Launched 14:00:29.100046 run osmo-stp_10.42.42.5(pid=30483): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30483)] 14:00:29.237753 run osmo-stp_10.42.42.5(pid=30483): stdout: | (launched: 2022-12-14_14:00:27.821074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:29.375654 run osmo-stp_10.42.42.5(pid=30483): stderr: | 20221214140028014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140028014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140028014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140028015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140028015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140028015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140028015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:29.512475 run osmo-stp_10.42.42.5(pid=30483): stdout: | (launched: 2022-12-14_14:00:27.821074) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:29.642526 run osmo-stp_10.42.42.5(pid=30483): stderr: | 20221214140028014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140028014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140028014 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140028015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140028015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140028015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140028015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:29.798174 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30483): Process ended prematurely: osmo-stp_10.42.42.5(pid=30483) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30483)] [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 14:00:29.807658 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:00:29.835431 run osmo-hlr_10.42.42.2(pid=30480): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30480)] 14:00:29.885847 run osmo-hlr_10.42.42.2(pid=30480): stdout: | (launched: 2022-12-14_14:00:26.820551) 14:00:29.937535 run osmo-hlr_10.42.42.2(pid=30480): stderr: | 20221214140026999 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140026999 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140026999 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140026999 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140026999 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140026999 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140027011 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140027020 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140027020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140027020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:30.010394 run osmo-msc_10.42.42.6(pid=30486): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30486)] 14:00:30.059946 run osmo-msc_10.42.42.6(pid=30486): stdout: | (launched: 2022-12-14_14:00:28.859601) 14:00:30.111721 run osmo-msc_10.42.42.6(pid=30486): stderr: | 20221214140029180 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140029180 DLGLOBAL DEBUG validating counter group 0x7fec56cf8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140029180 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140029180 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140029181 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140029181 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140029182 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140029183 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140029183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140029183 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:30.163717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30479): Terminating (SIGTERM) 14:00:30.205215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30482): Terminating (SIGTERM) 14:00:30.247086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30485): Terminating (SIGTERM) 14:00:30.289259 --- ParallelTerminationStrategy: PID 30479 died... 14:00:30.309691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30479): Terminated: ok {rc=0} 14:00:30.356202 --- ParallelTerminationStrategy: PID 30482 died... 14:00:30.376074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30482): Terminated: ok {rc=0} 14:00:30.422507 --- ParallelTerminationStrategy: PID 30485 died... 14:00:30.442489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30485): Terminated: ok {rc=0} 14:00:30.531806 bus /sierra_3: Setting Powered False 14:00:31.633836 bus /sierra_3: Setting Powered False 14:00:32.763059 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 14:00:34.027264 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:34.036458 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 14:00:34.068647 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 14:00:34.094836 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 14:00:34.143837 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 14:00:34.175460 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 14:00:34.202144 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 14:00:34.753871 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 14:00:34.803225 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:34.814278 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:00:34.880254 tst mo_mt_call.py: using LAC 41387 14:00:34.997608 tst mo_mt_call.py: using RAC 77 14:00:35.114493 tst mo_mt_call.py: using CellId 41387 14:00:35.232855 tst mo_mt_call.py: using BVCI 41388 14:00:35.342040 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:35.353111 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:35.363920 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:35.374870 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:35.385772 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:35.396506 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:00:35.509893 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:00:35.630705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:36.098275 run create_hlr_db(pid=30491): Launched 14:00:36.220516 bus /sierra_2: Setting Powered False 14:00:37.281186 run create_hlr_db(pid=30491): Terminated: ok {rc=0} 14:00:37.724394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30493): Launched 14:00:38.048425 run osmo-hlr_10.42.42.2(pid=30494): Launched 14:00:38.172532 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:38.733632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30496): Launched 14:00:39.057620 run osmo-stp_10.42.42.5(pid=30497): Launched 14:00:39.180252 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:39.765018 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30499): Launched 14:00:40.090404 run osmo-msc_10.42.42.6(pid=30500): Launched 14:00:40.270908 run osmo-stp_10.42.42.5(pid=30497): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30497)] 14:00:40.408109 run osmo-stp_10.42.42.5(pid=30497): stdout: | (launched: 2022-12-14_14:00:38.998482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:40.545542 run osmo-stp_10.42.42.5(pid=30497): stderr: | 20221214140039191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140039191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140039191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140039192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140039194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140039194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140039194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:40.681932 run osmo-stp_10.42.42.5(pid=30497): stdout: | (launched: 2022-12-14_14:00:38.998482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:40.811434 run osmo-stp_10.42.42.5(pid=30497): stderr: | 20221214140039191 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140039191 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140039191 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140039192 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140039194 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140039194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140039194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:40.965820 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30497): Process ended prematurely: osmo-stp_10.42.42.5(pid=30497) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30497)] [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 14:00:40.975434 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 14:00:41.003539 run osmo-hlr_10.42.42.2(pid=30494): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30494)] 14:00:41.054654 run osmo-hlr_10.42.42.2(pid=30494): stdout: | (launched: 2022-12-14_14:00:37.989377) 14:00:41.106276 run osmo-hlr_10.42.42.2(pid=30494): stderr: | 20221214140038189 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140038189 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140038189 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140038189 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140038189 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140038189 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140038202 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140038210 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140038210 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140038210 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:41.178632 run osmo-msc_10.42.42.6(pid=30500): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30500)] 14:00:41.228176 run osmo-msc_10.42.42.6(pid=30500): stdout: | (launched: 2022-12-14_14:00:40.031191) 14:00:41.279586 run osmo-msc_10.42.42.6(pid=30500): stderr: | 20221214140040352 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140040352 DLGLOBAL DEBUG validating counter group 0x7fa09b98fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140040352 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140040352 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140040352 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140040353 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140040354 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140040355 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140040355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140040355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:41.331751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30493): Terminating (SIGTERM) 14:00:41.373242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30496): Terminating (SIGTERM) 14:00:41.415002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30499): Terminating (SIGTERM) 14:00:41.457364 --- ParallelTerminationStrategy: PID 30493 died... 14:00:41.477227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30493): Terminated: ok {rc=0} 14:00:41.523833 --- ParallelTerminationStrategy: PID 30496 died... 14:00:41.543730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30496): Terminated: ok {rc=0} 14:00:41.590071 --- ParallelTerminationStrategy: PID 30499 died... 14:00:41.609918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30499): Terminated: ok {rc=0} 14:00:41.698158 bus /sierra_3: Setting Powered False 14:00:42.796658 bus /sierra_3: Setting Powered False 14:00:43.910769 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 14:00:45.059325 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:45.071458 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:00:45.144793 tst mo_mt_call_osmux.py: using LAC 41388 14:00:45.271034 tst mo_mt_call_osmux.py: using RAC 78 14:00:45.397321 tst mo_mt_call_osmux.py: using CellId 41388 14:00:45.522899 tst mo_mt_call_osmux.py: using BVCI 41389 14:00:45.640184 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:45.651789 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:45.663272 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:45.674581 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:45.686366 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:00:45.698138 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:00:45.818162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:00:45.955325 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:46.543745 run create_hlr_db(pid=30502): Launched 14:00:46.718535 bus /sierra_2: Setting Powered False 14:00:47.782906 run create_hlr_db(pid=30502): Terminated: ok {rc=0} 14:00:48.259034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30504): Launched 14:00:48.563132 run osmo-hlr_10.42.42.2(pid=30505): Launched 14:00:48.678689 run osmo-stp_10.42.42.5: Starting osmo-stp 14:00:49.197347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30507): Launched 14:00:49.499768 run osmo-stp_10.42.42.5(pid=30508): Launched 14:00:49.616484 run osmo-msc_10.42.42.6: Starting osmo-msc 14:00:50.163854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30510): Launched 14:00:50.467486 run osmo-msc_10.42.42.6(pid=30511): Launched 14:00:50.636789 run osmo-stp_10.42.42.5(pid=30508): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30508)] 14:00:50.764842 run osmo-stp_10.42.42.5(pid=30508): stdout: | (launched: 2022-12-14_14:00:49.444134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:50.892417 run osmo-stp_10.42.42.5(pid=30508): stderr: | 20221214140049615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140049615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140049616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140049616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140049617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140049617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140049617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:51.018927 run osmo-stp_10.42.42.5(pid=30508): stdout: | (launched: 2022-12-14_14:00:49.444134) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:00:51.140078 run osmo-stp_10.42.42.5(pid=30508): stderr: | 20221214140049615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140049615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140049616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140049616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140049617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140049617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140049617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:00:51.285197 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30508): Process ended prematurely: osmo-stp_10.42.42.5(pid=30508) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30508)] [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 14:00:51.294175 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:00:51.320495 run osmo-hlr_10.42.42.2(pid=30505): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30505)] 14:00:51.369047 run osmo-hlr_10.42.42.2(pid=30505): stdout: | (launched: 2022-12-14_14:00:48.506948) 14:00:51.418600 run osmo-hlr_10.42.42.2(pid=30505): stderr: | 20221214140048685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140048685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140048685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140048685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140048685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140048685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140048697 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140048706 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140048706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140048706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:00:51.488189 run osmo-msc_10.42.42.6(pid=30511): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30511)] 14:00:51.535594 run osmo-msc_10.42.42.6(pid=30511): stdout: | (launched: 2022-12-14_14:00:50.411564) 14:00:51.584712 run osmo-msc_10.42.42.6(pid=30511): stderr: | 20221214140050683 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140050684 DLGLOBAL DEBUG validating counter group 0x7f2247146c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140050684 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140050684 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140050684 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140050684 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140050686 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140050686 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140050687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140050687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:00:51.633842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30504): Terminating (SIGTERM) 14:00:51.673347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30507): Terminating (SIGTERM) 14:00:51.712899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30510): Terminating (SIGTERM) 14:00:51.752819 --- ParallelTerminationStrategy: PID 30504 died... 14:00:51.771890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30504): Terminated: ok {rc=0} 14:00:51.815623 --- ParallelTerminationStrategy: PID 30507 died... 14:00:51.834319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30507): Terminated: ok {rc=0} 14:00:51.878016 --- ParallelTerminationStrategy: PID 30510 died... 14:00:51.896510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30510): Terminated: ok {rc=0} 14:00:51.981534 bus /sierra_3: Setting Powered False 14:00:53.082784 bus /sierra_3: Setting Powered False 14:00:54.197627 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 14:00:55.441641 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:00:55.449097 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 14:00:55.480641 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 14:00:55.506843 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 14:00:55.559566 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 14:00:55.591490 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 14:00:55.617559 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 14:00:56.169170 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 14:00:56.217750 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:00:56.228682 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:00:56.293843 tst mo_mt_call.py: using LAC 41389 14:00:56.412507 tst mo_mt_call.py: using RAC 79 14:00:56.532924 tst mo_mt_call.py: using CellId 41389 14:00:56.653038 tst mo_mt_call.py: using BVCI 41390 14:00:56.771912 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:00:56.783699 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:00:56.795414 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:00:56.807070 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:00:56.819174 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:00:56.831133 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:00:56.947632 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:00:57.062742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:00:57.530870 run create_hlr_db(pid=30516): Launched 14:00:57.655036 bus /sierra_2: Setting Powered False 14:00:58.715607 run create_hlr_db(pid=30516): Terminated: ok {rc=0} 14:00:59.138480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30518): Launched 14:00:59.439825 run osmo-hlr_10.42.42.2(pid=30519): Launched 14:00:59.555121 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:00.092424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30521): Launched 14:01:00.395583 run osmo-stp_10.42.42.5(pid=30522): Launched 14:01:00.510339 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:01.072013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30524): Launched 14:01:01.403479 run osmo-msc_10.42.42.6(pid=30525): Launched 14:01:01.579139 run osmo-stp_10.42.42.5(pid=30522): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30522)] 14:01:01.746009 run osmo-stp_10.42.42.5(pid=30522): stdout: | (launched: 2022-12-14_14:01:00.339886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:02.060813 run osmo-stp_10.42.42.5(pid=30522): stderr: | 20221214140100511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140100511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140100511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140100511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140100514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140100514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140100514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:02.288096 run osmo-stp_10.42.42.5(pid=30522): stdout: | (launched: 2022-12-14_14:01:00.339886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:02.449200 run osmo-stp_10.42.42.5(pid=30522): stderr: | 20221214140100511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140100511 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140100511 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140100511 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140100514 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140100514 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140100514 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:02.609118 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30522): Process ended prematurely: osmo-stp_10.42.42.5(pid=30522) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30522)] [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 14:01:02.618808 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 14:01:02.647050 run osmo-hlr_10.42.42.2(pid=30519): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30519)] 14:01:02.699363 run osmo-hlr_10.42.42.2(pid=30519): stdout: | (launched: 2022-12-14_14:00:59.384139) 14:01:02.752590 run osmo-hlr_10.42.42.2(pid=30519): stderr: | 20221214140059563 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140059563 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140059563 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140059563 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140059563 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140059563 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140059576 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140059585 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140059585 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140059585 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:02.826117 run osmo-msc_10.42.42.6(pid=30525): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30525)] 14:01:02.876365 run osmo-msc_10.42.42.6(pid=30525): stdout: | (launched: 2022-12-14_14:01:01.341091) 14:01:02.929230 run osmo-msc_10.42.42.6(pid=30525): stderr: | 20221214140101907 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140101907 DLGLOBAL DEBUG validating counter group 0x7f3cce8cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140101908 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140101908 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140101908 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140101908 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140101910 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140101910 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140101910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140101910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:02.982554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30518): Terminating (SIGTERM) 14:01:03.024750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30521): Terminating (SIGTERM) 14:01:03.067000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30524): Terminating (SIGTERM) 14:01:03.109424 --- ParallelTerminationStrategy: PID 30518 died... 14:01:03.129954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30518): Terminated: ok {rc=0} 14:01:03.176677 --- ParallelTerminationStrategy: PID 30521 died... 14:01:03.197101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30521): Terminated: ok {rc=0} 14:01:03.243736 --- ParallelTerminationStrategy: PID 30524 died... 14:01:03.263875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30524): Terminated: ok {rc=0} 14:01:03.352051 bus /sierra_3: Setting Powered False 14:01:04.450125 bus /sierra_3: Setting Powered False 14:01:05.565665 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 14:01:06.715171 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:01:06.727689 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:01:06.797729 tst mo_mt_call_osmux.py: using LAC 41390 14:01:06.917174 tst mo_mt_call_osmux.py: using RAC 80 14:01:07.035494 tst mo_mt_call_osmux.py: using CellId 41390 14:01:07.156919 tst mo_mt_call_osmux.py: using BVCI 41391 14:01:07.267780 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:01:07.278963 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:01:07.289938 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:01:07.300780 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:01:07.312274 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:01:07.324269 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:01:07.447482 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:01:07.570503 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:08.074227 run create_hlr_db(pid=30527): Launched 14:01:08.198600 bus /sierra_2: Setting Powered False 14:01:09.262871 run create_hlr_db(pid=30527): Terminated: ok {rc=0} 14:01:09.697697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30529): Launched 14:01:10.000912 run osmo-hlr_10.42.42.2(pid=30530): Launched 14:01:10.117140 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:10.653818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30532): Launched 14:01:10.955807 run osmo-stp_10.42.42.5(pid=30533): Launched 14:01:11.070645 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:11.618168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30535): Launched 14:01:11.922282 run osmo-msc_10.42.42.6(pid=30536): Launched 14:01:12.091369 run osmo-stp_10.42.42.5(pid=30533): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30533)] 14:01:12.220033 run osmo-stp_10.42.42.5(pid=30533): stdout: | (launched: 2022-12-14_14:01:10.899994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:12.348163 run osmo-stp_10.42.42.5(pid=30533): stderr: | 20221214140111073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140111073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140111073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140111074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140111074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140111074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140111074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:12.474117 run osmo-stp_10.42.42.5(pid=30533): stdout: | (launched: 2022-12-14_14:01:10.899994) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:12.594282 run osmo-stp_10.42.42.5(pid=30533): stderr: | 20221214140111073 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140111073 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140111073 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140111074 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140111074 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140111074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140111074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:12.738547 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30533): Process ended prematurely: osmo-stp_10.42.42.5(pid=30533) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30533)] [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 14:01:12.747339 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 14:01:12.773676 run osmo-hlr_10.42.42.2(pid=30530): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30530)] 14:01:12.820830 run osmo-hlr_10.42.42.2(pid=30530): stdout: | (launched: 2022-12-14_14:01:09.945395) 14:01:12.869865 run osmo-hlr_10.42.42.2(pid=30530): stderr: | 20221214140110122 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140110122 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140110122 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140110122 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140110122 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140110122 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140110134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140110143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140110143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140110143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:12.938405 run osmo-msc_10.42.42.6(pid=30536): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30536)] 14:01:12.985794 run osmo-msc_10.42.42.6(pid=30536): stdout: | (launched: 2022-12-14_14:01:11.866058) 14:01:13.034485 run osmo-msc_10.42.42.6(pid=30536): stderr: | 20221214140112140 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140112140 DLGLOBAL DEBUG validating counter group 0x7f4999899c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140112140 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140112140 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140112140 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140112140 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140112142 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140112142 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140112143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140112143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:13.083582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30529): Terminating (SIGTERM) 14:01:13.122931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30532): Terminating (SIGTERM) 14:01:13.162213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30535): Terminating (SIGTERM) 14:01:13.201978 --- ParallelTerminationStrategy: PID 30529 died... 14:01:13.221167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30529): Terminated: ok {rc=0} 14:01:13.264879 --- ParallelTerminationStrategy: PID 30532 died... 14:01:13.283857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30532): Terminated: ok {rc=0} 14:01:13.327430 --- ParallelTerminationStrategy: PID 30535 died... 14:01:13.346071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30535): Terminated: ok {rc=0} 14:01:13.429402 bus /sierra_3: Setting Powered False 14:01:14.526421 bus /sierra_3: Setting Powered False 14:01:15.641837 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 14:01:16.930062 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:16.943396 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 14:01:16.985838 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 14:01:17.013548 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 14:01:17.066892 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 14:01:17.099477 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 14:01:17.126599 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 14:01:17.679004 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 14:01:17.730123 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:17.741345 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:01:17.809596 tst mo_mt_call.py: using LAC 41391 14:01:17.928475 tst mo_mt_call.py: using RAC 81 14:01:18.044710 tst mo_mt_call.py: using CellId 41391 14:01:18.170741 tst mo_mt_call.py: using BVCI 41392 14:01:18.290001 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:18.301885 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:18.313600 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:18.325192 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:18.337127 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:18.349080 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:01:18.469145 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:01:18.585641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:19.086921 run create_hlr_db(pid=30541): Launched 14:01:19.209307 bus /sierra_2: Setting Powered False 14:01:20.273469 run create_hlr_db(pid=30541): Terminated: ok {rc=0} 14:01:20.724538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30543): Launched 14:01:21.048156 run osmo-hlr_10.42.42.2(pid=30544): Launched 14:01:21.172152 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:21.727805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30546): Launched 14:01:22.052249 run osmo-stp_10.42.42.5(pid=30547): Launched 14:01:22.176131 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:22.760423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30549): Launched 14:01:23.084481 run osmo-msc_10.42.42.6(pid=30550): Launched 14:01:23.265178 run osmo-stp_10.42.42.5(pid=30547): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30547)] 14:01:23.401988 run osmo-stp_10.42.42.5(pid=30547): stdout: | (launched: 2022-12-14_14:01:21.992490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:23.538861 run osmo-stp_10.42.42.5(pid=30547): stderr: | 20221214140122184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140122184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140122185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140122185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140122186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140122186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140122186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:23.675248 run osmo-stp_10.42.42.5(pid=30547): stdout: | (launched: 2022-12-14_14:01:21.992490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:23.804578 run osmo-stp_10.42.42.5(pid=30547): stderr: | 20221214140122184 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140122184 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140122185 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140122185 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140122186 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140122186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140122186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:23.959414 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30547): Process ended prematurely: osmo-stp_10.42.42.5(pid=30547) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30547)] [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 14:01:23.968926 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:01:23.996883 run osmo-hlr_10.42.42.2(pid=30544): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30544)] 14:01:24.047947 run osmo-hlr_10.42.42.2(pid=30544): stdout: | (launched: 2022-12-14_14:01:20.988619) 14:01:24.100193 run osmo-hlr_10.42.42.2(pid=30544): stderr: | 20221214140121187 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140121187 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140121187 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140121187 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140121187 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140121187 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140121200 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140121208 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140121208 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140121208 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:24.172591 run osmo-msc_10.42.42.6(pid=30550): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30550)] 14:01:24.221877 run osmo-msc_10.42.42.6(pid=30550): stdout: | (launched: 2022-12-14_14:01:23.025334) 14:01:24.273602 run osmo-msc_10.42.42.6(pid=30550): stderr: | 20221214140123348 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140123348 DLGLOBAL DEBUG validating counter group 0x7fcad05bfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140123348 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140123348 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140123348 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140123349 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140123350 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140123351 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140123351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140123351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:24.325485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30543): Terminating (SIGTERM) 14:01:24.366995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30546): Terminating (SIGTERM) 14:01:24.408793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30549): Terminating (SIGTERM) 14:01:24.451482 --- ParallelTerminationStrategy: PID 30543 died... 14:01:24.471903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30543): Terminated: ok {rc=0} 14:01:24.518171 --- ParallelTerminationStrategy: PID 30546 died... 14:01:24.537950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30546): Terminated: ok {rc=0} 14:01:24.584218 --- ParallelTerminationStrategy: PID 30549 died... 14:01:24.604193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30549): Terminated: ok {rc=0} 14:01:24.690691 bus /sierra_3: Setting Powered False 14:01:25.789250 bus /sierra_3: Setting Powered False 14:01:26.904233 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 14:01:28.047269 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:28.059050 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:01:28.125759 tst mo_mt_call_osmux.py: using LAC 41392 14:01:28.256819 tst mo_mt_call_osmux.py: using RAC 82 14:01:28.375313 tst mo_mt_call_osmux.py: using CellId 41392 14:01:28.492639 tst mo_mt_call_osmux.py: using BVCI 41393 14:01:28.602336 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:28.613551 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:28.624519 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:28.635423 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:28.646437 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:01:28.657381 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:01:28.777054 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:01:28.899124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:29.402825 run create_hlr_db(pid=30553): Launched 14:01:29.527108 bus /sierra_2: Setting Powered False 14:01:30.591185 run create_hlr_db(pid=30553): Terminated: ok {rc=0} 14:01:31.064421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30555): Launched 14:01:31.413734 run osmo-hlr_10.42.42.2(pid=30556): Launched 14:01:31.654427 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:32.309736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30558): Launched 14:01:32.620887 run osmo-stp_10.42.42.5(pid=30559): Launched 14:01:32.738429 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:33.286762 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30561): Launched 14:01:33.590277 run osmo-msc_10.42.42.6(pid=30562): Launched 14:01:33.759432 run osmo-stp_10.42.42.5(pid=30559): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30559)] 14:01:33.887551 run osmo-stp_10.42.42.5(pid=30559): stdout: | (launched: 2022-12-14_14:01:32.564521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:34.014965 run osmo-stp_10.42.42.5(pid=30559): stderr: | 20221214140132736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140132736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140132737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140132737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140132737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140132738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140132738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:34.141094 run osmo-stp_10.42.42.5(pid=30559): stdout: | (launched: 2022-12-14_14:01:32.564521) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:34.261763 run osmo-stp_10.42.42.5(pid=30559): stderr: | 20221214140132736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140132736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140132737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140132737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140132737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140132738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140132738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:34.406184 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30559): Process ended prematurely: osmo-stp_10.42.42.5(pid=30559) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30559)] [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 14:01:34.415627 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 14:01:34.442312 run osmo-hlr_10.42.42.2(pid=30556): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30556)] 14:01:34.489834 run osmo-hlr_10.42.42.2(pid=30556): stdout: | (launched: 2022-12-14_14:01:31.343793) 14:01:34.538885 run osmo-hlr_10.42.42.2(pid=30556): stderr: | 20221214140131585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140131585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140131585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140131585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140131585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140131585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140131600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140131615 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140131615 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140131615 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:34.607395 run osmo-msc_10.42.42.6(pid=30562): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30562)] 14:01:34.654504 run osmo-msc_10.42.42.6(pid=30562): stdout: | (launched: 2022-12-14_14:01:33.534368) 14:01:34.703231 run osmo-msc_10.42.42.6(pid=30562): stderr: | 20221214140133804 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140133804 DLGLOBAL DEBUG validating counter group 0x7efe6a206c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140133804 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140133804 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140133804 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140133805 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140133806 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140133807 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140133807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140133807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:34.752325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30555): Terminating (SIGTERM) 14:01:34.792020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30558): Terminating (SIGTERM) 14:01:34.831687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30561): Terminating (SIGTERM) 14:01:34.871627 --- ParallelTerminationStrategy: PID 30555 died... 14:01:34.890949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30555): Terminated: ok {rc=0} 14:01:34.935107 --- ParallelTerminationStrategy: PID 30558 died... 14:01:34.953786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30558): Terminated: ok {rc=0} 14:01:34.997543 --- ParallelTerminationStrategy: PID 30561 died... 14:01:35.016082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30561): Terminated: ok {rc=0} 14:01:35.102771 bus /sierra_3: Setting Powered False 14:01:36.202674 bus /sierra_3: Setting Powered False 14:01:37.315257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:01:38.570833 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:38.578865 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:01:38.612519 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 14:01:38.640463 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:01:38.692339 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:01:38.724140 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 14:01:38.750525 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:01:39.304107 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 14:01:39.358867 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:39.370702 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:01:39.441493 tst mo_mt_call.py: using LAC 41393 14:01:39.567973 tst mo_mt_call.py: using RAC 83 14:01:39.692759 tst mo_mt_call.py: using CellId 41393 14:01:39.817555 tst mo_mt_call.py: using BVCI 41394 14:01:39.934690 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:39.946336 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:39.958697 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:39.970170 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:39.982300 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:39.994225 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:01:40.111732 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:01:40.234508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:40.737317 run create_hlr_db(pid=30567): Launched 14:01:40.860702 bus /sierra_2: Setting Powered False 14:01:41.924720 run create_hlr_db(pid=30567): Terminated: ok {rc=0} 14:01:42.359686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30569): Launched 14:01:42.663176 run osmo-hlr_10.42.42.2(pid=30570): Launched 14:01:42.777632 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:43.300478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30572): Launched 14:01:43.602060 run osmo-stp_10.42.42.5(pid=30573): Launched 14:01:43.717134 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:44.262916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30575): Launched 14:01:44.565565 run osmo-msc_10.42.42.6(pid=30576): Launched 14:01:44.734008 run osmo-stp_10.42.42.5(pid=30573): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30573)] 14:01:44.861815 run osmo-stp_10.42.42.5(pid=30573): stdout: | (launched: 2022-12-14_14:01:43.546399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:44.989449 run osmo-stp_10.42.42.5(pid=30573): stderr: | 20221214140143719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140143719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140143719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140143719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140143720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140143720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140143720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:45.114839 run osmo-stp_10.42.42.5(pid=30573): stdout: | (launched: 2022-12-14_14:01:43.546399) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:45.235119 run osmo-stp_10.42.42.5(pid=30573): stderr: | 20221214140143719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140143719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140143719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140143719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140143720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140143720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140143720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:45.379324 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30573): Process ended prematurely: osmo-stp_10.42.42.5(pid=30573) [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30573)] [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 14:01:45.388096 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 14:01:45.414410 run osmo-hlr_10.42.42.2(pid=30570): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30570)] 14:01:45.461939 run osmo-hlr_10.42.42.2(pid=30570): stdout: | (launched: 2022-12-14_14:01:42.606585) 14:01:45.510877 run osmo-hlr_10.42.42.2(pid=30570): stderr: | 20221214140142782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140142782 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140142782 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140142782 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140142782 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140142782 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140142794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140142803 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140142803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140142803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:45.579726 run osmo-msc_10.42.42.6(pid=30576): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30576)] 14:01:45.627003 run osmo-msc_10.42.42.6(pid=30576): stdout: | (launched: 2022-12-14_14:01:44.508747) 14:01:45.675815 run osmo-msc_10.42.42.6(pid=30576): stderr: | 20221214140144780 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140144780 DLGLOBAL DEBUG validating counter group 0x7efda588ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140144780 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140144780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140144781 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140144781 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140144784 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140144785 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140144785 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140144785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:45.724815 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30569): Terminating (SIGTERM) 14:01:45.764363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30572): Terminating (SIGTERM) 14:01:45.803921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30575): Terminating (SIGTERM) 14:01:45.852173 --- ParallelTerminationStrategy: PID 30569 died... 14:01:45.888155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30569): Terminated: ok {rc=0} 14:01:45.942644 --- ParallelTerminationStrategy: PID 30572 died... 14:01:45.961918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30572): Terminated: ok {rc=0} 14:01:46.006489 --- ParallelTerminationStrategy: PID 30575 died... 14:01:46.026459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30575): Terminated: ok {rc=0} 14:01:46.111532 bus /sierra_3: Setting Powered False 14:01:47.204880 bus /sierra_3: Setting Powered False 14:01:48.319932 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 14:01:49.465913 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:49.477693 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:01:49.545290 tst mo_mt_call_osmux.py: using LAC 41394 14:01:49.665191 tst mo_mt_call_osmux.py: using RAC 84 14:01:49.783424 tst mo_mt_call_osmux.py: using CellId 41394 14:01:49.901098 tst mo_mt_call_osmux.py: using BVCI 41395 14:01:50.010235 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:50.021494 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:50.032474 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:50.043431 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:50.054538 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:01:50.065511 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:01:50.183274 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:01:50.303607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:01:50.773357 run create_hlr_db(pid=30578): Launched 14:01:50.896444 bus /sierra_2: Setting Powered False 14:01:51.957292 run create_hlr_db(pid=30578): Terminated: ok {rc=0} 14:01:52.399577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30580): Launched 14:01:52.723826 run osmo-hlr_10.42.42.2(pid=30581): Launched 14:01:52.847540 run osmo-stp_10.42.42.5: Starting osmo-stp 14:01:53.405648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30583): Launched 14:01:53.729228 run osmo-stp_10.42.42.5(pid=30584): Launched 14:01:53.852248 run osmo-msc_10.42.42.6: Starting osmo-msc 14:01:54.437039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30586): Launched 14:01:54.760831 run osmo-msc_10.42.42.6(pid=30587): Launched 14:01:54.941092 run osmo-stp_10.42.42.5(pid=30584): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30584)] 14:01:55.077672 run osmo-stp_10.42.42.5(pid=30584): stdout: | (launched: 2022-12-14_14:01:53.670229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:55.214481 run osmo-stp_10.42.42.5(pid=30584): stderr: | 20221214140153863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140153863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140153864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140153864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140153864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140153865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140153865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:55.350901 run osmo-stp_10.42.42.5(pid=30584): stdout: | (launched: 2022-12-14_14:01:53.670229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:01:55.480741 run osmo-stp_10.42.42.5(pid=30584): stderr: | 20221214140153863 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140153863 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140153864 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140153864 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140153864 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140153865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140153865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:01:55.635723 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30584): Process ended prematurely: osmo-stp_10.42.42.5(pid=30584) [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30584)] [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 14:01:55.645170 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:01:55.672685 run osmo-hlr_10.42.42.2(pid=30581): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30581)] 14:01:55.722855 run osmo-hlr_10.42.42.2(pid=30581): stdout: | (launched: 2022-12-14_14:01:52.665081) 14:01:55.774820 run osmo-hlr_10.42.42.2(pid=30581): stderr: | 20221214140152865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140152865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140152865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140152865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140152865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140152865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140152881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140152890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140152890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140152891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:01:55.847287 run osmo-msc_10.42.42.6(pid=30587): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30587)] 14:01:55.896728 run osmo-msc_10.42.42.6(pid=30587): stdout: | (launched: 2022-12-14_14:01:54.701863) 14:01:55.948316 run osmo-msc_10.42.42.6(pid=30587): stderr: | 20221214140155023 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140155023 DLGLOBAL DEBUG validating counter group 0x7f68929eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140155023 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140155024 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140155024 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140155024 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140155026 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140155026 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140155026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140155026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:01:56.000561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30580): Terminating (SIGTERM) 14:01:56.042250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30583): Terminating (SIGTERM) 14:01:56.084366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30586): Terminating (SIGTERM) 14:01:56.126494 --- ParallelTerminationStrategy: PID 30580 died... 14:01:56.146351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30580): Terminated: ok {rc=0} 14:01:56.192321 --- ParallelTerminationStrategy: PID 30583 died... 14:01:56.212042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30583): Terminated: ok {rc=0} 14:01:56.258395 --- ParallelTerminationStrategy: PID 30586 died... 14:01:56.278124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30586): Terminated: ok {rc=0} 14:01:56.366385 bus /sierra_3: Setting Powered False 14:01:57.464049 bus /sierra_3: Setting Powered False 14:01:58.580788 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 14:01:59.826921 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:01:59.833528 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 14:01:59.865031 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 14:01:59.891274 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 14:01:59.941594 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 14:01:59.973341 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 14:01:59.999591 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 14:02:00.552829 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 14:02:00.601321 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:00.612606 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:02:00.661458 tst mo_mt_call.py: using LAC 41395 14:02:00.779349 tst mo_mt_call.py: using RAC 85 14:02:00.910756 tst mo_mt_call.py: using CellId 41395 14:02:01.064507 tst mo_mt_call.py: using BVCI 41396 14:02:01.198833 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:01.211003 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:01.222923 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:01.234700 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:01.246587 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:01.258542 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:02:01.377218 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:02:01.518001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:02.040333 run create_hlr_db(pid=30592): Launched 14:02:02.210446 bus /sierra_2: Setting Powered False 14:02:03.274698 run create_hlr_db(pid=30592): Terminated: ok {rc=0} 14:02:03.709495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30594): Launched 14:02:04.012901 run osmo-hlr_10.42.42.2(pid=30595): Launched 14:02:04.128363 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:04.663372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30597): Launched 14:02:04.987876 run osmo-stp_10.42.42.5(pid=30598): Launched 14:02:05.112042 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:05.697132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30600): Launched 14:02:06.020753 run osmo-msc_10.42.42.6(pid=30601): Launched 14:02:06.201449 run osmo-stp_10.42.42.5(pid=30598): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30598)] 14:02:06.338225 run osmo-stp_10.42.42.5(pid=30598): stdout: | (launched: 2022-12-14_14:02:04.929116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:06.475825 run osmo-stp_10.42.42.5(pid=30598): stderr: | 20221214140205121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140205121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140205121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140205121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140205122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140205122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140205122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:06.612603 run osmo-stp_10.42.42.5(pid=30598): stdout: | (launched: 2022-12-14_14:02:04.929116) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:06.742506 run osmo-stp_10.42.42.5(pid=30598): stderr: | 20221214140205121 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140205121 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140205121 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140205121 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140205122 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140205122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140205122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:06.897341 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30598): Process ended prematurely: osmo-stp_10.42.42.5(pid=30598) [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30598)] [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 14:02:06.906768 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:02:06.934289 run osmo-hlr_10.42.42.2(pid=30595): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30595)] 14:02:06.984479 run osmo-hlr_10.42.42.2(pid=30595): stdout: | (launched: 2022-12-14_14:02:03.957175) 14:02:07.036908 run osmo-hlr_10.42.42.2(pid=30595): stderr: | 20221214140204135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140204135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140204135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140204135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140204135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140204135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140204151 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140204161 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140204161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140204161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:07.108803 run osmo-msc_10.42.42.6(pid=30601): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30601)] 14:02:07.157968 run osmo-msc_10.42.42.6(pid=30601): stdout: | (launched: 2022-12-14_14:02:05.961677) 14:02:07.209262 run osmo-msc_10.42.42.6(pid=30601): stderr: | 20221214140206286 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140206286 DLGLOBAL DEBUG validating counter group 0x7fe8e2978c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140206287 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140206287 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140206287 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140206287 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140206289 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140206289 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140206289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140206289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:07.260877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30594): Terminating (SIGTERM) 14:02:07.302673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30597): Terminating (SIGTERM) 14:02:07.344362 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30600): Terminating (SIGTERM) 14:02:07.386597 --- ParallelTerminationStrategy: PID 30594 died... 14:02:07.406847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30594): Terminated: ok {rc=0} 14:02:07.453187 --- ParallelTerminationStrategy: PID 30597 died... 14:02:07.473002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30597): Terminated: ok {rc=0} 14:02:07.519205 --- ParallelTerminationStrategy: PID 30600 died... 14:02:07.538981 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30600): Terminated: ok {rc=0} 14:02:07.627326 bus /sierra_3: Setting Powered False 14:02:08.725792 bus /sierra_3: Setting Powered False 14:02:09.843499 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 14:02:10.988281 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:11.000178 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:02:11.050101 tst mo_mt_call_osmux.py: using LAC 41396 14:02:11.169150 tst mo_mt_call_osmux.py: using RAC 86 14:02:11.289075 tst mo_mt_call_osmux.py: using CellId 41396 14:02:11.407880 tst mo_mt_call_osmux.py: using BVCI 41397 14:02:11.519085 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:11.530571 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:11.541906 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:11.553023 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:11.564299 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:02:11.575392 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:02:11.691477 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:02:11.811308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:12.314037 run create_hlr_db(pid=30603): Launched 14:02:12.437491 bus /sierra_2: Setting Powered False 14:02:13.502192 run create_hlr_db(pid=30603): Terminated: ok {rc=0} 14:02:13.952420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30605): Launched 14:02:14.276453 run osmo-hlr_10.42.42.2(pid=30606): Launched 14:02:14.400156 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:14.957652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30608): Launched 14:02:15.281984 run osmo-stp_10.42.42.5(pid=30609): Launched 14:02:15.405653 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:15.999048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30611): Launched 14:02:16.339930 run osmo-msc_10.42.42.6(pid=30612): Launched 14:02:16.620282 run osmo-stp_10.42.42.5(pid=30609): ERR: Terminated: ERROR {rc=1} [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30609)] 14:02:16.818583 run osmo-stp_10.42.42.5(pid=30609): stdout: | (launched: 2022-12-14_14:02:15.222612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:17.095596 run osmo-stp_10.42.42.5(pid=30609): stderr: | 20221214140215415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140215416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140215416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140215416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140215417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140215417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140215417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:17.336135 run osmo-stp_10.42.42.5(pid=30609): stdout: | (launched: 2022-12-14_14:02:15.222612) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:17.456819 run osmo-stp_10.42.42.5(pid=30609): stderr: | 20221214140215415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140215416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140215416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140215416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140215417 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140215417 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140215417 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:17.602300 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30609): Process ended prematurely: osmo-stp_10.42.42.5(pid=30609) [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30609)] [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 14:02:17.611192 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 14:02:17.637691 run osmo-hlr_10.42.42.2(pid=30606): ERR: Terminated: ERROR {rc=237} [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30606)] 14:02:17.685187 run osmo-hlr_10.42.42.2(pid=30606): stdout: | (launched: 2022-12-14_14:02:14.217187) 14:02:17.734165 run osmo-hlr_10.42.42.2(pid=30606): stderr: | 20221214140214416 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140214416 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140214416 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140214416 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140214416 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140214416 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140214428 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140214436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140214436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140214436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:17.803128 run osmo-msc_10.42.42.6(pid=30612): ERR: Terminated: ERROR {rc=2} [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30612)] 14:02:17.850463 run osmo-msc_10.42.42.6(pid=30612): stdout: | (launched: 2022-12-14_14:02:16.272821) 14:02:17.899321 run osmo-msc_10.42.42.6(pid=30612): stderr: | 20221214140216900 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140216900 DLGLOBAL DEBUG validating counter group 0x7f4c76dbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140216900 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140216900 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140216900 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140216900 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140216902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140216902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140216903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140216903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:17.948605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30605): Terminating (SIGTERM) 14:02:17.988014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30608): Terminating (SIGTERM) 14:02:18.027284 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30611): Terminating (SIGTERM) 14:02:18.067184 --- ParallelTerminationStrategy: PID 30605 died... 14:02:18.086155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30605): Terminated: ok {rc=0} 14:02:18.130275 --- ParallelTerminationStrategy: PID 30608 died... 14:02:18.148697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30608): Terminated: ok {rc=0} 14:02:18.192777 --- ParallelTerminationStrategy: PID 30611 died... 14:02:18.211435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30611): Terminated: ok {rc=0} 14:02:18.296345 bus /sierra_3: Setting Powered False 14:02:19.392757 bus /sierra_3: Setting Powered False 14:02:20.504581 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 emergency:nanobts+band-900 --------------------------------------------------------------------- 14:02:21.764918 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:21.771934 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 14:02:21.804533 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 14:02:21.832739 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 14:02:21.918297 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 14:02:21.949592 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 14:02:21.975313 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 14:02:22.563035 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2405 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 14:02:22.568300 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:22.579420 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 14:02:22.631060 tst emergency_mo_mt_call.py: using LAC 41397 14:02:22.755739 tst emergency_mo_mt_call.py: using RAC 87 14:02:22.879351 tst emergency_mo_mt_call.py: using CellId 41397 14:02:23.004068 tst emergency_mo_mt_call.py: using BVCI 41398 14:02:23.119750 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:23.131028 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:23.142090 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:23.153289 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:23.164424 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:23.175641 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:02:23.291429 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:02:23.404336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:23.867089 run create_hlr_db(pid=30617): Launched 14:02:23.990755 bus /sierra_2: Setting Powered False 14:02:25.049988 run create_hlr_db(pid=30617): Terminated: ok {rc=0} 14:02:25.486125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30619): Launched 14:02:25.807586 run osmo-hlr_10.42.42.2(pid=30620): Launched 14:02:25.929022 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:26.479681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30622): Launched 14:02:26.798913 run osmo-stp_10.42.42.5(pid=30623): Launched 14:02:26.930771 tst emergency_mo_mt_call.py: using MSISDN 8716 14:02:27.096713 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:27.671924 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30625): Launched 14:02:27.991870 run osmo-msc_10.42.42.6(pid=30626): Launched 14:02:28.170775 run osmo-stp_10.42.42.5(pid=30623): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30623)] 14:02:28.310283 run osmo-stp_10.42.42.5(pid=30623): stdout: | (launched: 2022-12-14_14:02:26.740258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:28.441543 run osmo-stp_10.42.42.5(pid=30623): stderr: | 20221214140226933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140226933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140226933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140226934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140226936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140226936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140226936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:28.574500 run osmo-stp_10.42.42.5(pid=30623): stdout: | (launched: 2022-12-14_14:02:26.740258) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:28.701989 run osmo-stp_10.42.42.5(pid=30623): stderr: | 20221214140226933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140226933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140226933 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140226934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140226936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140226936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140226936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:28.854190 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=30623): Process ended prematurely: osmo-stp_10.42.42.5(pid=30623) [trial-2405↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30623)] [trial-2405↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 14:02:28.863204 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 14:02:28.890944 run osmo-hlr_10.42.42.2(pid=30620): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30620)] 14:02:28.942046 run osmo-hlr_10.42.42.2(pid=30620): stdout: | (launched: 2022-12-14_14:02:25.748756) 14:02:28.993844 run osmo-hlr_10.42.42.2(pid=30620): stderr: | 20221214140225945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140225946 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140225946 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140225946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140225946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140225946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140225958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140225967 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140225967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140225967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:29.067077 run osmo-msc_10.42.42.6(pid=30626): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30626)] 14:02:29.116921 run osmo-msc_10.42.42.6(pid=30626): stdout: | (launched: 2022-12-14_14:02:27.932925) 14:02:29.168536 run osmo-msc_10.42.42.6(pid=30626): stderr: | 20221214140228256 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140228256 DLGLOBAL DEBUG validating counter group 0x7fd417a80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140228256 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140228256 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140228256 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140228256 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140228258 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140228260 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140228260 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140228260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:29.220703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30619): Terminating (SIGTERM) 14:02:29.262656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30622): Terminating (SIGTERM) 14:02:29.304513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30625): Terminating (SIGTERM) 14:02:29.347480 --- ParallelTerminationStrategy: PID 30619 died... 14:02:29.367786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30619): Terminated: ok {rc=0} 14:02:29.414346 --- ParallelTerminationStrategy: PID 30622 died... 14:02:29.434250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30622): Terminated: ok {rc=0} 14:02:29.480510 --- ParallelTerminationStrategy: PID 30625 died... 14:02:29.500342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30625): Terminated: ok {rc=0} 14:02:29.587383 bus /sierra_3: Setting Powered False 14:02:30.684492 bus /sierra_3: Setting Powered False 14:02:31.807025 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 14:02:32.895482 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:32.907274 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 14:02:32.958431 tst emergency_preemptive_call.py: using LAC 41398 14:02:33.076359 tst emergency_preemptive_call.py: using RAC 88 14:02:33.205312 tst emergency_preemptive_call.py: using CellId 41398 14:02:33.324774 tst emergency_preemptive_call.py: using BVCI 41399 14:02:33.434036 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:33.444771 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:33.455196 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:33.465634 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:33.475989 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 14:02:33.486953 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:02:33.604843 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:02:33.720264 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:02:33.837998 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 14:02:33.953047 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:34.417818 run create_hlr_db(pid=30628): Launched 14:02:34.540420 bus /sierra_2: Setting Powered False 14:02:35.600720 run create_hlr_db(pid=30628): Terminated: ok {rc=0} 14:02:36.038582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30630): Launched 14:02:36.360934 run osmo-hlr_10.42.42.2(pid=30631): Launched 14:02:36.483930 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:37.041706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30633): Launched 14:02:37.341535 run osmo-stp_10.42.42.5(pid=30634): Launched 14:02:37.464540 tst emergency_preemptive_call.py: using MSISDN 8717 14:02:37.617316 run osmo-msc_10.42.42.6: Starting osmo-msc 14:02:38.152773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30636): Launched 14:02:38.451285 run osmo-msc_10.42.42.6(pid=30637): Launched 14:02:38.618545 run osmo-stp_10.42.42.5(pid=30634): ERR: Terminated: ERROR {rc=1} [trial-2405↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30634)] 14:02:38.744912 run osmo-stp_10.42.42.5(pid=30634): stdout: | (launched: 2022-12-14_14:02:37.286275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:38.870648 run osmo-stp_10.42.42.5(pid=30634): stderr: | 20221214140237458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140237458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140237458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140237459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140237459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140237459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140237460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:38.995513 run osmo-stp_10.42.42.5(pid=30634): stdout: | (launched: 2022-12-14_14:02:37.286275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:39.114292 run osmo-stp_10.42.42.5(pid=30634): stderr: | 20221214140237458 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140237458 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140237458 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140237459 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140237459 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140237459 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140237460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:39.256440 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=30634): Process ended prematurely: osmo-stp_10.42.42.5(pid=30634) [trial-2405↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30634)] [trial-2405↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 14:02:39.264780 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 14:02:39.290984 run osmo-hlr_10.42.42.2(pid=30631): ERR: Terminated: ERROR {rc=237} [trial-2405↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30631)] 14:02:39.339198 run osmo-hlr_10.42.42.2(pid=30631): stdout: | (launched: 2022-12-14_14:02:36.301862) 14:02:39.388783 run osmo-hlr_10.42.42.2(pid=30631): stderr: | 20221214140236499 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140236499 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140236499 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140236500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140236500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140236500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140236512 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140236520 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140236520 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140236520 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:39.458039 run osmo-msc_10.42.42.6(pid=30637): ERR: Terminated: ERROR {rc=2} [trial-2405↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30637)] 14:02:39.505953 run osmo-msc_10.42.42.6(pid=30637): stdout: | (launched: 2022-12-14_14:02:38.395867) 14:02:39.555231 run osmo-msc_10.42.42.6(pid=30637): stderr: | 20221214140238670 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140238670 DLGLOBAL DEBUG validating counter group 0x7f50d0389c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140238670 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140238670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140238670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140238671 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140238672 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140238673 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140238673 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140238673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:02:39.604524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30630): Terminating (SIGTERM) 14:02:39.644303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30633): Terminating (SIGTERM) 14:02:39.684316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30636): Terminating (SIGTERM) 14:02:39.724514 --- ParallelTerminationStrategy: PID 30630 died... 14:02:39.743985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30630): Terminated: ok {rc=0} 14:02:39.788256 --- ParallelTerminationStrategy: PID 30633 died... 14:02:39.807214 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30633): Terminated: ok {rc=0} 14:02:39.851412 --- ParallelTerminationStrategy: PID 30636 died... 14:02:39.870251 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30636): Terminated: ok {rc=0} 14:02:39.955933 bus /sierra_9: Setting Powered False 14:02:41.055644 bus /sierra_9: Setting Powered False 14:02:42.171286 bus /sierra_8: Setting Powered False 14:02:43.269319 bus /sierra_8: Setting Powered False 14:02:44.383235 bus /sierra_3: Setting Powered False 14:02:45.480898 bus /sierra_3: Setting Powered False 14:02:46.598749 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-900 --------------------------------------------------------------------- 14:02:47.882042 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:02:47.888140 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 14:02:47.919817 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 14:02:47.958057 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 14:02:48.045863 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 14:02:48.080410 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 14:02:48.119680 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 14:02:48.702917 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 14:02:48.752666 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:02:48.763254 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:02:48.809109 tst cs_paging_gprs_active.py: using LAC 41399 14:02:48.938594 tst cs_paging_gprs_active.py: using RAC 89 14:02:49.067372 tst cs_paging_gprs_active.py: using CellId 41399 14:02:49.195197 tst cs_paging_gprs_active.py: using BVCI 41400 14:02:49.313502 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:02:49.324720 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:02:49.335892 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:02:49.346821 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:02:49.358020 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:02:49.369259 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:02:49.380512 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:02:49.391302 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:02:49.403139 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:02:49.518998 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:02:49.636105 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:02:49.840064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:02:50.144845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30642): Launched 14:02:50.410265 run iperf3-srv_10.42.42.10(pid=30643): Launched 14:02:50.523621 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:02:50.726998 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:02:51.032261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30644): Launched 14:02:51.297177 run iperf3-srv_10.42.42.10(pid=30645): Launched 14:02:51.410399 tst cs_paging_gprs_active.py:38: start network... 14:02:51.612919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:02:52.082631 run create_hlr_db(pid=30646): Launched 14:02:52.207327 bus /sierra_2: Setting Powered False 14:02:53.267591 run create_hlr_db(pid=30646): Terminated: ok {rc=0} 14:02:53.710691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30648): Launched 14:02:54.019713 run osmo-hlr_10.42.42.2(pid=30649): Launched 14:02:54.136053 run osmo-stp_10.42.42.5: Starting osmo-stp 14:02:54.661337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30651): Launched 14:02:54.965125 run osmo-stp_10.42.42.5(pid=30652): Launched 14:02:55.081918 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:02:55.604573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30654): Launched 14:02:55.720304 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:02:55.976819 run patchelf(pid=30655): Launched 14:02:56.144663 run osmo-stp_10.42.42.5(pid=30652): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30652)] 14:02:56.272165 run osmo-stp_10.42.42.5(pid=30652): stdout: | (launched: 2022-12-14_14:02:54.908756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:56.401330 run osmo-stp_10.42.42.5(pid=30652): stderr: | 20221214140255081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140255081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140255081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140255082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140255084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140255084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140255084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:56.530989 run osmo-stp_10.42.42.5(pid=30652): stdout: | (launched: 2022-12-14_14:02:54.908756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:02:56.654364 run osmo-stp_10.42.42.5(pid=30652): stderr: | 20221214140255081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140255081 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140255081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140255082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140255084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140255084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140255084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:02:56.801184 run patchelf(pid=30655): Terminating (SIGINT) 14:02:56.970707 run patchelf(pid=30655): Terminated: ok {rc=0} 14:02:57.093796 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30652): Process ended prematurely: osmo-stp_10.42.42.5(pid=30652) [trial-2405↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30652)] [trial-2405↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 14:02:57.103192 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 14:02:57.130076 run osmo-hlr_10.42.42.2(pid=30649): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30649)] 14:02:57.177130 run osmo-hlr_10.42.42.2(pid=30649): stdout: | (launched: 2022-12-14_14:02:53.963759) 14:02:57.226142 run osmo-hlr_10.42.42.2(pid=30649): stderr: | 20221214140254142 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140254142 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140254142 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140254142 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140254142 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140254142 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140254154 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140254163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140254163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140254163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:02:57.275150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30642): Terminating (SIGTERM) 14:02:57.314374 run iperf3-srv_10.42.42.10(pid=30643): Terminating (SIGTERM) 14:02:57.353491 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30644): Terminating (SIGTERM) 14:02:57.392749 run iperf3-srv_10.42.42.10(pid=30645): Terminating (SIGTERM) 14:02:57.431628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30648): Terminating (SIGTERM) 14:02:57.470801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30651): Terminating (SIGTERM) 14:02:57.509956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30654): Terminating (SIGTERM) 14:02:57.549480 --- ParallelTerminationStrategy: PID 30642 died... 14:02:57.568445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30642): Terminated: ok {rc=0} 14:02:57.612702 --- ParallelTerminationStrategy: PID 30643 died... 14:02:57.631164 run iperf3-srv_10.42.42.10(pid=30643): Terminated {rc=256} 14:02:57.674534 --- ParallelTerminationStrategy: PID 30644 died... 14:02:57.692920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30644): Terminated: ok {rc=0} 14:02:57.736615 --- ParallelTerminationStrategy: PID 30645 died... 14:02:57.755082 run iperf3-srv_10.42.42.10(pid=30645): Terminated {rc=256} 14:02:57.798518 --- ParallelTerminationStrategy: PID 30648 died... 14:02:57.817009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30648): Terminated: ok {rc=0} 14:02:57.860443 --- ParallelTerminationStrategy: PID 30651 died... 14:02:57.879072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30651): Terminated: ok {rc=0} 14:02:57.922608 --- ParallelTerminationStrategy: PID 30654 died... 14:02:57.941190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30654): Terminated: ok {rc=0} 14:02:58.026305 bus /gobi_0: Setting Powered False 14:02:59.125311 bus /gobi_0: Setting Powered False 14:03:00.238582 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 14:03:01.389962 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:01.402727 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:03:01.456409 tst iperf3.py: using LAC 41400 14:03:01.587684 tst iperf3.py: using RAC 90 14:03:01.719089 tst iperf3.py: using CellId 41400 14:03:01.882243 tst iperf3.py: using BVCI 41401 14:03:02.046415 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:02.061740 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:02.077637 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:02.093360 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:02.110315 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:02.127308 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:02.142541 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:02.157189 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:02.174642 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:03:02.307119 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:03:02.528312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:03:02.855130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30657): Launched 14:03:03.139033 run iperf3-srv_10.42.42.10(pid=30658): Launched 14:03:03.261518 tst iperf3.py:8: start network... 14:03:03.482326 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:03.986848 run create_hlr_db(pid=30659): Launched 14:03:04.113114 bus /gobi_6: Setting Powered False 14:03:05.178116 run create_hlr_db(pid=30659): Terminated: ok {rc=0} 14:03:05.615536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30661): Launched 14:03:05.920879 run osmo-hlr_10.42.42.2(pid=30662): Launched 14:03:06.036511 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:06.576177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30664): Launched 14:03:06.881133 run osmo-stp_10.42.42.5(pid=30665): Launched 14:03:06.997779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:03:07.521693 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30667): Launched 14:03:07.637327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:03:07.893777 run patchelf(pid=30668): Launched 14:03:08.062184 run osmo-stp_10.42.42.5(pid=30665): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30665)] 14:03:08.190462 run osmo-stp_10.42.42.5(pid=30665): stdout: | (launched: 2022-12-14_14:03:06.824753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:08.320233 run osmo-stp_10.42.42.5(pid=30665): stderr: | 20221214140306996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140306997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140306997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140306997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140306998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140306998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140306998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:08.450480 run osmo-stp_10.42.42.5(pid=30665): stdout: | (launched: 2022-12-14_14:03:06.824753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:08.574733 run osmo-stp_10.42.42.5(pid=30665): stderr: | 20221214140306996 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140306997 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140306997 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140306997 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140306998 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140306998 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140306998 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:08.721989 run patchelf(pid=30668): Terminating (SIGINT) 14:03:08.892209 run patchelf(pid=30668): Terminated: ok {rc=0} 14:03:09.014841 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30665): Process ended prematurely: osmo-stp_10.42.42.5(pid=30665) [trial-2405↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30665)] [trial-2405↪gprs:nanobts+band-900↪iperf3.py:8] 14:03:09.024201 tst iperf3.py:8: Test FAILED (7.7 sec) 14:03:09.051231 run osmo-hlr_10.42.42.2(pid=30662): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30662)] 14:03:09.099035 run osmo-hlr_10.42.42.2(pid=30662): stdout: | (launched: 2022-12-14_14:03:05.864704) 14:03:09.147886 run osmo-hlr_10.42.42.2(pid=30662): stderr: | 20221214140306042 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140306042 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140306042 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140306042 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140306043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140306043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140306055 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140306065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140306065 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140306065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:09.197561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30657): Terminating (SIGTERM) 14:03:09.237380 run iperf3-srv_10.42.42.10(pid=30658): Terminating (SIGTERM) 14:03:09.276540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30661): Terminating (SIGTERM) 14:03:09.315938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30664): Terminating (SIGTERM) 14:03:09.355158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30667): Terminating (SIGTERM) 14:03:09.394598 --- ParallelTerminationStrategy: PID 30657 died... 14:03:09.413754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30657): Terminated: ok {rc=0} 14:03:09.457420 --- ParallelTerminationStrategy: PID 30658 died... 14:03:09.475741 run iperf3-srv_10.42.42.10(pid=30658): Terminated {rc=256} 14:03:09.519213 --- ParallelTerminationStrategy: PID 30661 died... 14:03:09.537677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30661): Terminated: ok {rc=0} 14:03:09.581266 --- ParallelTerminationStrategy: PID 30664 died... 14:03:09.599746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30664): Terminated: ok {rc=0} 14:03:09.643543 --- ParallelTerminationStrategy: PID 30667 died... 14:03:09.662073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30667): Terminated: ok {rc=0} 14:03:09.747273 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 14:03:10.892807 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:10.904002 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:03:10.955187 tst iperf3m4.py: using LAC 41401 14:03:11.073619 tst iperf3m4.py: using RAC 91 14:03:11.190396 tst iperf3m4.py: using CellId 41401 14:03:11.308262 tst iperf3m4.py: using BVCI 41402 14:03:11.419524 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:11.430387 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:11.440913 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:11.451456 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:11.461916 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:11.472358 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:11.483089 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:11.493450 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:11.504022 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:03:11.625793 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:03:11.750494 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:03:11.867236 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:03:11.987566 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:03:12.209991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:03:12.537535 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30669): Launched 14:03:12.821794 run iperf3-srv_10.42.42.10(pid=30670): Launched 14:03:12.944081 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:03:13.164739 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:03:13.492399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30671): Launched 14:03:13.776598 run iperf3-srv_10.42.42.10(pid=30672): Launched 14:03:13.899040 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:03:14.119689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:03:14.447159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30673): Launched 14:03:14.731244 run iperf3-srv_10.42.42.10(pid=30674): Launched 14:03:14.853484 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:03:15.073961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:03:15.402443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30675): Launched 14:03:15.685898 run iperf3-srv_10.42.42.10(pid=30676): Launched 14:03:15.807987 tst iperf3m4.py:8: start network... 14:03:16.031617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:16.603496 run create_hlr_db(pid=30677): Launched 14:03:16.767034 bus /gobi_6: Setting Powered False 14:03:17.828172 run create_hlr_db(pid=30677): Terminated: ok {rc=0} 14:03:18.288043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30679): Launched 14:03:18.615461 run osmo-hlr_10.42.42.2(pid=30680): Launched 14:03:18.740874 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:19.305525 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30682): Launched 14:03:19.632497 run osmo-stp_10.42.42.5(pid=30683): Launched 14:03:19.756874 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:03:20.319259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30685): Launched 14:03:20.443978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:03:20.718918 run patchelf(pid=30686): Launched 14:03:20.899617 run osmo-stp_10.42.42.5(pid=30683): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30683)] 14:03:21.037771 run osmo-stp_10.42.42.5(pid=30683): stdout: | (launched: 2022-12-14_14:03:19.572492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:21.177757 run osmo-stp_10.42.42.5(pid=30683): stderr: | 20221214140319768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140319768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140319768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140319769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140319769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140319769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140319769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:21.317812 run osmo-stp_10.42.42.5(pid=30683): stdout: | (launched: 2022-12-14_14:03:19.572492) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:21.451580 run osmo-stp_10.42.42.5(pid=30683): stderr: | 20221214140319768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140319768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140319768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140319769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140319769 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140319769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140319769 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:21.609862 run patchelf(pid=30686): Terminating (SIGINT) 14:03:21.791996 run patchelf(pid=30686): Terminated: ok {rc=0} 14:03:21.923874 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30683): Process ended prematurely: osmo-stp_10.42.42.5(pid=30683) [trial-2405↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30683)] [trial-2405↪gprs:nanobts+band-900↪iperf3m4.py:8] 14:03:21.934295 tst iperf3m4.py:8: Test FAILED (11.1 sec) 14:03:21.962769 run osmo-hlr_10.42.42.2(pid=30680): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30680)] 14:03:22.013314 run osmo-hlr_10.42.42.2(pid=30680): stdout: | (launched: 2022-12-14_14:03:18.555286) 14:03:22.065434 run osmo-hlr_10.42.42.2(pid=30680): stderr: | 20221214140318755 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140318755 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140318755 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140318755 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140318756 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140318756 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140318767 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140318775 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140318776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140318776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:22.116935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30669): Terminating (SIGTERM) 14:03:22.158733 run iperf3-srv_10.42.42.10(pid=30670): Terminating (SIGTERM) 14:03:22.200339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30671): Terminating (SIGTERM) 14:03:22.242118 run iperf3-srv_10.42.42.10(pid=30672): Terminating (SIGTERM) 14:03:22.283619 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30673): Terminating (SIGTERM) 14:03:22.325346 run iperf3-srv_10.42.42.10(pid=30674): Terminating (SIGTERM) 14:03:22.366629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30675): Terminating (SIGTERM) 14:03:22.408026 run iperf3-srv_10.42.42.10(pid=30676): Terminating (SIGTERM) 14:03:22.449402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30679): Terminating (SIGTERM) 14:03:22.490825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30682): Terminating (SIGTERM) 14:03:22.532136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30685): Terminating (SIGTERM) 14:03:22.573969 --- ParallelTerminationStrategy: PID 30669 died... 14:03:22.593844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30669): Terminated: ok {rc=0} 14:03:22.639863 --- ParallelTerminationStrategy: PID 30670 died... 14:03:22.659446 run iperf3-srv_10.42.42.10(pid=30670): Terminated {rc=256} 14:03:22.705335 --- ParallelTerminationStrategy: PID 30671 died... 14:03:22.724942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30671): Terminated: ok {rc=0} 14:03:22.771156 --- ParallelTerminationStrategy: PID 30672 died... 14:03:22.791041 run iperf3-srv_10.42.42.10(pid=30672): Terminated {rc=256} 14:03:22.837040 --- ParallelTerminationStrategy: PID 30673 died... 14:03:22.857306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30673): Terminated: ok {rc=0} 14:03:22.903080 --- ParallelTerminationStrategy: PID 30674 died... 14:03:22.922753 run iperf3-srv_10.42.42.10(pid=30674): Terminated {rc=256} 14:03:22.968558 --- ParallelTerminationStrategy: PID 30675 died... 14:03:22.988553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30675): Terminated: ok {rc=0} 14:03:23.034562 --- ParallelTerminationStrategy: PID 30676 died... 14:03:23.054405 run iperf3-srv_10.42.42.10(pid=30676): Terminated {rc=256} 14:03:23.100486 --- ParallelTerminationStrategy: PID 30679 died... 14:03:23.120355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30679): Terminated: ok {rc=0} 14:03:23.166412 --- ParallelTerminationStrategy: PID 30682 died... 14:03:23.186285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30682): Terminated: ok {rc=0} 14:03:23.232311 --- ParallelTerminationStrategy: PID 30685 died... 14:03:23.252285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30685): Terminated: ok {rc=0} 14:03:23.340364 bus /gobi_4: Setting Powered False 14:03:24.438952 bus /gobi_4: Setting Powered False 14:03:25.553891 bus /gobi_1: Setting Powered False 14:03:26.651012 bus /gobi_1: Setting Powered False 14:03:27.766315 bus /gobi_0: Setting Powered False 14:03:28.863934 bus /gobi_0: Setting Powered False 14:03:29.978821 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900 ping.py ---------------------------------------------- 14:03:31.089962 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:31.105568 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:03:31.167626 tst ping.py: using LAC 41402 14:03:31.308491 tst ping.py: using RAC 92 14:03:31.428406 tst ping.py: using CellId 41402 14:03:31.564603 tst ping.py: using BVCI 41403 14:03:31.711048 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:31.724255 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:31.737475 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:31.750750 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:31.764225 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:31.778348 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:31.792002 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:31.805666 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:03:31.947848 tst ping.py:19: start network... 14:03:32.181505 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:32.682310 run create_hlr_db(pid=30687): Launched 14:03:32.806092 bus /gobi_6: Setting Powered False 14:03:33.869209 run create_hlr_db(pid=30687): Terminated: ok {rc=0} 14:03:34.298427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30689): Launched 14:03:34.598044 run osmo-hlr_10.42.42.2(pid=30690): Launched 14:03:34.710935 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:35.244693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30692): Launched 14:03:35.544034 run osmo-stp_10.42.42.5(pid=30693): Launched 14:03:35.656839 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:03:36.171647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30695): Launched 14:03:36.285376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:03:36.538143 run patchelf(pid=30696): Launched 14:03:36.704106 run osmo-stp_10.42.42.5(pid=30693): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30693)] 14:03:36.829969 run osmo-stp_10.42.42.5(pid=30693): stdout: | (launched: 2022-12-14_14:03:35.488360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:36.957544 run osmo-stp_10.42.42.5(pid=30693): stderr: | 20221214140335662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140335662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140335662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140335662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140335663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140335663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140335663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:37.085097 run osmo-stp_10.42.42.5(pid=30693): stdout: | (launched: 2022-12-14_14:03:35.488360) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:37.207661 run osmo-stp_10.42.42.5(pid=30693): stderr: | 20221214140335662 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140335662 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140335662 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140335662 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140335663 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140335663 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140335663 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:37.352369 run patchelf(pid=30696): Terminating (SIGINT) 14:03:37.520512 run patchelf(pid=30696): Terminated: ok {rc=0} 14:03:37.640472 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30693): Process ended prematurely: osmo-stp_10.42.42.5(pid=30693) [trial-2405↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30693)] [trial-2405↪gprs:nanobts+band-900↪ping.py:22] 14:03:37.649239 tst ping.py:22: Test FAILED (6.6 sec) 14:03:37.676109 run osmo-hlr_10.42.42.2(pid=30690): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30690)] 14:03:37.723650 run osmo-hlr_10.42.42.2(pid=30690): stdout: | (launched: 2022-12-14_14:03:34.542158) 14:03:37.773190 run osmo-hlr_10.42.42.2(pid=30690): stderr: | 20221214140334717 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140334717 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140334717 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140334717 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140334717 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140334718 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140334730 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140334741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140334741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140334741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:37.822858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30689): Terminating (SIGTERM) 14:03:37.862416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30692): Terminating (SIGTERM) 14:03:37.902043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30695): Terminating (SIGTERM) 14:03:37.942087 --- ParallelTerminationStrategy: PID 30689 died... 14:03:37.961344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30689): Terminated: ok {rc=0} 14:03:38.005651 --- ParallelTerminationStrategy: PID 30692 died... 14:03:38.024445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30692): Terminated: ok {rc=0} 14:03:38.068488 --- ParallelTerminationStrategy: PID 30695 died... 14:03:38.087356 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30695): Terminated: ok {rc=0} 14:03:38.172940 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 14:03:39.260606 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:39.271859 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 14:03:39.319304 tst ping_idle_ping.py: using LAC 41403 14:03:39.439082 tst ping_idle_ping.py: using RAC 93 14:03:39.556580 tst ping_idle_ping.py: using CellId 41403 14:03:39.673938 tst ping_idle_ping.py: using BVCI 41404 14:03:39.792201 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:39.803490 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:39.814650 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:39.825714 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:39.837082 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:39.848411 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:39.859787 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 14:03:39.871445 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 14:03:39.993526 tst ping_idle_ping.py:24: start network... 14:03:40.211676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:40.713853 run create_hlr_db(pid=30697): Launched 14:03:40.837901 bus /gobi_6: Setting Powered False 14:03:41.902884 run create_hlr_db(pid=30697): Terminated: ok {rc=0} 14:03:42.333118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30699): Launched 14:03:42.635986 run osmo-hlr_10.42.42.2(pid=30700): Launched 14:03:42.750661 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:43.272843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30702): Launched 14:03:43.574498 run osmo-stp_10.42.42.5(pid=30703): Launched 14:03:43.688740 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:03:44.206353 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30705): Launched 14:03:44.320928 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:03:44.574734 run patchelf(pid=30706): Launched 14:03:44.741366 run osmo-stp_10.42.42.5(pid=30703): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30703)] 14:03:44.867848 run osmo-stp_10.42.42.5(pid=30703): stdout: | (launched: 2022-12-14_14:03:43.518876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:44.995766 run osmo-stp_10.42.42.5(pid=30703): stderr: | 20221214140343691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140343691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140343692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140343692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140343693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140343693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140343693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:45.126375 run osmo-stp_10.42.42.5(pid=30703): stdout: | (launched: 2022-12-14_14:03:43.518876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:45.249397 run osmo-stp_10.42.42.5(pid=30703): stderr: | 20221214140343691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140343691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140343692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140343692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140343693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140343693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140343693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:45.394854 run patchelf(pid=30706): Terminating (SIGINT) 14:03:45.563320 run patchelf(pid=30706): Terminated: ok {rc=0} 14:03:45.683795 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30703): Process ended prematurely: osmo-stp_10.42.42.5(pid=30703) [trial-2405↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30703)] [trial-2405↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 14:03:45.693028 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 14:03:45.719963 run osmo-hlr_10.42.42.2(pid=30700): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30700)] 14:03:45.767261 run osmo-hlr_10.42.42.2(pid=30700): stdout: | (launched: 2022-12-14_14:03:42.580229) 14:03:45.816395 run osmo-hlr_10.42.42.2(pid=30700): stderr: | 20221214140342759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140342759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140342759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140342759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140342759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140342759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140342771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140342780 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140342780 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140342780 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:45.875293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30699): Terminating (SIGTERM) 14:03:45.919158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30702): Terminating (SIGTERM) 14:03:45.965787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30705): Terminating (SIGTERM) 14:03:46.012602 --- ParallelTerminationStrategy: PID 30699 died... 14:03:46.034664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30699): Terminated: ok {rc=0} 14:03:46.087330 --- ParallelTerminationStrategy: PID 30702 died... 14:03:46.108111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30702): Terminated: ok {rc=0} 14:03:46.156891 --- ParallelTerminationStrategy: PID 30705 died... 14:03:46.178506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30705): Terminated: ok {rc=0} 14:03:46.277407 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 14:03:47.598594 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:03:47.605331 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 14:03:47.638466 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 14:03:47.678702 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 14:03:47.766377 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 14:03:47.799028 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 14:03:47.838227 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 14:03:48.439261 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 14:03:48.492873 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:03:48.504232 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:03:48.554245 tst cs_paging_gprs_active.py: using LAC 41404 14:03:48.675423 tst cs_paging_gprs_active.py: using RAC 94 14:03:48.796396 tst cs_paging_gprs_active.py: using CellId 41404 14:03:48.915650 tst cs_paging_gprs_active.py: using BVCI 41405 14:03:49.027399 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:03:49.038285 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:03:49.048899 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:03:49.059467 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:03:49.070442 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:03:49.081070 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:03:49.091672 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:03:49.102613 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:03:49.113293 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:03:49.233523 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:03:49.353534 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:03:49.574984 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:03:49.903371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30710): Launched 14:03:50.188359 run iperf3-srv_10.42.42.10(pid=30711): Launched 14:03:50.313272 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:03:50.534731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:03:50.864937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30712): Launched 14:03:51.149413 run iperf3-srv_10.42.42.10(pid=30713): Launched 14:03:51.271208 tst cs_paging_gprs_active.py:38: start network... 14:03:51.491836 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:03:51.998527 run create_hlr_db(pid=30714): Launched 14:03:52.124109 bus /gobi_6: Setting Powered False 14:03:53.186072 run create_hlr_db(pid=30714): Terminated: ok {rc=0} 14:03:53.619650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30716): Launched 14:03:53.925502 run osmo-hlr_10.42.42.2(pid=30717): Launched 14:03:54.042935 run osmo-stp_10.42.42.5: Starting osmo-stp 14:03:54.567887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30719): Launched 14:03:54.872935 run osmo-stp_10.42.42.5(pid=30720): Launched 14:03:54.989758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:03:55.516853 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30722): Launched 14:03:55.633725 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:03:55.891041 run patchelf(pid=30723): Launched 14:03:56.060090 run osmo-stp_10.42.42.5(pid=30720): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30720)] 14:03:56.188486 run osmo-stp_10.42.42.5(pid=30720): stdout: | (launched: 2022-12-14_14:03:54.816465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:56.318543 run osmo-stp_10.42.42.5(pid=30720): stderr: | 20221214140354989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140354989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140354989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140354990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140354990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140354990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140354990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:56.448713 run osmo-stp_10.42.42.5(pid=30720): stdout: | (launched: 2022-12-14_14:03:54.816465) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:03:56.573223 run osmo-stp_10.42.42.5(pid=30720): stderr: | 20221214140354989 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140354989 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140354989 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140354990 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140354990 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140354990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140354990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:03:56.720499 run patchelf(pid=30723): Terminating (SIGINT) 14:03:56.890899 run patchelf(pid=30723): Terminated: ok {rc=0} 14:03:57.013500 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30720): Process ended prematurely: osmo-stp_10.42.42.5(pid=30720) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30720)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 14:03:57.022792 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 14:03:57.049631 run osmo-hlr_10.42.42.2(pid=30717): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30717)] 14:03:57.096499 run osmo-hlr_10.42.42.2(pid=30717): stdout: | (launched: 2022-12-14_14:03:53.869380) 14:03:57.145110 run osmo-hlr_10.42.42.2(pid=30717): stderr: | 20221214140354047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140354047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140354047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140354047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140354047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140354047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140354060 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140354070 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140354070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140354070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:03:57.193867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30710): Terminating (SIGTERM) 14:03:57.232831 run iperf3-srv_10.42.42.10(pid=30711): Terminating (SIGTERM) 14:03:57.271687 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30712): Terminating (SIGTERM) 14:03:57.310804 run iperf3-srv_10.42.42.10(pid=30713): Terminating (SIGTERM) 14:03:57.349697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30716): Terminating (SIGTERM) 14:03:57.388689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30719): Terminating (SIGTERM) 14:03:57.427622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30722): Terminating (SIGTERM) 14:03:57.467145 --- ParallelTerminationStrategy: PID 30710 died... 14:03:57.486132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30710): Terminated: ok {rc=0} 14:03:57.529470 --- ParallelTerminationStrategy: PID 30711 died... 14:03:57.547918 run iperf3-srv_10.42.42.10(pid=30711): Terminated {rc=256} 14:03:57.591588 --- ParallelTerminationStrategy: PID 30712 died... 14:03:57.610157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30712): Terminated: ok {rc=0} 14:03:57.653475 --- ParallelTerminationStrategy: PID 30713 died... 14:03:57.671866 run iperf3-srv_10.42.42.10(pid=30713): Terminated {rc=256} 14:03:57.715226 --- ParallelTerminationStrategy: PID 30716 died... 14:03:57.733668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30716): Terminated: ok {rc=0} 14:03:57.776783 --- ParallelTerminationStrategy: PID 30719 died... 14:03:57.795258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30719): Terminated: ok {rc=0} 14:03:57.838546 --- ParallelTerminationStrategy: PID 30722 died... 14:03:57.856922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30722): Terminated: ok {rc=0} 14:03:57.939301 bus /gobi_0: Setting Powered False 14:03:59.033756 bus /gobi_0: Setting Powered False 14:04:00.145972 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 14:04:01.293291 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:01.306295 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:04:01.364584 tst iperf3.py: using LAC 41405 14:04:01.487257 tst iperf3.py: using RAC 95 14:04:01.613349 tst iperf3.py: using CellId 41405 14:04:01.763999 tst iperf3.py: using BVCI 41406 14:04:01.885516 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:01.898224 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:01.910825 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:01.923202 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:01.936516 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:01.949942 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:01.963136 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:01.976394 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:01.990006 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:04:02.112195 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:04:02.338126 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:04:02.666443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30724): Launched 14:04:02.951190 run iperf3-srv_10.42.42.10(pid=30725): Launched 14:04:03.073950 tst iperf3.py:8: start network... 14:04:03.295115 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:03.800309 run create_hlr_db(pid=30726): Launched 14:04:03.924843 bus /gobi_6: Setting Powered False 14:04:04.989191 run create_hlr_db(pid=30726): Terminated: ok {rc=0} 14:04:05.426355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30728): Launched 14:04:05.732049 run osmo-hlr_10.42.42.2(pid=30729): Launched 14:04:05.846940 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:06.370388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30731): Launched 14:04:06.673999 run osmo-stp_10.42.42.5(pid=30732): Launched 14:04:06.789955 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:04:07.313248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30734): Launched 14:04:07.429442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:04:07.687095 run patchelf(pid=30735): Launched 14:04:07.855947 run osmo-stp_10.42.42.5(pid=30732): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30732)] 14:04:07.984297 run osmo-stp_10.42.42.5(pid=30732): stdout: | (launched: 2022-12-14_14:04:06.617743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:08.113959 run osmo-stp_10.42.42.5(pid=30732): stderr: | 20221214140406789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140406789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140406790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140406790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140406791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140406791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140406791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:08.244223 run osmo-stp_10.42.42.5(pid=30732): stdout: | (launched: 2022-12-14_14:04:06.617743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:08.368183 run osmo-stp_10.42.42.5(pid=30732): stderr: | 20221214140406789 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140406789 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140406790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140406790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140406791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140406791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140406791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:08.515820 run patchelf(pid=30735): Terminating (SIGINT) 14:04:08.686012 run patchelf(pid=30735): Terminated: ok {rc=0} 14:04:08.808816 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30732): Process ended prematurely: osmo-stp_10.42.42.5(pid=30732) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30732)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 14:04:08.818263 tst iperf3.py:8: Test FAILED (7.6 sec) 14:04:08.845231 run osmo-hlr_10.42.42.2(pid=30729): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30729)] 14:04:08.893148 run osmo-hlr_10.42.42.2(pid=30729): stdout: | (launched: 2022-12-14_14:04:05.675825) 14:04:08.941937 run osmo-hlr_10.42.42.2(pid=30729): stderr: | 20221214140405854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140405854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140405854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140405854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140405855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140405855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140405866 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140405875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140405876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140405876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:08.991126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30724): Terminating (SIGTERM) 14:04:09.030439 run iperf3-srv_10.42.42.10(pid=30725): Terminating (SIGTERM) 14:04:09.069537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30728): Terminating (SIGTERM) 14:04:09.108646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30731): Terminating (SIGTERM) 14:04:09.147614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30734): Terminating (SIGTERM) 14:04:09.187300 --- ParallelTerminationStrategy: PID 30724 died... 14:04:09.206455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30724): Terminated: ok {rc=0} 14:04:09.250351 --- ParallelTerminationStrategy: PID 30725 died... 14:04:09.268692 run iperf3-srv_10.42.42.10(pid=30725): Terminated {rc=256} 14:04:09.312842 --- ParallelTerminationStrategy: PID 30728 died... 14:04:09.332136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30728): Terminated: ok {rc=0} 14:04:09.376569 --- ParallelTerminationStrategy: PID 30731 died... 14:04:09.395286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30731): Terminated: ok {rc=0} 14:04:09.439209 --- ParallelTerminationStrategy: PID 30734 died... 14:04:09.457942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30734): Terminated: ok {rc=0} 14:04:09.541462 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 14:04:10.690979 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:10.703196 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:04:10.757422 tst iperf3m4.py: using LAC 41406 14:04:10.877297 tst iperf3m4.py: using RAC 96 14:04:11.002491 tst iperf3m4.py: using CellId 41406 14:04:11.134600 tst iperf3m4.py: using BVCI 41407 14:04:11.246942 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:11.257903 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:11.268645 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:11.279352 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:11.290322 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:11.301582 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:11.313025 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:11.324192 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:11.335464 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:04:11.450916 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:04:11.573435 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:04:11.694053 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:04:11.811588 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:04:12.017526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:04:12.324926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30736): Launched 14:04:12.591851 run iperf3-srv_10.42.42.10(pid=30737): Launched 14:04:12.706103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:04:12.910040 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:04:13.215978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30738): Launched 14:04:13.481828 run iperf3-srv_10.42.42.10(pid=30739): Launched 14:04:13.595636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:04:13.800679 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:04:14.106305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30740): Launched 14:04:14.372075 run iperf3-srv_10.42.42.10(pid=30741): Launched 14:04:14.486416 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:04:14.690212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:04:14.996036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30742): Launched 14:04:15.261793 run iperf3-srv_10.42.42.10(pid=30743): Launched 14:04:15.375470 tst iperf3m4.py:8: start network... 14:04:15.579367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:16.096756 run create_hlr_db(pid=30744): Launched 14:04:16.250926 bus /gobi_6: Setting Powered False 14:04:17.313480 run create_hlr_db(pid=30744): Terminated: ok {rc=0} 14:04:17.761085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30746): Launched 14:04:18.086696 run osmo-hlr_10.42.42.2(pid=30747): Launched 14:04:18.211187 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:18.775062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30749): Launched 14:04:19.085837 run osmo-stp_10.42.42.5(pid=30750): Launched 14:04:19.200606 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:04:19.723883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30752): Launched 14:04:19.840489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:04:20.096740 run patchelf(pid=30753): Launched 14:04:20.265298 run osmo-stp_10.42.42.5(pid=30750): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30750)] 14:04:20.393549 run osmo-stp_10.42.42.5(pid=30750): stdout: | (launched: 2022-12-14_14:04:19.029299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:20.523434 run osmo-stp_10.42.42.5(pid=30750): stderr: | 20221214140419202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140419202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140419202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140419203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140419203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140419203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140419203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:20.653343 run osmo-stp_10.42.42.5(pid=30750): stdout: | (launched: 2022-12-14_14:04:19.029299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:20.777649 run osmo-stp_10.42.42.5(pid=30750): stderr: | 20221214140419202 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140419202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140419202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140419203 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140419203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140419203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140419203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:20.925522 run patchelf(pid=30753): Terminating (SIGINT) 14:04:21.095916 run patchelf(pid=30753): Terminated: ok {rc=0} 14:04:21.219332 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30750): Process ended prematurely: osmo-stp_10.42.42.5(pid=30750) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30750)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 14:04:21.228633 tst iperf3m4.py:8: Test FAILED (10.6 sec) 14:04:21.256048 run osmo-hlr_10.42.42.2(pid=30747): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30747)] 14:04:21.303496 run osmo-hlr_10.42.42.2(pid=30747): stdout: | (launched: 2022-12-14_14:04:18.027123) 14:04:21.352468 run osmo-hlr_10.42.42.2(pid=30747): stderr: | 20221214140418226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140418226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140418226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140418227 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140418227 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140418227 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140418239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140418247 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140418247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140418247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:21.401679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30736): Terminating (SIGTERM) 14:04:21.441243 run iperf3-srv_10.42.42.10(pid=30737): Terminating (SIGTERM) 14:04:21.480877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30738): Terminating (SIGTERM) 14:04:21.520350 run iperf3-srv_10.42.42.10(pid=30739): Terminating (SIGTERM) 14:04:21.559718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30740): Terminating (SIGTERM) 14:04:21.599168 run iperf3-srv_10.42.42.10(pid=30741): Terminating (SIGTERM) 14:04:21.638371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30742): Terminating (SIGTERM) 14:04:21.677684 run iperf3-srv_10.42.42.10(pid=30743): Terminating (SIGTERM) 14:04:21.716835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30746): Terminating (SIGTERM) 14:04:21.756815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30749): Terminating (SIGTERM) 14:04:21.796535 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30752): Terminating (SIGTERM) 14:04:21.836513 --- ParallelTerminationStrategy: PID 30736 died... 14:04:21.855875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30736): Terminated: ok {rc=0} 14:04:21.899928 --- ParallelTerminationStrategy: PID 30737 died... 14:04:21.918652 run iperf3-srv_10.42.42.10(pid=30737): Terminated {rc=256} 14:04:21.962514 --- ParallelTerminationStrategy: PID 30738 died... 14:04:21.981049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30738): Terminated: ok {rc=0} 14:04:22.025126 --- ParallelTerminationStrategy: PID 30739 died... 14:04:22.043705 run iperf3-srv_10.42.42.10(pid=30739): Terminated {rc=256} 14:04:22.088088 --- ParallelTerminationStrategy: PID 30740 died... 14:04:22.106855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30740): Terminated: ok {rc=0} 14:04:22.150672 --- ParallelTerminationStrategy: PID 30741 died... 14:04:22.169291 run iperf3-srv_10.42.42.10(pid=30741): Terminated {rc=256} 14:04:22.213308 --- ParallelTerminationStrategy: PID 30742 died... 14:04:22.231833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30742): Terminated: ok {rc=0} 14:04:22.275859 --- ParallelTerminationStrategy: PID 30743 died... 14:04:22.294544 run iperf3-srv_10.42.42.10(pid=30743): Terminated {rc=256} 14:04:22.338371 --- ParallelTerminationStrategy: PID 30746 died... 14:04:22.357182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30746): Terminated: ok {rc=0} 14:04:22.401187 --- ParallelTerminationStrategy: PID 30749 died... 14:04:22.419893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30749): Terminated: ok {rc=0} 14:04:22.463915 --- ParallelTerminationStrategy: PID 30752 died... 14:04:22.482742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30752): Terminated: ok {rc=0} 14:04:22.565871 bus /gobi_4: Setting Powered False 14:04:23.665214 bus /gobi_4: Setting Powered False 14:04:24.781619 bus /gobi_1: Setting Powered False 14:04:25.878964 bus /gobi_1: Setting Powered False 14:04:26.994212 bus /gobi_0: Setting Powered False 14:04:28.092200 bus /gobi_0: Setting Powered False 14:04:29.209707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 14:04:30.314658 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:30.326790 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:04:30.377976 tst ping.py: using LAC 41407 14:04:30.496888 tst ping.py: using RAC 97 14:04:30.614776 tst ping.py: using CellId 41407 14:04:30.734649 tst ping.py: using BVCI 41408 14:04:30.843397 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:30.855657 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:30.868793 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:30.880563 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:30.905086 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:30.916816 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:30.929043 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:30.940283 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:04:31.066928 tst ping.py:19: start network... 14:04:31.291792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:31.808507 run create_hlr_db(pid=30754): Launched 14:04:31.971914 bus /gobi_6: Setting Powered False 14:04:33.034949 run create_hlr_db(pid=30754): Terminated: ok {rc=0} 14:04:33.490925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Launched 14:04:33.813224 run osmo-hlr_10.42.42.2(pid=30757): Launched 14:04:33.936221 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:34.493190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Launched 14:04:34.814068 run osmo-stp_10.42.42.5(pid=30760): Launched 14:04:34.936106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:04:35.491732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30762): Launched 14:04:35.614617 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:04:35.887219 run patchelf(pid=30763): Launched 14:04:36.066327 run osmo-stp_10.42.42.5(pid=30760): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] 14:04:36.202880 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-14_14:04:34.754990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:36.340439 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221214140434947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140434947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140434947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140434948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140434950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140434950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140434950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:36.478335 run osmo-stp_10.42.42.5(pid=30760): stdout: | (launched: 2022-12-14_14:04:34.754990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:36.610726 run osmo-stp_10.42.42.5(pid=30760): stderr: | 20221214140434947 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140434947 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140434947 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140434948 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140434950 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140434950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140434950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:36.767336 run patchelf(pid=30763): Terminating (SIGINT) 14:04:36.947379 run patchelf(pid=30763): Terminated: ok {rc=0} 14:04:37.076853 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30760): Process ended prematurely: osmo-stp_10.42.42.5(pid=30760) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 14:04:37.086385 tst ping.py:22: Test FAILED (6.8 sec) 14:04:37.114627 run osmo-hlr_10.42.42.2(pid=30757): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30757)] 14:04:37.165249 run osmo-hlr_10.42.42.2(pid=30757): stdout: | (launched: 2022-12-14_14:04:33.754040) 14:04:37.217203 run osmo-hlr_10.42.42.2(pid=30757): stderr: | 20221214140433952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140433952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140433952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140433952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140433952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140433952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140433964 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140433972 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140433972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140433972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:37.268890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminating (SIGTERM) 14:04:37.310953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminating (SIGTERM) 14:04:37.353525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30762): Terminating (SIGTERM) 14:04:37.395831 --- ParallelTerminationStrategy: PID 30756 died... 14:04:37.416208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30756): Terminated: ok {rc=0} 14:04:37.463076 --- ParallelTerminationStrategy: PID 30759 died... 14:04:37.483140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30759): Terminated: ok {rc=0} 14:04:37.529570 --- ParallelTerminationStrategy: PID 30762 died... 14:04:37.549528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30762): Terminated: ok {rc=0} 14:04:37.637958 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 14:04:38.724272 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:38.736263 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:04:38.788508 tst ping_idle_ping.py: using LAC 41408 14:04:38.917902 tst ping_idle_ping.py: using RAC 98 14:04:39.043921 tst ping_idle_ping.py: using CellId 41408 14:04:39.172333 tst ping_idle_ping.py: using BVCI 41409 14:04:39.289136 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:39.300471 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:39.311763 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:39.322884 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:39.334794 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:39.346801 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:39.358967 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:04:39.371223 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:04:39.490680 tst ping_idle_ping.py:24: start network... 14:04:39.691925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:40.160914 run create_hlr_db(pid=30765): Launched 14:04:40.284904 bus /gobi_6: Setting Powered False 14:04:41.345735 run create_hlr_db(pid=30765): Terminated: ok {rc=0} 14:04:41.787075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Launched 14:04:42.111010 run osmo-hlr_10.42.42.2(pid=30768): Launched 14:04:42.235502 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:42.791237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Launched 14:04:43.114359 run osmo-stp_10.42.42.5(pid=30771): Launched 14:04:43.237916 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:04:43.795232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30773): Launched 14:04:43.914752 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:04:44.170069 run patchelf(pid=30774): Launched 14:04:44.336586 run osmo-stp_10.42.42.5(pid=30771): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] 14:04:44.463555 run osmo-stp_10.42.42.5(pid=30771): stdout: | (launched: 2022-12-14_14:04:43.054546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:44.591913 run osmo-stp_10.42.42.5(pid=30771): stderr: | 20221214140443246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140443246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140443246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140443247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140443247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140443247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140443247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:44.719267 run osmo-stp_10.42.42.5(pid=30771): stdout: | (launched: 2022-12-14_14:04:43.054546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:44.841767 run osmo-stp_10.42.42.5(pid=30771): stderr: | 20221214140443246 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140443246 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140443246 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140443247 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140443247 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140443247 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140443247 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:44.986912 run patchelf(pid=30774): Terminating (SIGINT) 14:04:45.155305 run patchelf(pid=30774): Terminated: ok {rc=0} 14:04:45.276248 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30771): Process ended prematurely: osmo-stp_10.42.42.5(pid=30771) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 14:04:45.285110 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 14:04:45.311734 run osmo-hlr_10.42.42.2(pid=30768): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30768)] 14:04:45.359174 run osmo-hlr_10.42.42.2(pid=30768): stdout: | (launched: 2022-12-14_14:04:42.051623) 14:04:45.408029 run osmo-hlr_10.42.42.2(pid=30768): stderr: | 20221214140442247 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140442247 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140442247 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140442247 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140442247 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140442248 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140442260 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140442269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140442269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140442269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:45.457169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Terminating (SIGTERM) 14:04:45.496155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Terminating (SIGTERM) 14:04:45.535103 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30773): Terminating (SIGTERM) 14:04:45.574531 --- ParallelTerminationStrategy: PID 30767 died... 14:04:45.593534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30767): Terminated: ok {rc=0} 14:04:45.637408 --- ParallelTerminationStrategy: PID 30770 died... 14:04:45.656080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30770): Terminated: ok {rc=0} 14:04:45.699899 --- ParallelTerminationStrategy: PID 30773 died... 14:04:45.718676 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30773): Terminated: ok {rc=0} 14:04:45.804086 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 14:04:47.114751 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:04:47.124717 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 14:04:47.157653 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 14:04:47.197188 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 14:04:47.285677 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 14:04:47.317441 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 14:04:47.355466 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 14:04:47.949909 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 14:04:47.998943 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:04:48.009882 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:04:48.075265 tst cs_paging_gprs_active.py: using LAC 41409 14:04:48.194131 tst cs_paging_gprs_active.py: using RAC 99 14:04:48.313176 tst cs_paging_gprs_active.py: using CellId 41409 14:04:48.432539 tst cs_paging_gprs_active.py: using BVCI 41410 14:04:48.544119 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:04:48.555061 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:04:48.565763 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:04:48.576383 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:04:48.587049 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:04:48.598178 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:04:48.609279 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:04:48.619793 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:04:48.630581 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:04:48.750868 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:04:48.867928 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:04:49.073790 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:04:49.381832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30778): Launched 14:04:49.647820 run iperf3-srv_10.42.42.10(pid=30779): Launched 14:04:49.762487 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:04:49.966947 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:04:50.293370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30780): Launched 14:04:50.579484 run iperf3-srv_10.42.42.10(pid=30781): Launched 14:04:50.701938 tst cs_paging_gprs_active.py:38: start network... 14:04:50.922660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:04:51.428697 run create_hlr_db(pid=30782): Launched 14:04:51.553810 bus /gobi_6: Setting Powered False 14:04:52.618740 run create_hlr_db(pid=30782): Terminated: ok {rc=0} 14:04:53.054664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30785): Launched 14:04:53.359675 run osmo-hlr_10.42.42.2(pid=30786): Launched 14:04:53.475673 run osmo-stp_10.42.42.5: Starting osmo-stp 14:04:54.001635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30788): Launched 14:04:54.306967 run osmo-stp_10.42.42.5(pid=30789): Launched 14:04:54.422807 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:04:54.948182 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30791): Launched 14:04:55.064907 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:04:55.322751 run patchelf(pid=30792): Launched 14:04:55.492668 run osmo-stp_10.42.42.5(pid=30789): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30789)] 14:04:55.621465 run osmo-stp_10.42.42.5(pid=30789): stdout: | (launched: 2022-12-14_14:04:54.250594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:55.751835 run osmo-stp_10.42.42.5(pid=30789): stderr: | 20221214140454423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140454423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140454423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140454424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140454424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140454424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140454424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:55.882814 run osmo-stp_10.42.42.5(pid=30789): stdout: | (launched: 2022-12-14_14:04:54.250594) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:04:56.007445 run osmo-stp_10.42.42.5(pid=30789): stderr: | 20221214140454423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140454423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140454423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140454424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140454424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140454424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140454424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:04:56.156492 run patchelf(pid=30792): Terminating (SIGINT) 14:04:56.327595 run patchelf(pid=30792): Terminated: ok {rc=0} 14:04:56.450447 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30789): Process ended prematurely: osmo-stp_10.42.42.5(pid=30789) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30789)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 14:04:56.459716 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 14:04:56.486658 run osmo-hlr_10.42.42.2(pid=30786): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30786)] 14:04:56.533758 run osmo-hlr_10.42.42.2(pid=30786): stdout: | (launched: 2022-12-14_14:04:53.303587) 14:04:56.582669 run osmo-hlr_10.42.42.2(pid=30786): stderr: | 20221214140453483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140453483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140453483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140453483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140453483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140453483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140453496 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140453506 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140453507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140453507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:04:56.632154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30778): Terminating (SIGTERM) 14:04:56.671669 run iperf3-srv_10.42.42.10(pid=30779): Terminating (SIGTERM) 14:04:56.711074 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30780): Terminating (SIGTERM) 14:04:56.750481 run iperf3-srv_10.42.42.10(pid=30781): Terminating (SIGTERM) 14:04:56.789765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30785): Terminating (SIGTERM) 14:04:56.829095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30788): Terminating (SIGTERM) 14:04:56.868350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30791): Terminating (SIGTERM) 14:04:56.908321 --- ParallelTerminationStrategy: PID 30778 died... 14:04:56.927501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30778): Terminated: ok {rc=0} 14:04:56.971355 --- ParallelTerminationStrategy: PID 30779 died... 14:04:56.989848 run iperf3-srv_10.42.42.10(pid=30779): Terminated {rc=256} 14:04:57.033308 --- ParallelTerminationStrategy: PID 30780 died... 14:04:57.051867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30780): Terminated: ok {rc=0} 14:04:57.095427 --- ParallelTerminationStrategy: PID 30781 died... 14:04:57.113969 run iperf3-srv_10.42.42.10(pid=30781): Terminated {rc=256} 14:04:57.157474 --- ParallelTerminationStrategy: PID 30785 died... 14:04:57.176093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30785): Terminated: ok {rc=0} 14:04:57.219690 --- ParallelTerminationStrategy: PID 30788 died... 14:04:57.238224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30788): Terminated: ok {rc=0} 14:04:57.281906 --- ParallelTerminationStrategy: PID 30791 died... 14:04:57.300232 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30791): Terminated: ok {rc=0} 14:04:57.384483 bus /gobi_0: Setting Powered False 14:04:58.483491 bus /gobi_0: Setting Powered False 14:04:59.598286 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 14:05:00.743927 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:00.755550 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:05:00.823846 tst iperf3.py: using LAC 41410 14:05:00.970399 tst iperf3.py: using RAC 100 14:05:01.152338 tst iperf3.py: using CellId 41410 14:05:01.277808 tst iperf3.py: using BVCI 41411 14:05:01.400489 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:01.412673 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:01.424898 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:01.437371 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:01.450813 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:01.464161 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:01.478590 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:01.492611 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:01.504900 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:05:01.630487 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:05:01.858176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:02.202454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30796): Launched 14:05:02.498376 run iperf3-srv_10.42.42.10(pid=30797): Launched 14:05:02.621646 tst iperf3.py:8: start network... 14:05:02.842670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:03.349262 run create_hlr_db(pid=30798): Launched 14:05:03.472886 bus /gobi_6: Setting Powered False 14:05:04.537410 run create_hlr_db(pid=30798): Terminated: ok {rc=0} 14:05:04.973856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30800): Launched 14:05:05.279216 run osmo-hlr_10.42.42.2(pid=30801): Launched 14:05:05.395221 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:05.919566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30803): Launched 14:05:06.224291 run osmo-stp_10.42.42.5(pid=30804): Launched 14:05:06.339865 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:06.863788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30806): Launched 14:05:06.979677 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:07.236482 run patchelf(pid=30807): Launched 14:05:07.405172 run osmo-stp_10.42.42.5(pid=30804): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30804)] 14:05:07.533440 run osmo-stp_10.42.42.5(pid=30804): stdout: | (launched: 2022-12-14_14:05:06.168034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:07.663432 run osmo-stp_10.42.42.5(pid=30804): stderr: | 20221214140506339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140506339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140506340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140506340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140506341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140506341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140506341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:07.794443 run osmo-stp_10.42.42.5(pid=30804): stdout: | (launched: 2022-12-14_14:05:06.168034) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:07.918549 run osmo-stp_10.42.42.5(pid=30804): stderr: | 20221214140506339 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140506339 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140506340 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140506340 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140506341 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140506341 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140506341 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:08.065571 run patchelf(pid=30807): Terminating (SIGINT) 14:05:08.236736 run patchelf(pid=30807): Terminated: ok {rc=0} 14:05:08.359614 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30804): Process ended prematurely: osmo-stp_10.42.42.5(pid=30804) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30804)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 14:05:08.368912 tst iperf3.py:8: Test FAILED (7.7 sec) 14:05:08.395914 run osmo-hlr_10.42.42.2(pid=30801): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30801)] 14:05:08.443196 run osmo-hlr_10.42.42.2(pid=30801): stdout: | (launched: 2022-12-14_14:05:05.223096) 14:05:08.492629 run osmo-hlr_10.42.42.2(pid=30801): stderr: | 20221214140505400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140505400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140505401 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140505401 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140505401 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140505401 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140505413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140505421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140505422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140505422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:08.542172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30796): Terminating (SIGTERM) 14:05:08.581418 run iperf3-srv_10.42.42.10(pid=30797): Terminating (SIGTERM) 14:05:08.620462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30800): Terminating (SIGTERM) 14:05:08.659662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30803): Terminating (SIGTERM) 14:05:08.698844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30806): Terminating (SIGTERM) 14:05:08.738395 --- ParallelTerminationStrategy: PID 30796 died... 14:05:08.757570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30796): Terminated: ok {rc=0} 14:05:08.801212 --- ParallelTerminationStrategy: PID 30797 died... 14:05:08.819807 run iperf3-srv_10.42.42.10(pid=30797): Terminated {rc=256} 14:05:08.863007 --- ParallelTerminationStrategy: PID 30800 died... 14:05:08.881686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30800): Terminated: ok {rc=0} 14:05:08.925193 --- ParallelTerminationStrategy: PID 30803 died... 14:05:08.943509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30803): Terminated: ok {rc=0} 14:05:08.987372 --- ParallelTerminationStrategy: PID 30806 died... 14:05:09.005982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30806): Terminated: ok {rc=0} 14:05:09.089324 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 14:05:10.232260 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:10.243818 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:05:10.310293 tst iperf3m4.py: using LAC 41411 14:05:10.429143 tst iperf3m4.py: using RAC 101 14:05:10.547627 tst iperf3m4.py: using CellId 41411 14:05:10.666757 tst iperf3m4.py: using BVCI 41412 14:05:10.778835 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:10.789987 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:10.801033 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:10.811960 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:10.822699 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:10.833718 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:10.844682 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:10.855472 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:10.866604 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:05:10.981476 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:05:11.105432 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:05:11.226185 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:05:11.343777 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:05:11.548480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:11.854456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30808): Launched 14:05:12.120916 run iperf3-srv_10.42.42.10(pid=30809): Launched 14:05:12.235661 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:05:12.439396 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:12.744591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30810): Launched 14:05:13.010035 run iperf3-srv_10.42.42.10(pid=30811): Launched 14:05:13.123409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:05:13.326390 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:13.631061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30812): Launched 14:05:13.896452 run iperf3-srv_10.42.42.10(pid=30813): Launched 14:05:14.009802 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:05:14.213838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:14.518688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30814): Launched 14:05:14.783911 run iperf3-srv_10.42.42.10(pid=30815): Launched 14:05:14.897766 tst iperf3m4.py:8: start network... 14:05:15.101400 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:15.571897 run create_hlr_db(pid=30816): Launched 14:05:15.695230 bus /gobi_6: Setting Powered False 14:05:16.753979 run create_hlr_db(pid=30816): Terminated: ok {rc=0} 14:05:17.203547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30818): Launched 14:05:17.513646 run osmo-hlr_10.42.42.2(pid=30819): Launched 14:05:17.630282 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:18.168403 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30821): Launched 14:05:18.474700 run osmo-stp_10.42.42.5(pid=30822): Launched 14:05:18.591313 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:19.113798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30824): Launched 14:05:19.229536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:19.486579 run patchelf(pid=30825): Launched 14:05:19.654972 run osmo-stp_10.42.42.5(pid=30822): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30822)] 14:05:19.782731 run osmo-stp_10.42.42.5(pid=30822): stdout: | (launched: 2022-12-14_14:05:18.417747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:19.912382 run osmo-stp_10.42.42.5(pid=30822): stderr: | 20221214140518590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140518590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140518591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140518591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140518591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140518592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140518592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:20.042382 run osmo-stp_10.42.42.5(pid=30822): stdout: | (launched: 2022-12-14_14:05:18.417747) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:20.166568 run osmo-stp_10.42.42.5(pid=30822): stderr: | 20221214140518590 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140518590 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140518591 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140518591 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140518591 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140518592 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140518592 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:20.314788 run patchelf(pid=30825): Terminating (SIGINT) 14:05:20.485227 run patchelf(pid=30825): Terminated: ok {rc=0} 14:05:20.607707 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30822): Process ended prematurely: osmo-stp_10.42.42.5(pid=30822) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30822)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 14:05:20.617201 tst iperf3m4.py:8: Test FAILED (10.4 sec) 14:05:20.644370 run osmo-hlr_10.42.42.2(pid=30819): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30819)] 14:05:20.691327 run osmo-hlr_10.42.42.2(pid=30819): stdout: | (launched: 2022-12-14_14:05:17.457098) 14:05:20.740314 run osmo-hlr_10.42.42.2(pid=30819): stderr: | 20221214140517635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140517635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140517635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140517635 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140517635 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140517635 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140517648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140517657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140517657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140517657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:20.789580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30808): Terminating (SIGTERM) 14:05:20.828856 run iperf3-srv_10.42.42.10(pid=30809): Terminating (SIGTERM) 14:05:20.868025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30810): Terminating (SIGTERM) 14:05:20.907259 run iperf3-srv_10.42.42.10(pid=30811): Terminating (SIGTERM) 14:05:20.946292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30812): Terminating (SIGTERM) 14:05:20.985325 run iperf3-srv_10.42.42.10(pid=30813): Terminating (SIGTERM) 14:05:21.025154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30814): Terminating (SIGTERM) 14:05:21.064352 run iperf3-srv_10.42.42.10(pid=30815): Terminating (SIGTERM) 14:05:21.103866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30818): Terminating (SIGTERM) 14:05:21.143160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30821): Terminating (SIGTERM) 14:05:21.182525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30824): Terminating (SIGTERM) 14:05:21.222548 --- ParallelTerminationStrategy: PID 30808 died... 14:05:21.241884 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30808): Terminated: ok {rc=0} 14:05:21.286069 --- ParallelTerminationStrategy: PID 30809 died... 14:05:21.304600 run iperf3-srv_10.42.42.10(pid=30809): Terminated {rc=256} 14:05:21.348376 --- ParallelTerminationStrategy: PID 30810 died... 14:05:21.367096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30810): Terminated: ok {rc=0} 14:05:21.411583 --- ParallelTerminationStrategy: PID 30811 died... 14:05:21.430308 run iperf3-srv_10.42.42.10(pid=30811): Terminated {rc=256} 14:05:21.473740 --- ParallelTerminationStrategy: PID 30812 died... 14:05:21.492419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30812): Terminated: ok {rc=0} 14:05:21.536401 --- ParallelTerminationStrategy: PID 30813 died... 14:05:21.555193 run iperf3-srv_10.42.42.10(pid=30813): Terminated {rc=256} 14:05:21.598707 --- ParallelTerminationStrategy: PID 30814 died... 14:05:21.617555 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30814): Terminated: ok {rc=0} 14:05:21.661358 --- ParallelTerminationStrategy: PID 30815 died... 14:05:21.680115 run iperf3-srv_10.42.42.10(pid=30815): Terminated {rc=256} 14:05:21.723569 --- ParallelTerminationStrategy: PID 30818 died... 14:05:21.742030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30818): Terminated: ok {rc=0} 14:05:21.785623 --- ParallelTerminationStrategy: PID 30821 died... 14:05:21.804474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30821): Terminated: ok {rc=0} 14:05:21.848720 --- ParallelTerminationStrategy: PID 30824 died... 14:05:21.867580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30824): Terminated: ok {rc=0} 14:05:21.954197 bus /gobi_4: Setting Powered False 14:05:23.052989 bus /gobi_4: Setting Powered False 14:05:24.169820 bus /gobi_1: Setting Powered False 14:05:25.268011 bus /gobi_1: Setting Powered False 14:05:26.383201 bus /gobi_0: Setting Powered False 14:05:27.482202 bus /gobi_0: Setting Powered False 14:05:28.597485 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 14:05:29.703425 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:29.715558 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:05:29.784889 tst ping.py: using LAC 41412 14:05:29.909733 tst ping.py: using RAC 102 14:05:30.036638 tst ping.py: using CellId 41412 14:05:30.163118 tst ping.py: using BVCI 41413 14:05:30.281336 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:30.293205 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:30.304420 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:30.315829 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:30.327181 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:30.338756 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:30.350478 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:30.362164 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:05:30.480649 tst ping.py:19: start network... 14:05:30.697784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:31.206950 run create_hlr_db(pid=30826): Launched 14:05:31.353686 bus /gobi_6: Setting Powered False 14:05:32.414859 run create_hlr_db(pid=30826): Terminated: ok {rc=0} 14:05:32.854856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30828): Launched 14:05:33.178471 run osmo-hlr_10.42.42.2(pid=30829): Launched 14:05:33.301448 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:33.856170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30831): Launched 14:05:34.178141 run osmo-stp_10.42.42.5(pid=30832): Launched 14:05:34.300619 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:34.854942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30834): Launched 14:05:34.977444 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:35.249897 run patchelf(pid=30835): Launched 14:05:35.428275 run osmo-stp_10.42.42.5(pid=30832): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30832)] 14:05:35.564076 run osmo-stp_10.42.42.5(pid=30832): stdout: | (launched: 2022-12-14_14:05:34.118501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:35.701783 run osmo-stp_10.42.42.5(pid=30832): stderr: | 20221214140534313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140534313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140534313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140534314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140534314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140534314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140534314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:35.839766 run osmo-stp_10.42.42.5(pid=30832): stdout: | (launched: 2022-12-14_14:05:34.118501) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:35.971861 run osmo-stp_10.42.42.5(pid=30832): stderr: | 20221214140534313 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140534313 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140534313 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140534314 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140534314 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140534314 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140534314 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:36.128693 run patchelf(pid=30835): Terminating (SIGINT) 14:05:36.308623 run patchelf(pid=30835): Terminated: ok {rc=0} 14:05:36.438326 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30832): Process ended prematurely: osmo-stp_10.42.42.5(pid=30832) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30832)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 14:05:36.447999 tst ping.py:22: Test FAILED (6.7 sec) 14:05:36.476374 run osmo-hlr_10.42.42.2(pid=30829): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30829)] 14:05:36.527107 run osmo-hlr_10.42.42.2(pid=30829): stdout: | (launched: 2022-12-14_14:05:33.119025) 14:05:36.579560 run osmo-hlr_10.42.42.2(pid=30829): stderr: | 20221214140533318 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140533318 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140533318 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140533318 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140533319 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140533319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140533332 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140533340 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140533340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140533340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:36.631944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30828): Terminating (SIGTERM) 14:05:36.674077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30831): Terminating (SIGTERM) 14:05:36.716491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30834): Terminating (SIGTERM) 14:05:36.759370 --- ParallelTerminationStrategy: PID 30828 died... 14:05:36.780043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30828): Terminated: ok {rc=0} 14:05:36.826779 --- ParallelTerminationStrategy: PID 30831 died... 14:05:36.846966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30831): Terminated: ok {rc=0} 14:05:36.893454 --- ParallelTerminationStrategy: PID 30834 died... 14:05:36.913485 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30834): Terminated: ok {rc=0} 14:05:37.002028 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 14:05:38.089464 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:38.101808 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:05:38.172243 tst ping_idle_ping.py: using LAC 41413 14:05:38.300285 tst ping_idle_ping.py: using RAC 103 14:05:38.426306 tst ping_idle_ping.py: using CellId 41413 14:05:38.553274 tst ping_idle_ping.py: using BVCI 41414 14:05:38.663317 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:38.674525 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:38.685526 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:38.696462 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:38.707333 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:38.718273 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:38.729091 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:05:38.739859 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:05:38.859322 tst ping_idle_ping.py:24: start network... 14:05:39.077387 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:39.581429 run create_hlr_db(pid=30836): Launched 14:05:39.706060 bus /gobi_6: Setting Powered False 14:05:40.770173 run create_hlr_db(pid=30836): Terminated: ok {rc=0} 14:05:41.202527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30838): Launched 14:05:41.504371 run osmo-hlr_10.42.42.2(pid=30839): Launched 14:05:41.619982 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:42.153955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30841): Launched 14:05:42.455219 run osmo-stp_10.42.42.5(pid=30842): Launched 14:05:42.570369 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:43.090019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30844): Launched 14:05:43.204614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:43.458588 run patchelf(pid=30845): Launched 14:05:43.625790 run osmo-stp_10.42.42.5(pid=30842): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30842)] 14:05:43.752199 run osmo-stp_10.42.42.5(pid=30842): stdout: | (launched: 2022-12-14_14:05:42.399082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:43.880337 run osmo-stp_10.42.42.5(pid=30842): stderr: | 20221214140542573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140542573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140542573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140542574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140542574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140542574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140542574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:44.008590 run osmo-stp_10.42.42.5(pid=30842): stdout: | (launched: 2022-12-14_14:05:42.399082) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:44.131795 run osmo-stp_10.42.42.5(pid=30842): stderr: | 20221214140542573 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140542573 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140542573 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140542574 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140542574 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140542574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140542574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:44.277726 run patchelf(pid=30845): Terminating (SIGINT) 14:05:44.446484 run patchelf(pid=30845): Terminated: ok {rc=0} 14:05:44.567389 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30842): Process ended prematurely: osmo-stp_10.42.42.5(pid=30842) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30842)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 14:05:44.576191 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 14:05:44.602773 run osmo-hlr_10.42.42.2(pid=30839): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30839)] 14:05:44.649953 run osmo-hlr_10.42.42.2(pid=30839): stdout: | (launched: 2022-12-14_14:05:41.448497) 14:05:44.698996 run osmo-hlr_10.42.42.2(pid=30839): stderr: | 20221214140541625 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140541625 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140541625 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140541626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140541626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140541626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140541638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140541648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140541649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140541649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:44.748308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30838): Terminating (SIGTERM) 14:05:44.787911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30841): Terminating (SIGTERM) 14:05:44.827534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30844): Terminating (SIGTERM) 14:05:44.867356 --- ParallelTerminationStrategy: PID 30838 died... 14:05:44.886595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30838): Terminated: ok {rc=0} 14:05:44.930646 --- ParallelTerminationStrategy: PID 30841 died... 14:05:44.949615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30841): Terminated: ok {rc=0} 14:05:44.993476 --- ParallelTerminationStrategy: PID 30844 died... 14:05:45.012236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30844): Terminated: ok {rc=0} 14:05:45.094987 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 14:05:46.451627 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:05:46.461975 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 14:05:46.497681 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 14:05:46.541405 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 14:05:46.632731 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 14:05:46.681398 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 14:05:46.723142 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 14:05:47.307618 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 14:05:47.357942 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:47.369417 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:05:47.418151 tst cs_paging_gprs_active.py: using LAC 41414 14:05:47.536386 tst cs_paging_gprs_active.py: using RAC 104 14:05:47.654276 tst cs_paging_gprs_active.py: using CellId 41414 14:05:47.774187 tst cs_paging_gprs_active.py: using BVCI 41415 14:05:47.885604 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:47.896912 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:47.908297 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:47.919351 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:47.930953 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:47.942520 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:47.955610 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:47.967452 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:47.979335 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:05:48.100461 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:05:48.217410 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:05:48.420103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:48.724449 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30849): Launched 14:05:48.986669 run iperf3-srv_10.42.42.10(pid=30850): Launched 14:05:49.099385 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:05:49.301417 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:05:49.603551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30851): Launched 14:05:49.865861 run iperf3-srv_10.42.42.10(pid=30852): Launched 14:05:49.978854 tst cs_paging_gprs_active.py:38: start network... 14:05:50.180641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:05:50.647988 run create_hlr_db(pid=30853): Launched 14:05:50.771666 bus /gobi_6: Setting Powered False 14:05:51.831606 run create_hlr_db(pid=30853): Terminated: ok {rc=0} 14:05:52.256670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30859): Launched 14:05:52.557944 run osmo-hlr_10.42.42.2(pid=30860): Launched 14:05:52.671901 run osmo-stp_10.42.42.5: Starting osmo-stp 14:05:53.190890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30862): Launched 14:05:53.490722 run osmo-stp_10.42.42.5(pid=30863): Launched 14:05:53.604703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:05:54.122024 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30865): Launched 14:05:54.236669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:05:54.490937 run patchelf(pid=30866): Launched 14:05:54.657956 run osmo-stp_10.42.42.5(pid=30863): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30863)] 14:05:54.784816 run osmo-stp_10.42.42.5(pid=30863): stdout: | (launched: 2022-12-14_14:05:53.435464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:54.913870 run osmo-stp_10.42.42.5(pid=30863): stderr: | 20221214140553604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140553605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140553605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140553605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140553606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140553606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140553606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:55.042723 run osmo-stp_10.42.42.5(pid=30863): stdout: | (launched: 2022-12-14_14:05:53.435464) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:05:55.165813 run osmo-stp_10.42.42.5(pid=30863): stderr: | 20221214140553604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140553605 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140553605 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140553605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140553606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140553606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140553606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:05:55.311362 run patchelf(pid=30866): Terminating (SIGINT) 14:05:55.479582 run patchelf(pid=30866): Terminated: ok {rc=0} 14:05:55.600734 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=30863): Process ended prematurely: osmo-stp_10.42.42.5(pid=30863) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30863)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 14:05:55.610253 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 14:05:55.636792 run osmo-hlr_10.42.42.2(pid=30860): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30860)] 14:05:55.684041 run osmo-hlr_10.42.42.2(pid=30860): stdout: | (launched: 2022-12-14_14:05:52.502833) 14:05:55.732715 run osmo-hlr_10.42.42.2(pid=30860): stderr: | 20221214140552680 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140552680 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140552680 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140552680 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140552680 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140552680 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140552692 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140552700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140552701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140552701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:05:55.782059 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30849): Terminating (SIGTERM) 14:05:55.821393 run iperf3-srv_10.42.42.10(pid=30850): Terminating (SIGTERM) 14:05:55.860528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30851): Terminating (SIGTERM) 14:05:55.899807 run iperf3-srv_10.42.42.10(pid=30852): Terminating (SIGTERM) 14:05:55.938833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30859): Terminating (SIGTERM) 14:05:55.977985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30862): Terminating (SIGTERM) 14:05:56.017138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30865): Terminating (SIGTERM) 14:05:56.056458 --- ParallelTerminationStrategy: PID 30849 died... 14:05:56.075321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30849): Terminated: ok {rc=0} 14:05:56.118691 --- ParallelTerminationStrategy: PID 30850 died... 14:05:56.136850 run iperf3-srv_10.42.42.10(pid=30850): Terminated {rc=256} 14:05:56.180138 --- ParallelTerminationStrategy: PID 30851 died... 14:05:56.198451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30851): Terminated: ok {rc=0} 14:05:56.241632 --- ParallelTerminationStrategy: PID 30852 died... 14:05:56.259868 run iperf3-srv_10.42.42.10(pid=30852): Terminated {rc=256} 14:05:56.303808 --- ParallelTerminationStrategy: PID 30859 died... 14:05:56.322143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30859): Terminated: ok {rc=0} 14:05:56.365178 --- ParallelTerminationStrategy: PID 30862 died... 14:05:56.383373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30862): Terminated: ok {rc=0} 14:05:56.426572 --- ParallelTerminationStrategy: PID 30865 died... 14:05:56.445068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30865): Terminated: ok {rc=0} 14:05:56.528250 bus /gobi_0: Setting Powered False 14:05:57.624540 bus /gobi_0: Setting Powered False 14:05:58.740180 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 14:05:59.881920 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:05:59.893873 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:05:59.943058 tst iperf3.py: using LAC 41415 14:06:00.063280 tst iperf3.py: using RAC 105 14:06:00.181253 tst iperf3.py: using CellId 41415 14:06:00.299622 tst iperf3.py: using BVCI 41416 14:06:00.410455 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:00.421953 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:00.433101 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:00.444196 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:00.455832 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:00.467491 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:00.479209 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:00.490778 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:00.502587 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:06:00.624283 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:06:00.831959 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:01.188458 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30867): Launched 14:06:01.484198 run iperf3-srv_10.42.42.10(pid=30868): Launched 14:06:01.618049 tst iperf3.py:8: start network... 14:06:01.841677 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:02.350099 run create_hlr_db(pid=30869): Launched 14:06:02.474146 bus /gobi_6: Setting Powered False 14:06:03.538007 run create_hlr_db(pid=30869): Terminated: ok {rc=0} 14:06:03.985549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30871): Launched 14:06:04.306179 run osmo-hlr_10.42.42.2(pid=30872): Launched 14:06:04.428606 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:04.980923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30874): Launched 14:06:05.302084 run osmo-stp_10.42.42.5(pid=30875): Launched 14:06:05.424595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:05.978880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30877): Launched 14:06:06.101728 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:06.373364 run patchelf(pid=30878): Launched 14:06:06.552148 run osmo-stp_10.42.42.5(pid=30875): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30875)] 14:06:06.688583 run osmo-stp_10.42.42.5(pid=30875): stdout: | (launched: 2022-12-14_14:06:05.243567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:06.826612 run osmo-stp_10.42.42.5(pid=30875): stderr: | 20221214140605436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140605436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140605437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140605437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140605438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140605438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140605438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:06.964815 run osmo-stp_10.42.42.5(pid=30875): stdout: | (launched: 2022-12-14_14:06:05.243567) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:07.097197 run osmo-stp_10.42.42.5(pid=30875): stderr: | 20221214140605436 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140605436 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140605437 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140605437 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140605438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140605438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140605438 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:07.255158 run patchelf(pid=30878): Terminating (SIGINT) 14:06:07.434954 run patchelf(pid=30878): Terminated: ok {rc=0} 14:06:07.565275 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30875): Process ended prematurely: osmo-stp_10.42.42.5(pid=30875) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30875)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 14:06:07.575446 tst iperf3.py:8: Test FAILED (7.7 sec) 14:06:07.603824 run osmo-hlr_10.42.42.2(pid=30872): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30872)] 14:06:07.654407 run osmo-hlr_10.42.42.2(pid=30872): stdout: | (launched: 2022-12-14_14:06:04.247972) 14:06:07.706881 run osmo-hlr_10.42.42.2(pid=30872): stderr: | 20221214140604448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140604448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140604448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140604448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140604448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140604448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140604460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140604469 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140604470 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140604470 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:07.759800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30867): Terminating (SIGTERM) 14:06:07.801260 run iperf3-srv_10.42.42.10(pid=30868): Terminating (SIGTERM) 14:06:07.843025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30871): Terminating (SIGTERM) 14:06:07.884906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30874): Terminating (SIGTERM) 14:06:07.927261 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30877): Terminating (SIGTERM) 14:06:07.969314 --- ParallelTerminationStrategy: PID 30867 died... 14:06:07.989419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30867): Terminated: ok {rc=0} 14:06:08.035631 --- ParallelTerminationStrategy: PID 30868 died... 14:06:08.055230 run iperf3-srv_10.42.42.10(pid=30868): Terminated {rc=256} 14:06:08.101302 --- ParallelTerminationStrategy: PID 30871 died... 14:06:08.120910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30871): Terminated: ok {rc=0} 14:06:08.167612 --- ParallelTerminationStrategy: PID 30874 died... 14:06:08.187250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30874): Terminated: ok {rc=0} 14:06:08.233557 --- ParallelTerminationStrategy: PID 30877 died... 14:06:08.253152 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30877): Terminated: ok {rc=0} 14:06:08.340372 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 14:06:09.489443 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:09.501921 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:06:09.553137 tst iperf3m4.py: using LAC 41416 14:06:09.676788 tst iperf3m4.py: using RAC 106 14:06:09.800126 tst iperf3m4.py: using CellId 41416 14:06:09.923741 tst iperf3m4.py: using BVCI 41417 14:06:10.039896 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:10.051721 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:10.063391 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:10.075080 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:10.087004 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:10.098919 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:10.111024 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:10.122868 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:10.135001 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:06:10.255823 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:06:10.374955 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:06:10.494926 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:06:10.611125 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:06:10.816496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:11.119274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30879): Launched 14:06:11.382254 run iperf3-srv_10.42.42.10(pid=30880): Launched 14:06:11.495172 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:06:11.696350 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:11.998107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30881): Launched 14:06:12.259953 run iperf3-srv_10.42.42.10(pid=30882): Launched 14:06:12.372481 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:06:12.573951 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:12.876482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30883): Launched 14:06:13.138709 run iperf3-srv_10.42.42.10(pid=30884): Launched 14:06:13.251233 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:06:13.452843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:06:13.755249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30885): Launched 14:06:14.017506 run iperf3-srv_10.42.42.10(pid=30886): Launched 14:06:14.130390 tst iperf3m4.py:8: start network... 14:06:14.331323 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:14.797698 run create_hlr_db(pid=30887): Launched 14:06:14.922056 bus /gobi_6: Setting Powered False 14:06:15.995089 run create_hlr_db(pid=30887): Terminated: ok {rc=0} 14:06:16.522622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30889): Launched 14:06:16.867842 run osmo-hlr_10.42.42.2(pid=30890): Launched 14:06:17.104644 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:17.682322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30892): Launched 14:06:17.984469 run osmo-stp_10.42.42.5(pid=30893): Launched 14:06:18.099432 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:18.621894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30895): Launched 14:06:18.737370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:18.991191 run patchelf(pid=30896): Launched 14:06:19.158437 run osmo-stp_10.42.42.5(pid=30893): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30893)] 14:06:19.285614 run osmo-stp_10.42.42.5(pid=30893): stdout: | (launched: 2022-12-14_14:06:17.928666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:19.414681 run osmo-stp_10.42.42.5(pid=30893): stderr: | 20221214140618102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140618102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140618102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140618103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140618103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140618103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140618103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:19.544144 run osmo-stp_10.42.42.5(pid=30893): stdout: | (launched: 2022-12-14_14:06:17.928666) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:19.667607 run osmo-stp_10.42.42.5(pid=30893): stderr: | 20221214140618102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140618102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140618102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140618103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140618103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140618103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140618103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:19.813991 run patchelf(pid=30896): Terminating (SIGINT) 14:06:19.983407 run patchelf(pid=30896): Terminated: ok {rc=0} 14:06:20.105584 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30893): Process ended prematurely: osmo-stp_10.42.42.5(pid=30893) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30893)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 14:06:20.114954 tst iperf3m4.py:8: Test FAILED (10.7 sec) 14:06:20.142296 run osmo-hlr_10.42.42.2(pid=30890): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30890)] 14:06:20.189765 run osmo-hlr_10.42.42.2(pid=30890): stdout: | (launched: 2022-12-14_14:06:16.799016) 14:06:20.238864 run osmo-hlr_10.42.42.2(pid=30890): stderr: | 20221214140617075 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140617075 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140617075 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140617075 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140617075 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140617075 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140617092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140617112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140617112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140617112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:20.288512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30879): Terminating (SIGTERM) 14:06:20.327801 run iperf3-srv_10.42.42.10(pid=30880): Terminating (SIGTERM) 14:06:20.367062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30881): Terminating (SIGTERM) 14:06:20.406493 run iperf3-srv_10.42.42.10(pid=30882): Terminating (SIGTERM) 14:06:20.446331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30883): Terminating (SIGTERM) 14:06:20.485937 run iperf3-srv_10.42.42.10(pid=30884): Terminating (SIGTERM) 14:06:20.525305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30885): Terminating (SIGTERM) 14:06:20.565208 run iperf3-srv_10.42.42.10(pid=30886): Terminating (SIGTERM) 14:06:20.604463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30889): Terminating (SIGTERM) 14:06:20.643928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30892): Terminating (SIGTERM) 14:06:20.683623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30895): Terminating (SIGTERM) 14:06:20.723675 --- ParallelTerminationStrategy: PID 30879 died... 14:06:20.742598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30879): Terminated: ok {rc=0} 14:06:20.786183 --- ParallelTerminationStrategy: PID 30880 died... 14:06:20.804405 run iperf3-srv_10.42.42.10(pid=30880): Terminated {rc=256} 14:06:20.847758 --- ParallelTerminationStrategy: PID 30881 died... 14:06:20.866217 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30881): Terminated: ok {rc=0} 14:06:20.909555 --- ParallelTerminationStrategy: PID 30882 died... 14:06:20.928002 run iperf3-srv_10.42.42.10(pid=30882): Terminated {rc=256} 14:06:20.971375 --- ParallelTerminationStrategy: PID 30883 died... 14:06:20.989835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30883): Terminated: ok {rc=0} 14:06:21.033349 --- ParallelTerminationStrategy: PID 30884 died... 14:06:21.051672 run iperf3-srv_10.42.42.10(pid=30884): Terminated {rc=256} 14:06:21.095166 --- ParallelTerminationStrategy: PID 30885 died... 14:06:21.113561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=30885): Terminated: ok {rc=0} 14:06:21.157005 --- ParallelTerminationStrategy: PID 30886 died... 14:06:21.175406 run iperf3-srv_10.42.42.10(pid=30886): Terminated {rc=256} 14:06:21.218890 --- ParallelTerminationStrategy: PID 30889 died... 14:06:21.237356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30889): Terminated: ok {rc=0} 14:06:21.280779 --- ParallelTerminationStrategy: PID 30892 died... 14:06:21.299279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30892): Terminated: ok {rc=0} 14:06:21.342785 --- ParallelTerminationStrategy: PID 30895 died... 14:06:21.361341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30895): Terminated: ok {rc=0} 14:06:21.446927 bus /gobi_4: Setting Powered False 14:06:22.545681 bus /gobi_4: Setting Powered False 14:06:23.659357 bus /gobi_1: Setting Powered False 14:06:24.759579 bus /gobi_1: Setting Powered False 14:06:25.874729 bus /gobi_0: Setting Powered False 14:06:26.972601 bus /gobi_0: Setting Powered False 14:06:28.086432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 14:06:29.188894 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:29.201477 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:06:29.252873 tst ping.py: using LAC 41417 14:06:29.392081 tst ping.py: using RAC 107 14:06:29.512584 tst ping.py: using CellId 41417 14:06:29.630781 tst ping.py: using BVCI 41418 14:06:29.739051 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:29.750533 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:29.761686 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:29.772677 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:29.783746 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:29.794907 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:29.806424 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:29.817474 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:06:29.930819 tst ping.py:19: start network... 14:06:30.128606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:30.587056 run create_hlr_db(pid=30897): Launched 14:06:30.708885 bus /gobi_6: Setting Powered False 14:06:31.803446 run create_hlr_db(pid=30897): Terminated: ok {rc=0} 14:06:32.317255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30899): Launched 14:06:32.624084 run osmo-hlr_10.42.42.2(pid=30900): Launched 14:06:32.735469 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:33.265272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30902): Launched 14:06:33.560027 run osmo-stp_10.42.42.5(pid=30903): Launched 14:06:33.672058 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:34.181507 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30905): Launched 14:06:34.294118 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:34.543295 run patchelf(pid=30906): Launched 14:06:34.706939 run osmo-stp_10.42.42.5(pid=30903): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30903)] 14:06:34.831855 run osmo-stp_10.42.42.5(pid=30903): stdout: | (launched: 2022-12-14_14:06:33.505424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:34.957573 run osmo-stp_10.42.42.5(pid=30903): stderr: | 20221214140633678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140633678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140633678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140633679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140633679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140633679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140633679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:35.083377 run osmo-stp_10.42.42.5(pid=30903): stdout: | (launched: 2022-12-14_14:06:33.505424) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:35.204008 run osmo-stp_10.42.42.5(pid=30903): stderr: | 20221214140633678 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140633678 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140633678 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140633679 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140633679 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140633679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140633679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:35.346550 run patchelf(pid=30906): Terminating (SIGINT) 14:06:35.510986 run patchelf(pid=30906): Terminated: ok {rc=0} 14:06:35.629813 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=30903): Process ended prematurely: osmo-stp_10.42.42.5(pid=30903) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30903)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 14:06:35.638548 tst ping.py:22: Test FAILED (6.4 sec) 14:06:35.664781 run osmo-hlr_10.42.42.2(pid=30900): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30900)] 14:06:35.712350 run osmo-hlr_10.42.42.2(pid=30900): stdout: | (launched: 2022-12-14_14:06:32.569179) 14:06:35.760918 run osmo-hlr_10.42.42.2(pid=30900): stderr: | 20221214140632746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140632746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140632746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140632746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140632746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140632746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140632759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140632767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140632767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140632767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:35.810224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30899): Terminating (SIGTERM) 14:06:35.849931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30902): Terminating (SIGTERM) 14:06:35.889199 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30905): Terminating (SIGTERM) 14:06:35.928622 --- ParallelTerminationStrategy: PID 30899 died... 14:06:35.947563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30899): Terminated: ok {rc=0} 14:06:35.991036 --- ParallelTerminationStrategy: PID 30902 died... 14:06:36.009409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30902): Terminated: ok {rc=0} 14:06:36.052859 --- ParallelTerminationStrategy: PID 30905 died... 14:06:36.071849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30905): Terminated: ok {rc=0} 14:06:36.156429 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 14:06:37.244539 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:37.256591 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:06:37.306931 tst ping_idle_ping.py: using LAC 41418 14:06:37.423682 tst ping_idle_ping.py: using RAC 108 14:06:37.550759 tst ping_idle_ping.py: using CellId 41418 14:06:37.676120 tst ping_idle_ping.py: using BVCI 41419 14:06:37.791718 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:37.803890 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:37.815620 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:37.827255 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:37.839125 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:37.850954 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:37.862894 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:06:37.874825 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:06:37.990126 tst ping_idle_ping.py:24: start network... 14:06:38.189512 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:38.652708 run create_hlr_db(pid=30907): Launched 14:06:38.774752 bus /gobi_6: Setting Powered False 14:06:39.834164 run create_hlr_db(pid=30907): Terminated: ok {rc=0} 14:06:40.249573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30909): Launched 14:06:40.547228 run osmo-hlr_10.42.42.2(pid=30910): Launched 14:06:40.660239 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:41.170924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30912): Launched 14:06:41.466246 run osmo-stp_10.42.42.5(pid=30913): Launched 14:06:41.578521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:42.090098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30915): Launched 14:06:42.203235 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:42.454086 run patchelf(pid=30916): Launched 14:06:42.618308 run osmo-stp_10.42.42.5(pid=30913): ERR: Terminated: ERROR {rc=1} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30913)] 14:06:42.743549 run osmo-stp_10.42.42.5(pid=30913): stdout: | (launched: 2022-12-14_14:06:41.411152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:42.870708 run osmo-stp_10.42.42.5(pid=30913): stderr: | 20221214140641582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140641582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140641583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140641583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140641583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140641584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140641584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:42.997598 run osmo-stp_10.42.42.5(pid=30913): stdout: | (launched: 2022-12-14_14:06:41.411152) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:43.118869 run osmo-stp_10.42.42.5(pid=30913): stderr: | 20221214140641582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140641582 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140641583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140641583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140641583 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140641584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140641584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:43.262529 run patchelf(pid=30916): Terminating (SIGINT) 14:06:43.428552 run patchelf(pid=30916): Terminated: ok {rc=0} 14:06:43.548461 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=30913): Process ended prematurely: osmo-stp_10.42.42.5(pid=30913) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30913)] [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 14:06:43.557479 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 14:06:43.584004 run osmo-hlr_10.42.42.2(pid=30910): ERR: Terminated: ERROR {rc=237} [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30910)] 14:06:43.631200 run osmo-hlr_10.42.42.2(pid=30910): stdout: | (launched: 2022-12-14_14:06:40.491967) 14:06:43.680698 run osmo-hlr_10.42.42.2(pid=30910): stderr: | 20221214140640667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140640667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140640667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140640667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140640667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140640667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140640680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140640688 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140640689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140640689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:43.730049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30909): Terminating (SIGTERM) 14:06:43.769687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30912): Terminating (SIGTERM) 14:06:43.809216 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30915): Terminating (SIGTERM) 14:06:43.849537 --- ParallelTerminationStrategy: PID 30909 died... 14:06:43.868540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30909): Terminated: ok {rc=0} 14:06:43.912145 --- ParallelTerminationStrategy: PID 30912 died... 14:06:43.930662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30912): Terminated: ok {rc=0} 14:06:43.974366 --- ParallelTerminationStrategy: PID 30915 died... 14:06:43.992858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30915): Terminated: ok {rc=0} 14:06:44.079028 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 14:06:45.408812 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:06:45.417498 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:06:45.451169 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 14:06:45.486246 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:06:45.539453 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:06:45.571717 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 14:06:45.606318 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:06:46.169790 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2405 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 14:06:46.176312 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:06:46.189540 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:06:46.259881 tst switch_tch_pdch.py: using LAC 41419 14:06:46.386387 tst switch_tch_pdch.py: using RAC 109 14:06:46.514048 tst switch_tch_pdch.py: using CellId 41419 14:06:46.645802 tst switch_tch_pdch.py: using BVCI 41420 14:06:46.765124 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:06:46.778244 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:06:46.791131 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:06:46.804015 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:06:46.817958 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:06:46.832941 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:06:46.847100 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:06:46.861295 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:06:47.007808 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:06:47.144924 tst switch_tch_pdch.py:51: start network... 14:06:47.356014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:06:47.813767 run create_hlr_db(pid=30920): Launched 14:06:47.934580 bus /gobi_6: Setting Powered False 14:06:48.993334 run create_hlr_db(pid=30920): Terminated: ok {rc=0} 14:06:49.425193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30922): Launched 14:06:49.740826 run osmo-hlr_10.42.42.2(pid=30923): Launched 14:06:49.861246 run osmo-stp_10.42.42.5: Starting osmo-stp 14:06:50.407278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30925): Launched 14:06:50.724309 run osmo-stp_10.42.42.5(pid=30926): Launched 14:06:50.846564 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:06:51.394223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30928): Launched 14:06:51.515838 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:06:51.783142 run patchelf(pid=30929): Launched 14:06:51.958772 run osmo-stp_10.42.42.5(pid=30926): ERR: Terminated: ERROR {rc=1} [trial-2405↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30926)] 14:06:52.093730 run osmo-stp_10.42.42.5(pid=30926): stdout: | (launched: 2022-12-14_14:06:50.666473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:52.230448 run osmo-stp_10.42.42.5(pid=30926): stderr: | 20221214140650858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140650858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140650858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140650858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140650859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140650859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140650859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:52.366668 run osmo-stp_10.42.42.5(pid=30926): stdout: | (launched: 2022-12-14_14:06:50.666473) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:06:52.497101 run osmo-stp_10.42.42.5(pid=30926): stderr: | 20221214140650858 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140650858 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140650858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140650858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140650859 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140650859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140650859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:06:52.651484 run patchelf(pid=30929): Terminating (SIGINT) 14:06:52.828160 run patchelf(pid=30929): Terminated: ok {rc=0} 14:06:52.955926 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=30926): Process ended prematurely: osmo-stp_10.42.42.5(pid=30926) [trial-2405↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30926)] [trial-2405↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 14:06:52.965532 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 14:06:52.993170 run osmo-hlr_10.42.42.2(pid=30923): ERR: Terminated: ERROR {rc=237} [trial-2405↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30923)] 14:06:53.043488 run osmo-hlr_10.42.42.2(pid=30923): stdout: | (launched: 2022-12-14_14:06:49.683076) 14:06:53.095431 run osmo-hlr_10.42.42.2(pid=30923): stderr: | 20221214140649881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140649881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140649881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140649881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140649882 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140649882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140649895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140649905 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140649906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140649906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:06:53.147944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30922): Terminating (SIGTERM) 14:06:53.190242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30925): Terminating (SIGTERM) 14:06:53.232108 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30928): Terminating (SIGTERM) 14:06:53.274575 --- ParallelTerminationStrategy: PID 30922 died... 14:06:53.295072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30922): Terminated: ok {rc=0} 14:06:53.341666 --- ParallelTerminationStrategy: PID 30925 died... 14:06:53.361825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30925): Terminated: ok {rc=0} 14:06:53.407853 --- ParallelTerminationStrategy: PID 30928 died... 14:06:53.427594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=30928): Terminated: ok {rc=0} 14:06:53.515478 bus /gobi_0: Setting Powered False 14:06:54.614118 bus /gobi_0: Setting Powered False 14:06:55.731906 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2405 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 nitb_smpp --------------------------------------------------------------------- 14:06:56.984134 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:06:56.987124 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 14:06:57.007888 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 14:06:57.015098 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 14:06:57.048808 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 14:06:57.069182 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 14:06:57.075652 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 14:06:57.596101 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2405 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 14:06:57.601327 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 14:06:57.619999 tst esme_connect_policy_acceptall.py: using MSISDN 8718 14:06:57.762813 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:06:58.365753 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30933): Launched 14:06:58.689420 run osmo-nitb_10.42.42.2(pid=30934): Launched 14:06:58.868272 run osmo-nitb_10.42.42.2(pid=30934): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30934)] 14:06:59.013148 run osmo-nitb_10.42.42.2(pid=30934): stdout: | (launched: 2022-12-14_14:06:58.630408) 14:06:59.159597 run osmo-nitb_10.42.42.2(pid=30934): stderr: | (launched: 2022-12-14_14:06:58.678820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:06:59.306327 run osmo-nitb_10.42.42.2(pid=30934): stdout: | (launched: 2022-12-14_14:06:58.630408) 14:06:59.447003 run osmo-nitb_10.42.42.2(pid=30934): stderr: | (launched: 2022-12-14_14:06:58.678820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30934): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30934) [trial-2405↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30934)] 14:06:59.811976 tst osmo-nitb_10.42.42.2(pid=30934): stdout: | (launched: 2022-12-14_14:06:58.630408) 14:06:59.942777 tst osmo-nitb_10.42.42.2(pid=30934): stderr: | (launched: 2022-12-14_14:06:58.678820) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:07:00.097771 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=30934): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30934) [trial-2405↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30934)] [trial-2405↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 14:07:00.106853 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 14:07:00.114044 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30933): Terminating (SIGTERM) 14:07:00.325275 --- ParallelTerminationStrategy: PID 30933 died... 14:07:00.346550 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30933): Terminated: ok {rc=0} ---------------------------------------------- trial-2405 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 14:07:00.398074 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 14:07:00.420585 tst esme_connect_policy_closed.py: using MSISDN 8719 14:07:00.550874 tst esme_connect_policy_closed.py: using MSISDN 8720 14:07:00.668280 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:07:01.300111 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30935): Launched 14:07:01.747264 run osmo-nitb_10.42.42.2(pid=30936): Launched 14:07:01.951540 run osmo-nitb_10.42.42.2(pid=30936): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30936)] 14:07:02.080702 run osmo-nitb_10.42.42.2(pid=30936): stdout: | (launched: 2022-12-14_14:07:01.670342) 14:07:02.212167 run osmo-nitb_10.42.42.2(pid=30936): stderr: | (launched: 2022-12-14_14:07:01.736042) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:07:02.347551 run osmo-nitb_10.42.42.2(pid=30936): stdout: | (launched: 2022-12-14_14:07:01.670342) 14:07:02.477640 run osmo-nitb_10.42.42.2(pid=30936): stderr: | (launched: 2022-12-14_14:07:01.736042) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:07:02.633051 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=30936): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30936) [trial-2405↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30936)] [trial-2405↪nitb_smpp↪esme_connect_policy_closed.py:24] 14:07:02.642313 tst esme_connect_policy_closed.py:24: Test FAILED (2.2 sec) 14:07:02.649635 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30935): Terminating (SIGTERM) 14:07:02.861297 --- ParallelTerminationStrategy: PID 30935 died... 14:07:02.882418 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30935): Terminated: ok {rc=0} ---------------------------------------------- trial-2405 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 14:07:02.934301 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 14:07:02.945817 tst nitb_smpp: Using 1 x bts (candidates: 1) 14:07:02.981238 tst esme_ms_sms_storeforward.py: using LAC 41420 14:07:03.109411 tst esme_ms_sms_storeforward.py: using RAC 110 14:07:03.239270 tst esme_ms_sms_storeforward.py: using CellId 41420 14:07:03.368454 tst esme_ms_sms_storeforward.py: using BVCI 41421 14:07:03.486969 tst nitb_smpp: Using 1 x modem (candidates: 1) 14:07:03.619189 tst esme_ms_sms_storeforward.py: using MSISDN 8721 14:07:03.738136 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 14:07:03.958625 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:07:04.620185 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30937): Launched 14:07:04.945956 run osmo-nitb_10.42.42.2(pid=30938): Launched 14:07:05.121816 run osmo-nitb_10.42.42.2(pid=30938): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30938)] 14:07:05.256240 run osmo-nitb_10.42.42.2(pid=30938): stdout: | (launched: 2022-12-14_14:07:04.886649) 14:07:05.392209 run osmo-nitb_10.42.42.2(pid=30938): stderr: | (launched: 2022-12-14_14:07:04.935328) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:07:05.527843 run osmo-nitb_10.42.42.2(pid=30938): stdout: | (launched: 2022-12-14_14:07:04.886649) 14:07:05.658413 run osmo-nitb_10.42.42.2(pid=30938): stderr: | (launched: 2022-12-14_14:07:04.935328) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:07:05.813902 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=30938): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30938) [trial-2405↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30938)] [trial-2405↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 14:07:05.822714 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 14:07:05.829721 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30937): Terminating (SIGTERM) 14:07:06.040428 --- ParallelTerminationStrategy: PID 30937 died... 14:07:06.061776 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30937): Terminated: ok {rc=0} 14:07:06.150904 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 14:07:07.236297 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 14:07:07.248224 tst nitb_smpp: Using 1 x bts (candidates: 1) 14:07:07.284328 tst esme_ms_sms_transaction.py: using LAC 41421 14:07:07.404348 tst esme_ms_sms_transaction.py: using RAC 111 14:07:07.523228 tst esme_ms_sms_transaction.py: using CellId 41421 14:07:07.643783 tst esme_ms_sms_transaction.py: using BVCI 41422 14:07:07.755152 tst nitb_smpp: Using 1 x modem (candidates: 1) 14:07:07.885689 tst esme_ms_sms_transaction.py: using MSISDN 8722 14:07:07.995546 tst esme_ms_sms_transaction.py:18: start nitb and bts... 14:07:08.199817 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:07:08.816283 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30939): Launched 14:07:09.121537 run osmo-nitb_10.42.42.2(pid=30940): Launched 14:07:09.290272 run osmo-nitb_10.42.42.2(pid=30940): ERR: Terminated: ERROR {rc=2} [trial-2405↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30940)] 14:07:09.426307 run osmo-nitb_10.42.42.2(pid=30940): stdout: | (launched: 2022-12-14_14:07:09.065159) 14:07:09.563732 run osmo-nitb_10.42.42.2(pid=30940): stderr: | (launched: 2022-12-14_14:07:09.111278) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:07:09.700894 run osmo-nitb_10.42.42.2(pid=30940): stdout: | (launched: 2022-12-14_14:07:09.065159) 14:07:09.832784 run osmo-nitb_10.42.42.2(pid=30940): stderr: | (launched: 2022-12-14_14:07:09.111278) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7fdbfd690268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=30940): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30940) [trial-2405↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30940)] 14:07:10.236274 tst osmo-nitb_10.42.42.2(pid=30940): stdout: | (launched: 2022-12-14_14:07:09.065159) 14:07:10.359404 tst osmo-nitb_10.42.42.2(pid=30940): stderr: | (launched: 2022-12-14_14:07:09.111278) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:07:10.504021 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=30940): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30940) [trial-2405↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30940)] [trial-2405↪nitb_smpp↪esme_ms_sms_transaction.py:21] 14:07:10.512589 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 14:07:10.519318 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30939): Terminating (SIGTERM) 14:07:10.727734 --- ParallelTerminationStrategy: PID 30939 died... 14:07:10.748289 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30939): Terminated: ok {rc=0} 14:07:10.832017 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 smpp --------------------------------------------------------------------- 14:07:11.993389 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:07:11.996040 tst smpp: Verifying 1 x bts (candidates: 11) 14:07:12.016293 tst smpp: Verifying 6 x ip_address (candidates: 9) 14:07:12.043971 tst smpp: Verifying 1 x modem (candidates: 12) 14:07:12.079259 tst smpp: Reserving 1 x bts (candidates: 11) 14:07:12.100135 tst smpp: Reserving 6 x ip_address (candidates: 9) 14:07:12.126843 tst smpp: Reserving 1 x modem (candidates: 12) 14:07:12.652094 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 14:07:12.657202 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:12.667626 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:12.678028 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:12.688075 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:12.707299 tst esme_connect_policy_acceptall.py: using MSISDN 8723 14:07:12.819513 run osmo-stp_10.42.42.4: Starting osmo-stp 14:07:13.336711 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30944): Launched 14:07:13.639729 run osmo-stp_10.42.42.4(pid=30945): Launched 14:07:13.755726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:14.225509 run create_hlr_db(pid=30946): Launched 14:07:14.349723 bus /sierra_2: Setting Powered False 14:07:15.409693 run create_hlr_db(pid=30946): Terminated: ok {rc=0} 14:07:15.853771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30948): Launched 14:07:16.221695 run osmo-hlr_10.42.42.2(pid=30949): Launched 14:07:16.401629 run osmo-msc_10.42.42.5: Starting osmo-msc 14:07:17.099556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30951): Launched 14:07:17.442920 run osmo-msc_10.42.42.5(pid=30952): Launched 14:07:17.627074 run osmo-hlr_10.42.42.2(pid=30949): ERR: Terminated: ERROR {rc=237} [trial-2405↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30949)] 14:07:17.765902 run osmo-hlr_10.42.42.2(pid=30949): stdout: | (launched: 2022-12-14_14:07:16.151727) 14:07:17.908352 run osmo-hlr_10.42.42.2(pid=30949): stderr: | 20221214140716514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140716514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140716514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140716514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140716515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140716515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140716535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140716551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140716552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140716552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:18.046590 run osmo-hlr_10.42.42.2(pid=30949): stdout: | (launched: 2022-12-14_14:07:16.151727) 14:07:18.176679 run osmo-hlr_10.42.42.2(pid=30949): stderr: | 20221214140716514 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140716514 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140716514 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140716514 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140716515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140716515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140716535 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140716551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140716552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140716552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:18.332722 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=30949): Process ended prematurely: osmo-hlr_10.42.42.2(pid=30949) [trial-2405↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30949)] [trial-2405↪smpp↪esme_connect_policy_acceptall.py:23] 14:07:18.341896 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.7 sec) 14:07:18.369517 run osmo-msc_10.42.42.5(pid=30952): ERR: Terminated: ERROR {rc=9} [trial-2405↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=30952)] 14:07:18.420086 run osmo-msc_10.42.42.5(pid=30952): stdout: | (launched: 2022-12-14_14:07:17.383261) 14:07:18.472053 run osmo-msc_10.42.42.5(pid=30952): stderr: | 20221214140717806 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214140717806 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214140717806 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140717806 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214140717806 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214140717806 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214140717806 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214140717806 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214140717807 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 14:07:18.524491 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30944): Terminating (SIGTERM) 14:07:18.566291 run osmo-stp_10.42.42.4(pid=30945): Terminating (SIGTERM) 14:07:18.608221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30948): Terminating (SIGTERM) 14:07:18.652139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30951): Terminating (SIGTERM) 14:07:18.697706 --- ParallelTerminationStrategy: PID 30944 died... 14:07:18.719266 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30944): Terminated: ok {rc=0} 14:07:18.768444 --- ParallelTerminationStrategy: PID 30945 died... 14:07:18.788820 run osmo-stp_10.42.42.4(pid=30945): Terminated: ok {rc=0} 14:07:18.835198 --- ParallelTerminationStrategy: PID 30948 died... 14:07:18.855002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30948): Terminated: ok {rc=0} 14:07:18.901554 --- ParallelTerminationStrategy: PID 30951 died... 14:07:18.921255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30951): Terminated: ok {rc=0} ---------------------------------------------- trial-2405 smpp esme_connect_policy_closed.py ---------------------------------------------- 14:07:18.973256 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:18.984557 tst smpp: Using 1 x bts (candidates: 1) 14:07:19.020121 tst esme_connect_policy_closed.py: using LAC 41422 14:07:19.142933 tst esme_connect_policy_closed.py: using RAC 112 14:07:19.264853 tst esme_connect_policy_closed.py: using CellId 41422 14:07:19.385072 tst esme_connect_policy_closed.py: using BVCI 41423 14:07:19.495731 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:19.506266 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:19.516595 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:19.536208 tst esme_connect_policy_closed.py: using MSISDN 8724 14:07:19.658486 tst esme_connect_policy_closed.py: using MSISDN 8725 14:07:19.770802 run osmo-stp_10.42.42.4: Starting osmo-stp 14:07:20.290720 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30955): Launched 14:07:20.595796 run osmo-stp_10.42.42.4(pid=30956): Launched 14:07:20.713466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:21.187482 run create_hlr_db(pid=30957): Launched 14:07:22.368103 run create_hlr_db(pid=30957): Terminated: ok {rc=0} 14:07:22.689698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30959): Launched 14:07:22.995550 run osmo-hlr_10.42.42.2(pid=30960): Launched 14:07:23.112111 run osmo-msc_10.42.42.5: Starting osmo-msc 14:07:23.667171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30962): Launched 14:07:23.973230 run osmo-msc_10.42.42.5(pid=30963): Launched 14:07:24.144541 run osmo-hlr_10.42.42.2(pid=30960): ERR: Terminated: ERROR {rc=237} [trial-2405↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30960)] 14:07:24.275825 run osmo-hlr_10.42.42.2(pid=30960): stdout: | (launched: 2022-12-14_14:07:22.939032) 14:07:24.406472 run osmo-hlr_10.42.42.2(pid=30960): stderr: | 20221214140723121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140723121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140723121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140723121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140723121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140723121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140723133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140723142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140723142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140723142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:24.534168 run osmo-hlr_10.42.42.2(pid=30960): stdout: | (launched: 2022-12-14_14:07:22.939032) 14:07:24.656100 run osmo-hlr_10.42.42.2(pid=30960): stderr: | 20221214140723121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140723121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140723121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140723121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140723121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140723121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140723133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140723142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140723142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140723142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:24.802212 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=30960): Process ended prematurely: osmo-hlr_10.42.42.2(pid=30960) [trial-2405↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30960)] [trial-2405↪smpp↪esme_connect_policy_closed.py:31] 14:07:24.810570 tst esme_connect_policy_closed.py:31: Test FAILED (5.8 sec) 14:07:24.836707 run osmo-msc_10.42.42.5(pid=30963): ERR: Terminated: ERROR {rc=9} [trial-2405↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=30963)] 14:07:24.885284 run osmo-msc_10.42.42.5(pid=30963): stdout: | (launched: 2022-12-14_14:07:23.916640) 14:07:24.935221 run osmo-msc_10.42.42.5(pid=30963): stderr: | 20221214140724238 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221214140724238 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221214140724238 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140724238 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221214140724238 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221214140724239 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221214140724239 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221214140724239 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221214140724239 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 14:07:24.985412 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30955): Terminating (SIGTERM) 14:07:25.025326 run osmo-stp_10.42.42.4(pid=30956): Terminating (SIGTERM) 14:07:25.065100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30959): Terminating (SIGTERM) 14:07:25.105962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30962): Terminating (SIGTERM) 14:07:25.146803 --- ParallelTerminationStrategy: PID 30955 died... 14:07:25.165991 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=30955): Terminated: ok {rc=0} 14:07:25.211023 --- ParallelTerminationStrategy: PID 30956 died... 14:07:25.230110 run osmo-stp_10.42.42.4(pid=30956): Terminated: ok {rc=0} 14:07:25.274412 --- ParallelTerminationStrategy: PID 30959 died... 14:07:25.293130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30959): Terminated: ok {rc=0} 14:07:25.337225 --- ParallelTerminationStrategy: PID 30962 died... 14:07:25.355969 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30962): Terminated: ok {rc=0} ---------------------------------------------- trial-2405 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 14:07:25.404838 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:25.415709 tst smpp: Using 1 x bts (candidates: 1) 14:07:25.450886 tst esme_ms_sms_storeforward.py: using LAC 41423 14:07:25.573502 tst esme_ms_sms_storeforward.py: using RAC 113 14:07:25.694499 tst esme_ms_sms_storeforward.py: using CellId 41423 14:07:25.815822 tst esme_ms_sms_storeforward.py: using BVCI 41424 14:07:25.927949 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:25.938530 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:25.948835 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:25.958978 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:25.969333 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:25.979989 tst smpp: Using 1 x modem (candidates: 1) 14:07:26.103573 tst esme_ms_sms_storeforward.py: using MSISDN 8726 14:07:26.222844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:26.728804 run create_hlr_db(pid=30966): Launched 14:07:27.911708 run create_hlr_db(pid=30966): Terminated: ok {rc=0} 14:07:28.256882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30968): Launched 14:07:28.583648 run osmo-hlr_10.42.42.2(pid=30969): Launched 14:07:28.709576 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:29.280387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30971): Launched 14:07:29.608492 run osmo-stp_10.42.42.5(pid=30972): Launched 14:07:29.733846 run osmo-msc_10.42.42.6: Starting osmo-msc 14:07:30.324839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30974): Launched 14:07:30.652046 run osmo-msc_10.42.42.6(pid=30975): Launched 14:07:30.835657 run osmo-stp_10.42.42.5(pid=30972): ERR: Terminated: ERROR {rc=1} [trial-2405↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30972)] 14:07:31.071272 run osmo-stp_10.42.42.5(pid=30972): stdout: | (launched: 2022-12-14_14:07:29.548550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:31.411557 run osmo-stp_10.42.42.5(pid=30972): stderr: | 20221214140729742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140729742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140729742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140729742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140729743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140729743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140729743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:31.665526 run osmo-stp_10.42.42.5(pid=30972): stdout: | (launched: 2022-12-14_14:07:29.548550) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:31.799575 run osmo-stp_10.42.42.5(pid=30972): stderr: | 20221214140729742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140729742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140729742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140729742 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140729743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140729743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140729743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:31.959234 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=30972): Process ended prematurely: osmo-stp_10.42.42.5(pid=30972) [trial-2405↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30972)] [trial-2405↪smpp↪esme_ms_sms_storeforward.py:30] 14:07:31.969099 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.6 sec) 14:07:31.997711 run osmo-hlr_10.42.42.2(pid=30969): ERR: Terminated: ERROR {rc=237} [trial-2405↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30969)] 14:07:32.052886 run osmo-hlr_10.42.42.2(pid=30969): stdout: | (launched: 2022-12-14_14:07:28.523925) 14:07:32.107469 run osmo-hlr_10.42.42.2(pid=30969): stderr: | 20221214140728723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140728723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140728723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140728723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140728723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140728723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140728735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140728745 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140728745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140728745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:32.183571 run osmo-msc_10.42.42.6(pid=30975): ERR: Terminated: ERROR {rc=2} [trial-2405↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30975)] 14:07:32.236852 run osmo-msc_10.42.42.6(pid=30975): stdout: | (launched: 2022-12-14_14:07:30.592353) 14:07:32.291097 run osmo-msc_10.42.42.6(pid=30975): stderr: | 20221214140731037 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140731038 DLGLOBAL DEBUG validating counter group 0x7fde84256c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140731038 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140731038 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140731038 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140731038 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140731049 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140731049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140731049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140731049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:07:32.345625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30968): Terminating (SIGTERM) 14:07:32.387918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30971): Terminating (SIGTERM) 14:07:32.430449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30974): Terminating (SIGTERM) 14:07:32.473408 --- ParallelTerminationStrategy: PID 30968 died... 14:07:32.494147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30968): Terminated: ok {rc=0} 14:07:32.541393 --- ParallelTerminationStrategy: PID 30971 died... 14:07:32.561581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30971): Terminated: ok {rc=0} 14:07:32.608317 --- ParallelTerminationStrategy: PID 30974 died... 14:07:32.628398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30974): Terminated: ok {rc=0} 14:07:32.717757 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 smpp esme_ms_sms_transaction.py ---------------------------------------------- 14:07:33.805854 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:33.818312 tst smpp: Using 1 x bts (candidates: 1) 14:07:33.857841 tst esme_ms_sms_transaction.py: using LAC 41424 14:07:33.985051 tst esme_ms_sms_transaction.py: using RAC 114 14:07:34.110400 tst esme_ms_sms_transaction.py: using CellId 41424 14:07:34.235961 tst esme_ms_sms_transaction.py: using BVCI 41425 14:07:34.354096 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:34.364813 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:34.375568 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:34.386374 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:34.397452 tst smpp: Using 1 x ip_address (candidates: 6) 14:07:34.408330 tst smpp: Using 1 x modem (candidates: 1) 14:07:34.535326 tst esme_ms_sms_transaction.py: using MSISDN 8727 14:07:34.654581 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:35.158255 run create_hlr_db(pid=30977): Launched 14:07:35.283367 bus /sierra_2: Setting Powered False 14:07:36.347554 run create_hlr_db(pid=30977): Terminated: ok {rc=0} 14:07:36.783077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30979): Launched 14:07:37.090347 run osmo-hlr_10.42.42.2(pid=30980): Launched 14:07:37.206635 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:37.730956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30982): Launched 14:07:38.035141 run osmo-stp_10.42.42.5(pid=30983): Launched 14:07:38.151281 run osmo-msc_10.42.42.6: Starting osmo-msc 14:07:38.701657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30985): Launched 14:07:39.007238 run osmo-msc_10.42.42.6(pid=30986): Launched 14:07:39.178079 run osmo-stp_10.42.42.5(pid=30983): ERR: Terminated: ERROR {rc=1} [trial-2405↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30983)] 14:07:39.307580 run osmo-stp_10.42.42.5(pid=30983): stdout: | (launched: 2022-12-14_14:07:37.979086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:39.437255 run osmo-stp_10.42.42.5(pid=30983): stderr: | 20221214140738150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140738150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140738150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140738151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140738153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140738153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140738153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:39.564090 run osmo-stp_10.42.42.5(pid=30983): stdout: | (launched: 2022-12-14_14:07:37.979086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:39.685677 run osmo-stp_10.42.42.5(pid=30983): stderr: | 20221214140738150 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140738150 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140738150 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140738151 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140738153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140738153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140738153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:39.830971 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=30983): Process ended prematurely: osmo-stp_10.42.42.5(pid=30983) [trial-2405↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30983)] [trial-2405↪smpp↪esme_ms_sms_transaction.py:28] 14:07:39.839345 tst esme_ms_sms_transaction.py:28: Test FAILED (6.0 sec) 14:07:39.865287 run osmo-hlr_10.42.42.2(pid=30980): ERR: Terminated: ERROR {rc=237} [trial-2405↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30980)] 14:07:39.913250 run osmo-hlr_10.42.42.2(pid=30980): stdout: | (launched: 2022-12-14_14:07:37.033337) 14:07:39.963051 run osmo-hlr_10.42.42.2(pid=30980): stderr: | 20221214140737211 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140737211 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140737211 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140737211 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140737211 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140737211 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140737223 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140737233 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140737234 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140737234 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:40.032927 run osmo-msc_10.42.42.6(pid=30986): ERR: Terminated: ERROR {rc=2} [trial-2405↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=30986)] 14:07:40.081002 run osmo-msc_10.42.42.6(pid=30986): stdout: | (launched: 2022-12-14_14:07:38.950704) 14:07:40.130744 run osmo-msc_10.42.42.6(pid=30986): stderr: | 20221214140739224 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140739225 DLGLOBAL DEBUG validating counter group 0x7fbe23b10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140739225 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140739225 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140739225 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140739225 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140739227 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140739228 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140739228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140739228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:07:40.180676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30979): Terminating (SIGTERM) 14:07:40.221192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30982): Terminating (SIGTERM) 14:07:40.261676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30985): Terminating (SIGTERM) 14:07:40.302336 --- ParallelTerminationStrategy: PID 30979 died... 14:07:40.321561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30979): Terminated: ok {rc=0} 14:07:40.365923 --- ParallelTerminationStrategy: PID 30982 died... 14:07:40.384445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30982): Terminated: ok {rc=0} 14:07:40.428127 --- ParallelTerminationStrategy: PID 30985 died... 14:07:40.446615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=30985): Terminated: ok {rc=0} 14:07:40.531989 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 encryption --------------------------------------------------------------------- 14:07:41.725350 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:07:41.727996 tst encryption: Verifying 1 x bts (candidates: 11) 14:07:41.748401 tst encryption: Verifying 6 x ip_address (candidates: 9) 14:07:41.774998 tst encryption: Verifying 1 x modem (candidates: 12) 14:07:41.815428 tst encryption: Reserving 1 x bts (candidates: 11) 14:07:41.836126 tst encryption: Reserving 6 x ip_address (candidates: 9) 14:07:41.862086 tst encryption: Reserving 1 x modem (candidates: 12) 14:07:42.385406 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2405 encryption register_a5_0_authopt.py ---------------------------------------------- 14:07:42.437513 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:42.447788 tst encryption: Using 1 x bts (candidates: 1) 14:07:42.485191 tst register_a5_0_authopt.py: using LAC 41425 14:07:42.613859 tst register_a5_0_authopt.py: using RAC 115 14:07:42.740906 tst register_a5_0_authopt.py: using CellId 41425 14:07:42.867140 tst register_a5_0_authopt.py: using BVCI 41426 14:07:42.986700 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:42.997782 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:43.008712 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:43.019422 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:43.030399 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:43.041399 tst encryption: Using 1 x modem (candidates: 1) 14:07:43.157732 tst register_a5_0_authopt.py:8: start network... 14:07:43.366269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:43.843573 run create_hlr_db(pid=30992): Launched 14:07:43.969309 bus /sierra_2: Setting Powered False 14:07:45.030102 run create_hlr_db(pid=30992): Terminated: ok {rc=0} 14:07:45.481171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30994): Launched 14:07:45.810002 run osmo-hlr_10.42.42.2(pid=30995): Launched 14:07:46.067097 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:46.830728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30997): Launched 14:07:47.170380 run osmo-stp_10.42.42.5(pid=30998): Launched 14:07:47.359771 run osmo-msc_10.42.42.6: Starting osmo-msc 14:07:47.930624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31000): Launched 14:07:48.237337 run osmo-msc_10.42.42.6(pid=31001): Launched 14:07:48.410066 run osmo-stp_10.42.42.5(pid=30998): ERR: Terminated: ERROR {rc=1} [trial-2405↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30998)] 14:07:48.539979 run osmo-stp_10.42.42.5(pid=30998): stdout: | (launched: 2022-12-14_14:07:47.104530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:48.669360 run osmo-stp_10.42.42.5(pid=30998): stderr: | 20221214140747372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140747372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140747372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140747373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140747373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140747373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140747374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:48.796158 run osmo-stp_10.42.42.5(pid=30998): stdout: | (launched: 2022-12-14_14:07:47.104530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:48.918774 run osmo-stp_10.42.42.5(pid=30998): stderr: | 20221214140747372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140747372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140747372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140747373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140747373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140747373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140747374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:49.064784 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=30998): Process ended prematurely: osmo-stp_10.42.42.5(pid=30998) [trial-2405↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30998)] [trial-2405↪encryption↪register_a5_0_authopt.py:8] 14:07:49.073688 tst register_a5_0_authopt.py:8: Test FAILED (6.7 sec) 14:07:49.099791 run osmo-hlr_10.42.42.2(pid=30995): ERR: Terminated: ERROR {rc=237} [trial-2405↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30995)] 14:07:49.147338 run osmo-hlr_10.42.42.2(pid=30995): stdout: | (launched: 2022-12-14_14:07:45.750332) 14:07:49.196485 run osmo-hlr_10.42.42.2(pid=30995): stderr: | 20221214140746053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140746053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140746053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140746054 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140746054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140746054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140746075 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140746091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140746092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140746093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:49.265178 run osmo-msc_10.42.42.6(pid=31001): ERR: Terminated: ERROR {rc=2} [trial-2405↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31001)] 14:07:49.312443 run osmo-msc_10.42.42.6(pid=31001): stdout: | (launched: 2022-12-14_14:07:48.180895) 14:07:49.361584 run osmo-msc_10.42.42.6(pid=31001): stderr: | 20221214140748453 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140748453 DLGLOBAL DEBUG validating counter group 0x7fcdae21ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140748453 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140748453 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140748453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140748454 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140748455 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140748456 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140748456 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140748456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:07:49.411598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30994): Terminating (SIGTERM) 14:07:49.450754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30997): Terminating (SIGTERM) 14:07:49.490282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31000): Terminating (SIGTERM) 14:07:49.529788 --- ParallelTerminationStrategy: PID 30994 died... 14:07:49.548939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30994): Terminated: ok {rc=0} 14:07:49.593328 --- ParallelTerminationStrategy: PID 30997 died... 14:07:49.611661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30997): Terminated: ok {rc=0} 14:07:49.655286 --- ParallelTerminationStrategy: PID 31000 died... 14:07:49.673713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31000): Terminated: ok {rc=0} 14:07:49.758887 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 encryption register_a5_0_authreq.py ---------------------------------------------- 14:07:50.906088 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:50.917127 tst encryption: Using 1 x bts (candidates: 1) 14:07:50.955913 tst register_a5_0_authreq.py: using LAC 41426 14:07:51.075275 tst register_a5_0_authreq.py: using RAC 116 14:07:51.194708 tst register_a5_0_authreq.py: using CellId 41426 14:07:51.314712 tst register_a5_0_authreq.py: using BVCI 41427 14:07:51.426010 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:51.436351 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:51.446767 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:51.456818 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:51.466989 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:51.477621 tst encryption: Using 1 x modem (candidates: 1) 14:07:51.593536 tst register_a5_0_authreq.py:8: start network... 14:07:51.800469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:07:52.274916 run create_hlr_db(pid=31003): Launched 14:07:52.399757 bus /sierra_2: Setting Powered False 14:07:53.462164 run create_hlr_db(pid=31003): Terminated: ok {rc=0} 14:07:53.910417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31005): Launched 14:07:54.241212 run osmo-hlr_10.42.42.2(pid=31006): Launched 14:07:54.369180 run osmo-stp_10.42.42.5: Starting osmo-stp 14:07:54.937280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31008): Launched 14:07:55.266603 run osmo-stp_10.42.42.5(pid=31009): Launched 14:07:55.392696 run osmo-msc_10.42.42.6: Starting osmo-msc 14:07:55.985968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31011): Launched 14:07:56.316743 run osmo-msc_10.42.42.6(pid=31012): Launched 14:07:56.500390 run osmo-stp_10.42.42.5(pid=31009): ERR: Terminated: ERROR {rc=1} [trial-2405↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31009)] 14:07:56.639317 run osmo-stp_10.42.42.5(pid=31009): stdout: | (launched: 2022-12-14_14:07:55.206785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:56.778852 run osmo-stp_10.42.42.5(pid=31009): stderr: | 20221214140755402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140755402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140755402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140755403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140755403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140755403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140755403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:56.917020 run osmo-stp_10.42.42.5(pid=31009): stdout: | (launched: 2022-12-14_14:07:55.206785) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:07:57.048608 run osmo-stp_10.42.42.5(pid=31009): stderr: | 20221214140755402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140755402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140755402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140755403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140755403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140755403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140755403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:07:57.206434 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31009): Process ended prematurely: osmo-stp_10.42.42.5(pid=31009) [trial-2405↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31009)] [trial-2405↪encryption↪register_a5_0_authreq.py:8] 14:07:57.215989 tst register_a5_0_authreq.py:8: Test FAILED (6.3 sec) 14:07:57.243576 run osmo-hlr_10.42.42.2(pid=31006): ERR: Terminated: ERROR {rc=237} [trial-2405↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31006)] 14:07:57.294251 run osmo-hlr_10.42.42.2(pid=31006): stdout: | (launched: 2022-12-14_14:07:54.181225) 14:07:57.346109 run osmo-hlr_10.42.42.2(pid=31006): stderr: | 20221214140754381 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140754381 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140754381 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140754381 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140754381 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140754381 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140754393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140754401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140754402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140754402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:07:57.417892 run osmo-msc_10.42.42.6(pid=31012): ERR: Terminated: ERROR {rc=2} [trial-2405↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31012)] 14:07:57.467220 run osmo-msc_10.42.42.6(pid=31012): stdout: | (launched: 2022-12-14_14:07:56.256578) 14:07:57.519124 run osmo-msc_10.42.42.6(pid=31012): stderr: | 20221214140756579 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140756580 DLGLOBAL DEBUG validating counter group 0x7fa3a40c0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140756580 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140756580 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140756580 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140756580 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140756582 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140756582 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140756582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140756582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:07:57.570872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31005): Terminating (SIGTERM) 14:07:57.612377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31008): Terminating (SIGTERM) 14:07:57.654077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31011): Terminating (SIGTERM) 14:07:57.696483 --- ParallelTerminationStrategy: PID 31005 died... 14:07:57.716714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31005): Terminated: ok {rc=0} 14:07:57.763648 --- ParallelTerminationStrategy: PID 31008 died... 14:07:57.783366 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31008): Terminated: ok {rc=0} 14:07:57.829480 --- ParallelTerminationStrategy: PID 31011 died... 14:07:57.849218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31011): Terminated: ok {rc=0} 14:07:57.936234 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 encryption register_a5_1_authreq.py ---------------------------------------------- 14:07:59.089459 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:59.100834 tst encryption: Using 1 x bts (candidates: 1) 14:07:59.137362 tst register_a5_1_authreq.py: using LAC 41427 14:07:59.266714 tst register_a5_1_authreq.py: using RAC 117 14:07:59.396641 tst register_a5_1_authreq.py: using CellId 41427 14:07:59.524891 tst register_a5_1_authreq.py: using BVCI 41428 14:07:59.646204 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:59.657232 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:59.667982 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:59.678824 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:59.689974 tst encryption: Using 1 x ip_address (candidates: 6) 14:07:59.701107 tst encryption: Using 1 x modem (candidates: 1) 14:07:59.817468 tst register_a5_1_authreq.py:8: start network... 14:08:00.025784 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:00.502907 run create_hlr_db(pid=31014): Launched 14:08:00.629709 bus /sierra_2: Setting Powered False 14:08:01.690012 run create_hlr_db(pid=31014): Terminated: ok {rc=0} 14:08:02.137734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31016): Launched 14:08:02.455616 run osmo-hlr_10.42.42.2(pid=31017): Launched 14:08:02.575703 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:03.106328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31019): Launched 14:08:03.413426 run osmo-stp_10.42.42.5(pid=31020): Launched 14:08:03.535044 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:04.088598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31022): Launched 14:08:04.395738 run osmo-msc_10.42.42.6(pid=31023): Launched 14:08:04.569410 run osmo-stp_10.42.42.5(pid=31020): ERR: Terminated: ERROR {rc=1} [trial-2405↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31020)] 14:08:04.699387 run osmo-stp_10.42.42.5(pid=31020): stdout: | (launched: 2022-12-14_14:08:03.357295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:04.829436 run osmo-stp_10.42.42.5(pid=31020): stderr: | 20221214140803529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140803529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140803529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140803531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140803531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140803531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140803531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:04.957476 run osmo-stp_10.42.42.5(pid=31020): stdout: | (launched: 2022-12-14_14:08:03.357295) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:05.079733 run osmo-stp_10.42.42.5(pid=31020): stderr: | 20221214140803529 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140803529 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140803529 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140803531 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140803531 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140803531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140803531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:05.227023 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31020): Process ended prematurely: osmo-stp_10.42.42.5(pid=31020) [trial-2405↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31020)] [trial-2405↪encryption↪register_a5_1_authreq.py:8] 14:08:05.235803 tst register_a5_1_authreq.py:8: Test FAILED (6.2 sec) 14:08:05.262049 run osmo-hlr_10.42.42.2(pid=31017): ERR: Terminated: ERROR {rc=237} [trial-2405↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31017)] 14:08:05.309516 run osmo-hlr_10.42.42.2(pid=31017): stdout: | (launched: 2022-12-14_14:08:02.398953) 14:08:05.358491 run osmo-hlr_10.42.42.2(pid=31017): stderr: | 20221214140802579 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140802579 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140802579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140802579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140802579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140802579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140802603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140802613 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140802613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140802613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:05.426737 run osmo-msc_10.42.42.6(pid=31023): ERR: Terminated: ERROR {rc=2} [trial-2405↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31023)] 14:08:05.473885 run osmo-msc_10.42.42.6(pid=31023): stdout: | (launched: 2022-12-14_14:08:04.339789) 14:08:05.523039 run osmo-msc_10.42.42.6(pid=31023): stderr: | 20221214140804610 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140804610 DLGLOBAL DEBUG validating counter group 0x7f2273f15c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140804611 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140804611 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140804611 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140804611 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140804613 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140804613 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140804613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140804613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:05.572361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31016): Terminating (SIGTERM) 14:08:05.611850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31019): Terminating (SIGTERM) 14:08:05.651474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31022): Terminating (SIGTERM) 14:08:05.691153 --- ParallelTerminationStrategy: PID 31016 died... 14:08:05.710291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31016): Terminated: ok {rc=0} 14:08:05.754083 --- ParallelTerminationStrategy: PID 31019 died... 14:08:05.772433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31019): Terminated: ok {rc=0} 14:08:05.816096 --- ParallelTerminationStrategy: PID 31022 died... 14:08:05.834714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31022): Terminated: ok {rc=0} 14:08:05.919434 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2405 encryption register_a5_3_authreq.py ---------------------------------------------- 14:08:07.073897 tst encryption: Using 1 x ip_address (candidates: 6) 14:08:07.085733 tst encryption: Using 1 x bts (candidates: 1) 14:08:07.123031 tst register_a5_3_authreq.py: using LAC 41428 14:08:07.246596 tst register_a5_3_authreq.py: using RAC 118 14:08:07.370280 tst register_a5_3_authreq.py: using CellId 41428 14:08:07.493563 tst register_a5_3_authreq.py: using BVCI 41429 14:08:07.606823 tst encryption: Using 1 x ip_address (candidates: 6) 14:08:07.617429 tst encryption: Using 1 x ip_address (candidates: 6) 14:08:07.627896 tst encryption: Using 1 x ip_address (candidates: 6) 14:08:07.638342 tst encryption: Using 1 x ip_address (candidates: 6) 14:08:07.649059 tst encryption: Using 1 x ip_address (candidates: 6) 14:08:07.659789 tst encryption: Using 1 x modem (candidates: 1) 14:08:07.790032 tst register_a5_3_authreq.py:8: start network... 14:08:08.014089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:08:08.523816 run create_hlr_db(pid=31025): Launched 14:08:08.650338 bus /sierra_2: Setting Powered False 14:08:09.715006 run create_hlr_db(pid=31025): Terminated: ok {rc=0} 14:08:10.154120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31027): Launched 14:08:10.461575 run osmo-hlr_10.42.42.2(pid=31028): Launched 14:08:10.580323 run osmo-stp_10.42.42.5: Starting osmo-stp 14:08:11.109864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31030): Launched 14:08:11.418323 run osmo-stp_10.42.42.5(pid=31031): Launched 14:08:11.536222 run osmo-msc_10.42.42.6: Starting osmo-msc 14:08:12.095376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31033): Launched 14:08:12.397740 run osmo-msc_10.42.42.6(pid=31034): Launched 14:08:12.568157 run osmo-stp_10.42.42.5(pid=31031): ERR: Terminated: ERROR {rc=1} [trial-2405↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31031)] 14:08:12.696836 run osmo-stp_10.42.42.5(pid=31031): stdout: | (launched: 2022-12-14_14:08:11.362312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:12.825715 run osmo-stp_10.42.42.5(pid=31031): stderr: | 20221214140811533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140811533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140811533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140811533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140811537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140811537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140811537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:12.951791 run osmo-stp_10.42.42.5(pid=31031): stdout: | (launched: 2022-12-14_14:08:11.362312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:08:13.072696 run osmo-stp_10.42.42.5(pid=31031): stderr: | 20221214140811533 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214140811533 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214140811533 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214140811533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214140811537 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214140811537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214140811537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:08:13.217643 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31031): Process ended prematurely: osmo-stp_10.42.42.5(pid=31031) [trial-2405↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31031)] [trial-2405↪encryption↪register_a5_3_authreq.py:8] 14:08:13.226491 tst register_a5_3_authreq.py:8: Test FAILED (6.2 sec) 14:08:13.252144 run osmo-hlr_10.42.42.2(pid=31028): ERR: Terminated: ERROR {rc=237} [trial-2405↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31028)] 14:08:13.299296 run osmo-hlr_10.42.42.2(pid=31028): stdout: | (launched: 2022-12-14_14:08:10.405231) 14:08:13.348584 run osmo-hlr_10.42.42.2(pid=31028): stderr: | 20221214140810583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214140810583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214140810583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214140810583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214140810583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214140810583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214140810595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214140810606 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214140810607 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214140810607 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:08:13.416912 run osmo-msc_10.42.42.6(pid=31034): ERR: Terminated: ERROR {rc=2} [trial-2405↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31034)] 14:08:13.464025 run osmo-msc_10.42.42.6(pid=31034): stdout: | (launched: 2022-12-14_14:08:12.342586) 14:08:13.512748 run osmo-msc_10.42.42.6(pid=31034): stderr: | 20221214140812615 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214140812615 DLGLOBAL DEBUG validating counter group 0x7f6530065c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214140812615 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214140812615 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214140812615 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214140812616 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214140812617 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214140812618 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214140812618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214140812618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:08:13.561742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31027): Terminating (SIGTERM) 14:08:13.601350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31030): Terminating (SIGTERM) 14:08:13.640734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31033): Terminating (SIGTERM) 14:08:13.680051 --- ParallelTerminationStrategy: PID 31027 died... 14:08:13.698916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31027): Terminated: ok {rc=0} 14:08:13.742331 --- ParallelTerminationStrategy: PID 31030 died... 14:08:13.760557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31030): Terminated: ok {rc=0} 14:08:13.803878 --- ParallelTerminationStrategy: PID 31033 died... 14:08:13.822298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31033): Terminated: ok {rc=0} 14:08:13.903897 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 14:08:15.104683 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:08:15.109280 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 14:08:15.127195 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 14:08:15.154471 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 14:08:15.182088 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 14:08:15.200908 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 14:08:15.227438 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 14:08:15.738324 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2405 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 14:08:15.743410 tst handover.py:11: TEST_CONFIG: {} 14:08:15.977820 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:08:15.994421 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:08:16.018216 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:08:16.072003 tst handover.py: using MSISDN 8728 14:08:16.220268 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8728', subscriber_id=0} 14:08:16.337765 run srsepc_10.42.42.118: Starting srsepc 14:08:18.250281 run rm-remote-dir(pid=31039): Launched 14:08:18.379371 bus /sierra_2: Setting Powered False 14:08:19.447407 run rm-remote-dir(pid=31039): Terminated: ok {rc=0} 14:08:19.914287 run mk-remote-dir(pid=31040): Launched 14:08:21.103316 run mk-remote-dir(pid=31040): Terminated: ok {rc=0} 14:08:21.408518 run scp-inst-to-remote(pid=31041): Launched 14:08:23.597093 run scp-inst-to-remote(pid=31041): Terminated: ok {rc=0} 14:08:23.949648 run rm-remote-dir(pid=31043): Launched 14:08:25.137934 run rm-remote-dir(pid=31043): Terminated: ok {rc=0} 14:08:25.493843 run mk-remote-dir(pid=31044): Launched 14:08:26.683599 run mk-remote-dir(pid=31044): Terminated: ok {rc=0} 14:08:26.985930 run scp-cfg-to-remote(pid=31045): Launched 14:08:28.170818 run scp-cfg-to-remote(pid=31045): Terminated: ok {rc=0} 14:08:28.471722 run scp-db-to-remote(pid=31047): Launched 14:08:29.658497 run scp-db-to-remote(pid=31047): Terminated: ok {rc=0} 14:08:29.798459 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:08:30.123672 run patchelf(pid=31049): Launched 14:08:31.309141 run patchelf(pid=31049): Terminated: ok {rc=0} 14:08:31.451655 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:08:31.795555 run setcap-netadm(pid=31050): Launched 14:08:33.027396 run setcap-netadm(pid=31050): Terminated: ok {rc=0} 14:08:33.345584 run srsepc(pid=31051): Launched 14:08:33.460249 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:08:34.618296 run rm-remote-dir(pid=31052): Launched 14:08:34.803544 run srsepc(pid=31051): ERR: Terminated: ERROR {rc=127} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31051)] 14:08:34.945867 run srsepc(pid=31051): stdout: | (launched: 2022-12-14_14:08:33.290131) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:08:35.089137 run srsepc(pid=31051): stderr: | (launched: 2022-12-14_14:08:33.335070) | Connection to 10.42.42.116 closed. 14:08:35.232390 run srsepc(pid=31051): stdout: | (launched: 2022-12-14_14:08:33.290131) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:08:35.369327 run srsepc(pid=31051): stderr: | (launched: 2022-12-14_14:08:33.335070) | Connection to 10.42.42.116 closed. 14:08:35.531124 run rm-remote-dir(pid=31052): Terminating (SIGINT) 14:08:35.718628 run rm-remote-dir(pid=31052): Terminated: ok {rc=0} 14:08:35.854537 tst handover.py:37: ERR: Error: srsepc(pid=31051): Process ended prematurely: srsepc(pid=31051) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31051)] [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 14:08:35.865088 tst handover.py:37: Test FAILED (20.1 sec) 14:08:35.945632 run scp-back-log(pid=31053): Launched 14:08:37.023859 run scp-back-log(pid=31053): ERR: Terminated: ERROR {rc=1} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31053)] 14:08:37.087395 run scp-back-log(pid=31053): stdout: | (launched: 2022-12-14_14:08:35.914138) 14:08:37.152794 run scp-back-log(pid=31053): stderr: | (launched: 2022-12-14_14:08:35.934677) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:08:37.226046 tst srsepc_10.42.42.118: Error('scp-back-log(pid=31053): launch_sync(): local process exited with status 1 [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31053)]') ---------------------------------------------- trial-2405 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 14:08:37.272708 tst iperf3_bidir.py:13: Number of physical ue: 1 14:08:37.493600 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:08:37.535480 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 14:08:37.737674 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:08:37.753265 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:08:37.785299 tst iperf3_bidir.py: using MSISDN 8729 14:08:37.903777 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8729', subscriber_id=0} 14:08:38.017695 run srsepc_10.42.42.118: Starting srsepc 14:08:38.682234 run rm-remote-dir(pid=31055): Launched 14:08:39.870151 run rm-remote-dir(pid=31055): Terminated: ok {rc=0} 14:08:40.223936 run mk-remote-dir(pid=31056): Launched 14:08:41.412123 run mk-remote-dir(pid=31056): Terminated: ok {rc=0} 14:08:41.713090 run scp-inst-to-remote(pid=31057): Launched 14:08:43.896665 run scp-inst-to-remote(pid=31057): Terminated: ok {rc=0} 14:08:44.226160 run rm-remote-dir(pid=31059): Launched 14:08:45.403062 run rm-remote-dir(pid=31059): Terminated: ok {rc=0} 14:08:45.733833 run mk-remote-dir(pid=31060): Launched 14:08:46.959191 run mk-remote-dir(pid=31060): Terminated: ok {rc=0} 14:08:47.338889 run scp-cfg-to-remote(pid=31061): Launched 14:08:48.535886 run scp-cfg-to-remote(pid=31061): Terminated: ok {rc=0} 14:08:48.835936 run scp-db-to-remote(pid=31063): Launched 14:08:50.022152 run scp-db-to-remote(pid=31063): Terminated: ok {rc=0} 14:08:50.161108 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:08:50.487307 run patchelf(pid=31065): Launched 14:08:51.671776 run patchelf(pid=31065): Terminated: ok {rc=0} 14:08:51.810959 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:08:52.136544 run setcap-netadm(pid=31066): Launched 14:08:53.322381 run setcap-netadm(pid=31066): Terminated: ok {rc=0} 14:08:53.663597 run srsepc(pid=31067): Launched 14:08:53.783785 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:08:54.946450 run rm-remote-dir(pid=31068): Launched 14:08:55.130595 run srsepc(pid=31067): ERR: Terminated: ERROR {rc=127} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31067)] 14:08:55.272694 run srsepc(pid=31067): stdout: | (launched: 2022-12-14_14:08:53.604681) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:08:55.415648 run srsepc(pid=31067): stderr: | (launched: 2022-12-14_14:08:53.652903) | Connection to 10.42.42.116 closed. 14:08:55.558018 run srsepc(pid=31067): stdout: | (launched: 2022-12-14_14:08:53.604681) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:08:55.694669 run srsepc(pid=31067): stderr: | (launched: 2022-12-14_14:08:53.652903) | Connection to 10.42.42.116 closed. 14:08:55.856349 run rm-remote-dir(pid=31068): Terminating (SIGINT) 14:08:56.043510 run rm-remote-dir(pid=31068): Terminated: ok {rc=0} 14:08:56.179587 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=31067): Process ended prematurely: srsepc(pid=31067) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31067)] [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 14:08:56.190687 tst iperf3_bidir.py:42: Test FAILED (18.9 sec) 14:08:56.270941 run scp-back-log(pid=31069): Launched 14:08:57.349625 run scp-back-log(pid=31069): ERR: Terminated: ERROR {rc=1} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31069)] 14:08:57.413618 run scp-back-log(pid=31069): stdout: | (launched: 2022-12-14_14:08:56.239884) 14:08:57.478643 run scp-back-log(pid=31069): stderr: | (launched: 2022-12-14_14:08:56.260311) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:08:57.551444 tst srsepc_10.42.42.118: Error('scp-back-log(pid=31069): launch_sync(): local process exited with status 1 [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31069)]') ---------------------------------------------- trial-2405 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 14:08:57.595995 tst iperf3_dl.py:13: Number of physical ue: 1 14:08:57.798935 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:08:57.842957 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 14:08:58.064538 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:08:58.080878 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:08:58.113808 tst iperf3_dl.py: using MSISDN 8730 14:08:58.233334 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8730', subscriber_id=0} 14:08:58.347960 run srsepc_10.42.42.118: Starting srsepc 14:08:59.012272 run rm-remote-dir(pid=31071): Launched 14:09:00.200869 run rm-remote-dir(pid=31071): Terminated: ok {rc=0} 14:09:00.555363 run mk-remote-dir(pid=31072): Launched 14:09:01.756744 run mk-remote-dir(pid=31072): Terminated: ok {rc=0} 14:09:02.142038 run scp-inst-to-remote(pid=31105): Launched 14:09:05.398249 run scp-inst-to-remote(pid=31105): Terminated: ok {rc=0} 14:09:05.773646 run rm-remote-dir(pid=31345): Launched 14:09:07.003318 run rm-remote-dir(pid=31345): Terminated: ok {rc=0} 14:09:07.355280 run mk-remote-dir(pid=31348): Launched 14:09:08.603353 run mk-remote-dir(pid=31348): Terminated: ok {rc=0} 14:09:08.900738 run scp-cfg-to-remote(pid=31349): Launched 14:09:10.145761 run scp-cfg-to-remote(pid=31349): Terminated: ok {rc=0} 14:09:10.465749 run scp-db-to-remote(pid=31351): Launched 14:09:11.688095 run scp-db-to-remote(pid=31351): Terminated: ok {rc=0} 14:09:11.834793 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:09:12.237688 run patchelf(pid=31353): Launched 14:09:13.474824 run patchelf(pid=31353): Terminated: ok {rc=0} 14:09:13.627044 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:09:13.975588 run setcap-netadm(pid=31354): Launched 14:09:15.225752 run setcap-netadm(pid=31354): Terminated: ok {rc=0} 14:09:15.590364 run srsepc(pid=31355): Launched 14:09:15.770469 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:09:17.327312 run rm-remote-dir(pid=31356): Launched 14:09:17.702289 run srsepc(pid=31355): ERR: Terminated: ERROR {rc=127} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31355)] 14:09:17.881503 run srsepc(pid=31355): stdout: | (launched: 2022-12-14_14:09:15.526611) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:09:18.065370 run srsepc(pid=31355): stderr: | (launched: 2022-12-14_14:09:15.577137) | Connection to 10.42.42.116 closed. 14:09:18.229440 run srsepc(pid=31355): stdout: | (launched: 2022-12-14_14:09:15.526611) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:09:18.376112 run srsepc(pid=31355): stderr: | (launched: 2022-12-14_14:09:15.577137) | Connection to 10.42.42.116 closed. 14:09:18.547457 run rm-remote-dir(pid=31356): Terminating (SIGINT) 14:09:18.747204 run rm-remote-dir(pid=31356): Terminated: ok {rc=0} 14:09:18.891030 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=31355): Process ended prematurely: srsepc(pid=31355) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31355)] [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 14:09:18.902721 tst iperf3_dl.py:42: Test FAILED (21.3 sec) 14:09:18.992889 run scp-back-log(pid=31357): Launched 14:09:20.112699 run scp-back-log(pid=31357): ERR: Terminated: ERROR {rc=1} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31357)] 14:09:20.180767 run scp-back-log(pid=31357): stdout: | (launched: 2022-12-14_14:09:18.956276) 14:09:20.249810 run scp-back-log(pid=31357): stderr: | (launched: 2022-12-14_14:09:18.977597) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:09:20.327958 tst srsepc_10.42.42.118: Error('scp-back-log(pid=31357): launch_sync(): local process exited with status 1 [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31357)]') ---------------------------------------------- trial-2405 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 14:09:20.378990 tst iperf3_ul.py:13: Number of physical ue: 1 14:09:20.614083 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:09:20.657716 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 14:09:20.889953 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:09:20.907415 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:09:20.942155 tst iperf3_ul.py: using MSISDN 8731 14:09:21.068202 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8731', subscriber_id=0} 14:09:21.190745 run srsepc_10.42.42.118: Starting srsepc 14:09:21.902536 run rm-remote-dir(pid=31359): Launched 14:09:23.173409 run rm-remote-dir(pid=31359): Terminated: ok {rc=0} 14:09:23.556874 run mk-remote-dir(pid=31360): Launched 14:09:24.776501 run mk-remote-dir(pid=31360): Terminated: ok {rc=0} 14:09:25.100890 run scp-inst-to-remote(pid=31361): Launched 14:09:27.325870 run scp-inst-to-remote(pid=31361): Terminated: ok {rc=0} 14:09:27.686115 run rm-remote-dir(pid=31364): Launched 14:09:28.878243 run rm-remote-dir(pid=31364): Terminated: ok {rc=0} 14:09:29.240386 run mk-remote-dir(pid=31365): Launched 14:09:30.434159 run mk-remote-dir(pid=31365): Terminated: ok {rc=0} 14:09:30.742483 run scp-cfg-to-remote(pid=31366): Launched 14:09:31.933575 run scp-cfg-to-remote(pid=31366): Terminated: ok {rc=0} 14:09:32.251001 run scp-db-to-remote(pid=31368): Launched 14:09:33.441488 run scp-db-to-remote(pid=31368): Terminated: ok {rc=0} 14:09:33.574065 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:09:33.886182 run patchelf(pid=31370): Launched 14:09:35.065216 run patchelf(pid=31370): Terminated: ok {rc=0} 14:09:35.197880 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:09:35.510059 run setcap-netadm(pid=31371): Launched 14:09:36.689948 run setcap-netadm(pid=31371): Terminated: ok {rc=0} 14:09:37.017258 run srsepc(pid=31372): Launched 14:09:37.134906 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:09:38.272687 run rm-remote-dir(pid=31373): Launched 14:09:38.452516 run srsepc(pid=31372): ERR: Terminated: ERROR {rc=127} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31372)] 14:09:38.590080 run srsepc(pid=31372): stdout: | (launched: 2022-12-14_14:09:36.959772) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:09:38.727050 run srsepc(pid=31372): stderr: | (launched: 2022-12-14_14:09:37.005905) | Connection to 10.42.42.116 closed. 14:09:38.864273 run srsepc(pid=31372): stdout: | (launched: 2022-12-14_14:09:36.959772) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:09:38.995160 run srsepc(pid=31372): stderr: | (launched: 2022-12-14_14:09:37.005905) | Connection to 10.42.42.116 closed. 14:09:39.150355 run rm-remote-dir(pid=31373): Terminating (SIGINT) 14:09:39.330119 run rm-remote-dir(pid=31373): Terminated: ok {rc=0} 14:09:39.459621 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=31372): Process ended prematurely: srsepc(pid=31372) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31372)] [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 14:09:39.469808 tst iperf3_ul.py:42: Test FAILED (19.1 sec) 14:09:39.546296 run scp-back-log(pid=31374): Launched 14:09:40.622691 run scp-back-log(pid=31374): ERR: Terminated: ERROR {rc=1} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31374)] 14:09:40.683065 run scp-back-log(pid=31374): stdout: | (launched: 2022-12-14_14:09:39.515747) 14:09:40.744921 run scp-back-log(pid=31374): stderr: | (launched: 2022-12-14_14:09:39.535290) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:09:40.814689 tst srsepc_10.42.42.118: Error('scp-back-log(pid=31374): launch_sync(): local process exited with status 1 [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31374)]') ---------------------------------------------- trial-2405 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 14:09:40.859908 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:09:40.876593 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:09:40.899274 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:09:40.948923 tst ping.py: using MSISDN 8732 14:09:41.071505 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8732', subscriber_id=0} 14:09:41.188505 run srsepc_10.42.42.118: Starting srsepc 14:09:41.869232 run rm-remote-dir(pid=31376): Launched 14:09:43.062313 run rm-remote-dir(pid=31376): Terminated: ok {rc=0} 14:09:43.425825 run mk-remote-dir(pid=31377): Launched 14:09:44.615348 run mk-remote-dir(pid=31377): Terminated: ok {rc=0} 14:09:44.905681 run scp-inst-to-remote(pid=31378): Launched 14:09:47.084804 run scp-inst-to-remote(pid=31378): Terminated: ok {rc=0} 14:09:47.435575 run rm-remote-dir(pid=31380): Launched 14:09:48.628029 run rm-remote-dir(pid=31380): Terminated: ok {rc=0} 14:09:48.968146 run mk-remote-dir(pid=31381): Launched 14:09:50.150947 run mk-remote-dir(pid=31381): Terminated: ok {rc=0} 14:09:50.441894 run scp-cfg-to-remote(pid=31382): Launched 14:09:51.620325 run scp-cfg-to-remote(pid=31382): Terminated: ok {rc=0} 14:09:51.908186 run scp-db-to-remote(pid=31384): Launched 14:09:53.087483 run scp-db-to-remote(pid=31384): Terminated: ok {rc=0} 14:09:53.220515 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:09:53.532614 run patchelf(pid=31386): Launched 14:09:54.712732 run patchelf(pid=31386): Terminated: ok {rc=0} 14:09:54.845434 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:09:55.156913 run setcap-netadm(pid=31387): Launched 14:09:56.335013 run setcap-netadm(pid=31387): Terminated: ok {rc=0} 14:09:56.662938 run srsepc(pid=31388): Launched 14:09:56.780139 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:09:57.906515 run rm-remote-dir(pid=31389): Launched 14:09:58.086956 run srsepc(pid=31388): ERR: Terminated: ERROR {rc=127} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31388)] 14:09:58.225315 run srsepc(pid=31388): stdout: | (launched: 2022-12-14_14:09:56.605565) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:09:58.362523 run srsepc(pid=31388): stderr: | (launched: 2022-12-14_14:09:56.651667) | Connection to 10.42.42.116 closed. 14:09:58.499598 run srsepc(pid=31388): stdout: | (launched: 2022-12-14_14:09:56.605565) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:09:58.630979 run srsepc(pid=31388): stderr: | (launched: 2022-12-14_14:09:56.651667) | Connection to 10.42.42.116 closed. 14:09:58.785795 run rm-remote-dir(pid=31389): Terminating (SIGINT) 14:09:58.966152 run rm-remote-dir(pid=31389): Terminated: ok {rc=0} 14:09:59.096782 tst ping.py:16: ERR: Error: srsepc(pid=31388): Process ended prematurely: srsepc(pid=31388) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31388)] [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 14:09:59.106930 tst ping.py:16: Test FAILED (18.2 sec) 14:09:59.184443 run scp-back-log(pid=31390): Launched 14:10:00.261845 run scp-back-log(pid=31390): ERR: Terminated: ERROR {rc=1} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31390)] 14:10:00.322602 run scp-back-log(pid=31390): stdout: | (launched: 2022-12-14_14:09:59.153555) 14:10:00.384932 run scp-back-log(pid=31390): stderr: | (launched: 2022-12-14_14:09:59.173370) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:10:00.455326 tst srsepc_10.42.42.118: Error('scp-back-log(pid=31390): launch_sync(): local process exited with status 1 [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31390)]') ---------------------------------------------- trial-2405 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 14:10:00.501106 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:10:00.517831 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:10:00.540333 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:10:00.591180 tst rrc_idle_mo_ping.py: using MSISDN 8733 14:10:00.705932 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8733', subscriber_id=0} 14:10:00.814075 run srsepc_10.42.42.118: Starting srsepc 14:10:01.531990 run rm-remote-dir(pid=31395): Launched 14:10:02.782216 run rm-remote-dir(pid=31395): Terminated: ok {rc=0} 14:10:03.145744 run mk-remote-dir(pid=31396): Launched 14:10:04.338724 run mk-remote-dir(pid=31396): Terminated: ok {rc=0} 14:10:04.648014 run scp-inst-to-remote(pid=31397): Launched 14:10:06.835579 run scp-inst-to-remote(pid=31397): Terminated: ok {rc=0} 14:10:07.173746 run rm-remote-dir(pid=31399): Launched 14:10:08.355732 run rm-remote-dir(pid=31399): Terminated: ok {rc=0} 14:10:08.696179 run mk-remote-dir(pid=31400): Launched 14:10:09.878760 run mk-remote-dir(pid=31400): Terminated: ok {rc=0} 14:10:10.168844 run scp-cfg-to-remote(pid=31401): Launched 14:10:11.347618 run scp-cfg-to-remote(pid=31401): Terminated: ok {rc=0} 14:10:11.634685 run scp-db-to-remote(pid=31403): Launched 14:10:12.814531 run scp-db-to-remote(pid=31403): Terminated: ok {rc=0} 14:10:12.947240 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:10:13.259484 run patchelf(pid=31405): Launched 14:10:14.438414 run patchelf(pid=31405): Terminated: ok {rc=0} 14:10:14.571755 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:10:14.884359 run setcap-netadm(pid=31406): Launched 14:10:16.074796 run setcap-netadm(pid=31406): Terminated: ok {rc=0} 14:10:16.450255 run srsepc(pid=31407): Launched 14:10:16.616096 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:10:17.859017 run rm-remote-dir(pid=31408): Launched 14:10:18.039242 run srsepc(pid=31407): ERR: Terminated: ERROR {rc=127} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31407)] 14:10:18.177041 run srsepc(pid=31407): stdout: | (launched: 2022-12-14_14:10:16.387964) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:10:18.314024 run srsepc(pid=31407): stderr: | (launched: 2022-12-14_14:10:16.435291) | Connection to 10.42.42.116 closed. 14:10:18.450971 run srsepc(pid=31407): stdout: | (launched: 2022-12-14_14:10:16.387964) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:10:18.582120 run srsepc(pid=31407): stderr: | (launched: 2022-12-14_14:10:16.435291) | Connection to 10.42.42.116 closed. 14:10:18.736886 run rm-remote-dir(pid=31408): Terminating (SIGINT) 14:10:18.916542 run rm-remote-dir(pid=31408): Terminated: ok {rc=0} 14:10:19.046835 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=31407): Process ended prematurely: srsepc(pid=31407) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31407)] [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 14:10:19.056767 tst rrc_idle_mo_ping.py:16: Test FAILED (18.5 sec) 14:10:19.134686 run scp-back-log(pid=31409): Launched 14:10:20.212821 run scp-back-log(pid=31409): ERR: Terminated: ERROR {rc=1} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31409)] 14:10:20.273611 run scp-back-log(pid=31409): stdout: | (launched: 2022-12-14_14:10:19.103598) 14:10:20.336223 run scp-back-log(pid=31409): stderr: | (launched: 2022-12-14_14:10:19.123628) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:10:20.406456 tst srsepc_10.42.42.118: Error('scp-back-log(pid=31409): launch_sync(): local process exited with status 1 [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31409)]') ---------------------------------------------- trial-2405 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 14:10:20.452556 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 14:10:20.469240 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 14:10:20.491668 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 14:10:20.544463 tst rrc_idle_mt_ping.py: using MSISDN 8734 14:10:20.660599 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='8734', subscriber_id=0} 14:10:20.769460 run srsepc_10.42.42.118: Starting srsepc 14:10:21.405673 run rm-remote-dir(pid=31411): Launched 14:10:22.588896 run rm-remote-dir(pid=31411): Terminated: ok {rc=0} 14:10:22.930813 run mk-remote-dir(pid=31412): Launched 14:10:24.113391 run mk-remote-dir(pid=31412): Terminated: ok {rc=0} 14:10:24.404071 run scp-inst-to-remote(pid=31413): Launched 14:10:26.586987 run scp-inst-to-remote(pid=31413): Terminated: ok {rc=0} 14:10:26.926588 run rm-remote-dir(pid=31415): Launched 14:10:28.125501 run rm-remote-dir(pid=31415): Terminated: ok {rc=0} 14:10:28.489651 run mk-remote-dir(pid=31416): Launched 14:10:29.683200 run mk-remote-dir(pid=31416): Terminated: ok {rc=0} 14:10:29.993258 run scp-cfg-to-remote(pid=31417): Launched 14:10:31.199498 run scp-cfg-to-remote(pid=31417): Terminated: ok {rc=0} 14:10:31.523211 run scp-db-to-remote(pid=31419): Launched 14:10:32.754975 run scp-db-to-remote(pid=31419): Terminated: ok {rc=0} 14:10:32.888039 run srsepc_10.42.42.118: Setting RPATH for srsepc 14:10:33.200862 run patchelf(pid=31421): Launched 14:10:34.380788 run patchelf(pid=31421): Terminated: ok {rc=0} 14:10:34.513347 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 14:10:34.826346 run setcap-netadm(pid=31422): Launched 14:10:36.006421 run setcap-netadm(pid=31422): Terminated: ok {rc=0} 14:10:36.333901 run srsepc(pid=31423): Launched 14:10:36.451579 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 14:10:37.574960 run rm-remote-dir(pid=31424): Launched 14:10:37.754500 run srsepc(pid=31423): ERR: Terminated: ERROR {rc=127} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31423)] 14:10:37.891389 run srsepc(pid=31423): stdout: | (launched: 2022-12-14_14:10:36.276112) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:10:38.027626 run srsepc(pid=31423): stderr: | (launched: 2022-12-14_14:10:36.322380) | Connection to 10.42.42.116 closed. 14:10:38.163681 run srsepc(pid=31423): stdout: | (launched: 2022-12-14_14:10:36.276112) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 14:10:38.293949 run srsepc(pid=31423): stderr: | (launched: 2022-12-14_14:10:36.322380) | Connection to 10.42.42.116 closed. 14:10:38.448012 run rm-remote-dir(pid=31424): Terminating (SIGINT) 14:10:38.627698 run rm-remote-dir(pid=31424): Terminated: ok {rc=0} 14:10:38.757910 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=31423): Process ended prematurely: srsepc(pid=31423) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31423)] [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 14:10:38.767730 tst rrc_idle_mt_ping.py:16: Test FAILED (18.3 sec) 14:10:38.845204 run scp-back-log(pid=31425): Launched 14:10:39.922506 run scp-back-log(pid=31425): ERR: Terminated: ERROR {rc=1} [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31425)] 14:10:39.988634 run scp-back-log(pid=31425): stdout: | (launched: 2022-12-14_14:10:38.813904) 14:10:40.055289 run scp-back-log(pid=31425): stderr: | (launched: 2022-12-14_14:10:38.833808) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 14:10:40.129304 tst srsepc_10.42.42.118: Error('scp-back-log(pid=31425): launch_sync(): local process exited with status 1 [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=31425)]') --------------------------------------------------------------------- trial-2405 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 14:10:40.263553 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:10:40.269320 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 14:10:40.312938 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 14:10:40.340145 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 14:10:40.393402 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 14:10:40.437009 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 14:10:40.464042 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 14:10:41.014027 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 14:10:41.020423 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:10:41.032161 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 14:10:41.069966 tst handover.py: using LAC 41429 14:10:41.192295 tst handover.py: using RAC 119 14:10:41.314481 tst handover.py: using CellId 41429 14:10:41.435866 tst handover.py: using BVCI 41430 14:10:41.548208 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 14:10:41.585968 tst handover.py: using LAC 41430 14:10:41.706617 tst handover.py: using RAC 120 14:10:41.826689 tst handover.py: using CellId 41430 14:10:41.946416 tst handover.py: using BVCI 41431 14:10:42.058324 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:10:42.069038 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:10:42.079500 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:10:42.090080 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:10:42.100666 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 14:10:42.111159 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 14:10:42.233352 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 14:10:42.349869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:10:42.825142 run create_hlr_db(pid=31432): Launched 14:10:43.996498 run create_hlr_db(pid=31432): Terminated: ok {rc=0} 14:10:44.318491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31434): Launched 14:10:44.624092 run osmo-hlr_10.42.42.2(pid=31435): Launched 14:10:44.741110 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:45.310536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31437): Launched 14:10:45.637406 run osmo-stp_10.42.42.5(pid=31438): Launched 14:10:45.763435 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:46.455105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31440): Launched 14:10:46.801468 run osmo-msc_10.42.42.6(pid=31441): Launched 14:10:47.096344 run osmo-stp_10.42.42.5(pid=31438): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31438)] 14:10:47.305203 run osmo-stp_10.42.42.5(pid=31438): stdout: | (launched: 2022-12-14_14:10:45.577493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:47.444352 run osmo-stp_10.42.42.5(pid=31438): stderr: | 20221214141045772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141045773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141045773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141045773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141045774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141045774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141045774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:47.580896 run osmo-stp_10.42.42.5(pid=31438): stdout: | (launched: 2022-12-14_14:10:45.577493) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:47.711367 run osmo-stp_10.42.42.5(pid=31438): stderr: | 20221214141045772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141045773 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141045773 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141045773 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141045774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141045774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141045774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:47.867170 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31438): Process ended prematurely: osmo-stp_10.42.42.5(pid=31438) [trial-2405↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31438)] [trial-2405↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 14:10:47.875899 tst handover.py:18: Test FAILED (6.8 sec) 14:10:47.903211 run osmo-hlr_10.42.42.2(pid=31435): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31435)] 14:10:47.953974 run osmo-hlr_10.42.42.2(pid=31435): stdout: | (launched: 2022-12-14_14:10:44.567540) 14:10:48.006041 run osmo-hlr_10.42.42.2(pid=31435): stderr: | 20221214141044747 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141044747 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141044747 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141044747 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141044747 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141044747 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141044770 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141044778 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141044779 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141044779 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:48.078973 run osmo-msc_10.42.42.6(pid=31441): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31441)] 14:10:48.128886 run osmo-msc_10.42.42.6(pid=31441): stdout: | (launched: 2022-12-14_14:10:46.739369) 14:10:48.181293 run osmo-msc_10.42.42.6(pid=31441): stderr: | 20221214141047203 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141047203 DLGLOBAL DEBUG validating counter group 0x7fb21e86cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141047203 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141047203 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141047203 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141047203 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141047206 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141047207 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141047207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141047207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:48.233334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31434): Terminating (SIGTERM) 14:10:48.274853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31437): Terminating (SIGTERM) 14:10:48.317733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31440): Terminating (SIGTERM) 14:10:48.359888 --- ParallelTerminationStrategy: PID 31434 died... 14:10:48.380122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31434): Terminated: ok {rc=0} 14:10:48.426650 --- ParallelTerminationStrategy: PID 31437 died... 14:10:48.446554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31437): Terminated: ok {rc=0} 14:10:48.492712 --- ParallelTerminationStrategy: PID 31440 died... 14:10:48.512521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31440): Terminated: ok {rc=0} 14:10:48.600685 bus /sierra_3: Setting Powered False 14:10:49.698984 bus /sierra_3: Setting Powered False 14:10:50.811619 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 14:10:52.063424 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:10:52.068638 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 14:10:52.112223 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 14:10:52.139613 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 14:10:52.192154 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 14:10:52.231450 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 14:10:52.258198 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 14:10:52.815230 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 14:10:52.821618 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:10:52.832411 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 14:10:52.870423 tst handover.py: using LAC 41431 14:10:52.991425 tst handover.py: using RAC 121 14:10:53.112777 tst handover.py: using CellId 41431 14:10:53.232324 tst handover.py: using BVCI 41432 14:10:53.345268 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 14:10:53.379464 tst handover.py: using LAC 41432 14:10:53.500720 tst handover.py: using RAC 122 14:10:53.620321 tst handover.py: using CellId 41432 14:10:53.741362 tst handover.py: using BVCI 41433 14:10:53.852264 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:10:53.863106 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:10:53.874151 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:10:53.884676 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:10:53.895377 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:10:53.905963 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 14:10:54.027716 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 14:10:54.144903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:10:54.592327 run create_hlr_db(pid=31447): Launched 14:10:54.709643 bus /sierra_2: Setting Powered False 14:10:55.770226 run create_hlr_db(pid=31447): Terminated: ok {rc=0} 14:10:56.171721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31449): Launched 14:10:56.479780 run osmo-hlr_10.42.42.2(pid=31450): Launched 14:10:56.596748 run osmo-stp_10.42.42.5: Starting osmo-stp 14:10:57.114407 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31452): Launched 14:10:57.421570 run osmo-stp_10.42.42.5(pid=31453): Launched 14:10:57.540114 run osmo-msc_10.42.42.6: Starting osmo-msc 14:10:58.069058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31455): Launched 14:10:58.377638 run osmo-msc_10.42.42.6(pid=31456): Launched 14:10:58.550013 run osmo-stp_10.42.42.5(pid=31453): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31453)] 14:10:58.679882 run osmo-stp_10.42.42.5(pid=31453): stdout: | (launched: 2022-12-14_14:10:57.364800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:58.809827 run osmo-stp_10.42.42.5(pid=31453): stderr: | 20221214141057535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141057536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141057536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141057536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141057538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141057539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141057539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:58.938227 run osmo-stp_10.42.42.5(pid=31453): stdout: | (launched: 2022-12-14_14:10:57.364800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:10:59.060381 run osmo-stp_10.42.42.5(pid=31453): stderr: | 20221214141057535 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141057536 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141057536 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141057536 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141057538 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141057539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141057539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:10:59.207010 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31453): Process ended prematurely: osmo-stp_10.42.42.5(pid=31453) [trial-2405↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31453)] [trial-2405↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 14:10:59.215380 tst handover.py:18: Test FAILED (6.4 sec) 14:10:59.241029 run osmo-hlr_10.42.42.2(pid=31450): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31450)] 14:10:59.288402 run osmo-hlr_10.42.42.2(pid=31450): stdout: | (launched: 2022-12-14_14:10:56.423147) 14:10:59.337312 run osmo-hlr_10.42.42.2(pid=31450): stderr: | 20221214141056601 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141056601 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141056601 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141056602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141056602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141056602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141056614 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141056625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141056625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141056625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:10:59.405960 run osmo-msc_10.42.42.6(pid=31456): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31456)] 14:10:59.453121 run osmo-msc_10.42.42.6(pid=31456): stdout: | (launched: 2022-12-14_14:10:58.320258) 14:10:59.501907 run osmo-msc_10.42.42.6(pid=31456): stderr: | 20221214141058594 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141058594 DLGLOBAL DEBUG validating counter group 0x7f8ca617fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141058594 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141058594 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141058595 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141058595 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141058596 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141058597 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141058597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141058597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:10:59.550798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31449): Terminating (SIGTERM) 14:10:59.590201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31452): Terminating (SIGTERM) 14:10:59.629552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31455): Terminating (SIGTERM) 14:10:59.669496 --- ParallelTerminationStrategy: PID 31449 died... 14:10:59.688645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31449): Terminated: ok {rc=0} 14:10:59.732474 --- ParallelTerminationStrategy: PID 31452 died... 14:10:59.750909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31452): Terminated: ok {rc=0} 14:10:59.794518 --- ParallelTerminationStrategy: PID 31455 died... 14:10:59.813076 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31455): Terminated: ok {rc=0} 14:10:59.898316 bus /sierra_3: Setting Powered False 14:11:01.003641 bus /sierra_3: Setting Powered False 14:11:02.133153 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 14:11:03.395805 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:11:03.401985 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:11:03.455437 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:11:03.481869 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:11:03.531591 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:11:03.583713 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:11:03.609703 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:11:04.162892 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 14:11:04.168317 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:11:04.179225 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:11:04.217157 tst handover.py: using LAC 41433 14:11:04.336736 tst handover.py: using RAC 123 14:11:04.455599 tst handover.py: using CellId 41433 14:11:04.575591 tst handover.py: using BVCI 41434 14:11:04.686367 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:11:04.735638 tst handover.py: using LAC 41434 14:11:04.855328 tst handover.py: using RAC 124 14:11:04.974204 tst handover.py: using CellId 41434 14:11:05.092070 tst handover.py: using BVCI 41435 14:11:05.202686 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:11:05.213449 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:11:05.223899 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:11:05.234501 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:11:05.245141 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:11:05.255600 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:11:05.370411 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:11:05.489692 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:05.967952 run create_hlr_db(pid=31461): Launched 14:11:06.093458 bus /sierra_2: Setting Powered False 14:11:07.157835 run create_hlr_db(pid=31461): Terminated: ok {rc=0} 14:11:07.570554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31463): Launched 14:11:07.877407 run osmo-hlr_10.42.42.2(pid=31464): Launched 14:11:07.994316 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:08.494826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31466): Launched 14:11:08.801540 run osmo-stp_10.42.42.5(pid=31467): Launched 14:11:08.918817 run osmo-msc_10.42.42.6: Starting osmo-msc 14:11:09.447438 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31469): Launched 14:11:09.754797 run osmo-msc_10.42.42.6(pid=31470): Launched 14:11:09.925574 run osmo-stp_10.42.42.5(pid=31467): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31467)] 14:11:10.054836 run osmo-stp_10.42.42.5(pid=31467): stdout: | (launched: 2022-12-14_14:11:08.744753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:10.183890 run osmo-stp_10.42.42.5(pid=31467): stderr: | 20221214141108919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141108919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141108919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141108919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141108920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141108920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141108920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:10.310922 run osmo-stp_10.42.42.5(pid=31467): stdout: | (launched: 2022-12-14_14:11:08.744753) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:10.432275 run osmo-stp_10.42.42.5(pid=31467): stderr: | 20221214141108919 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141108919 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141108919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141108919 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141108920 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141108920 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141108920 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:10.578307 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31467): Process ended prematurely: osmo-stp_10.42.42.5(pid=31467) [trial-2405↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31467)] [trial-2405↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 14:11:10.586373 tst handover.py:18: Test FAILED (6.4 sec) 14:11:10.612032 run osmo-hlr_10.42.42.2(pid=31464): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31464)] 14:11:10.659076 run osmo-hlr_10.42.42.2(pid=31464): stdout: | (launched: 2022-12-14_14:11:07.821063) 14:11:10.708171 run osmo-hlr_10.42.42.2(pid=31464): stderr: | 20221214141107998 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141107998 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141107998 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141107998 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141107998 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141107998 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141108016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141108026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141108026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141108026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:10.776280 run osmo-msc_10.42.42.6(pid=31470): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31470)] 14:11:10.823295 run osmo-msc_10.42.42.6(pid=31470): stdout: | (launched: 2022-12-14_14:11:09.697912) 14:11:10.871945 run osmo-msc_10.42.42.6(pid=31470): stderr: | 20221214141109970 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141109970 DLGLOBAL DEBUG validating counter group 0x7fb885f0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141109970 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141109970 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141109971 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141109971 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141109972 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141109973 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141109973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141109973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:11:10.920912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31463): Terminating (SIGTERM) 14:11:10.960026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31466): Terminating (SIGTERM) 14:11:10.999651 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31469): Terminating (SIGTERM) 14:11:11.039071 --- ParallelTerminationStrategy: PID 31463 died... 14:11:11.057982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31463): Terminated: ok {rc=0} 14:11:11.101443 --- ParallelTerminationStrategy: PID 31466 died... 14:11:11.119909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31466): Terminated: ok {rc=0} 14:11:11.163225 --- ParallelTerminationStrategy: PID 31469 died... 14:11:11.181705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31469): Terminated: ok {rc=0} 14:11:11.264609 bus /sierra_3: Setting Powered False 14:11:12.361583 bus /sierra_3: Setting Powered False 14:11:13.477284 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:11:14.731745 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:11:14.736698 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:11:14.785453 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:11:14.811493 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:11:14.863452 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:11:14.912725 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:11:14.939532 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:11:15.489606 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:11:15.495079 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:11:15.506335 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:11:15.544532 tst handover.py: using LAC 41435 14:11:15.664606 tst handover.py: using RAC 125 14:11:15.793404 tst handover.py: using CellId 41435 14:11:15.957321 tst handover.py: using BVCI 41436 14:11:16.077181 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:11:16.121914 tst handover.py: using LAC 41436 14:11:16.246029 tst handover.py: using RAC 126 14:11:16.414570 tst handover.py: using CellId 41436 14:11:16.546672 tst handover.py: using BVCI 41437 14:11:16.707219 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:11:16.723296 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:11:16.739274 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:11:16.755623 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:11:16.771767 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:11:16.787790 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:11:16.943915 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:11:17.071633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:17.559340 run create_hlr_db(pid=31475): Launched 14:11:17.685252 bus /sierra_2: Setting Powered False 14:11:18.750145 run create_hlr_db(pid=31475): Terminated: ok {rc=0} 14:11:19.176917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31477): Launched 14:11:19.505665 run osmo-hlr_10.42.42.2(pid=31478): Launched 14:11:19.631465 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:20.169709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31480): Launched 14:11:20.499611 run osmo-stp_10.42.42.5(pid=31481): Launched 14:11:20.626412 run osmo-msc_10.42.42.6: Starting osmo-msc 14:11:21.196385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31483): Launched 14:11:21.525335 run osmo-msc_10.42.42.6(pid=31484): Launched 14:11:21.709534 run osmo-stp_10.42.42.5(pid=31481): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31481)] 14:11:21.847958 run osmo-stp_10.42.42.5(pid=31481): stdout: | (launched: 2022-12-14_14:11:20.438941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:22.022791 run osmo-stp_10.42.42.5(pid=31481): stderr: | 20221214141120632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141120633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141120633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141120633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141120634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141120634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141120634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:22.160418 run osmo-stp_10.42.42.5(pid=31481): stdout: | (launched: 2022-12-14_14:11:20.438941) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:22.291563 run osmo-stp_10.42.42.5(pid=31481): stderr: | 20221214141120632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141120633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141120633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141120633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141120634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141120634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141120634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:22.448805 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31481): Process ended prematurely: osmo-stp_10.42.42.5(pid=31481) [trial-2405↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31481)] [trial-2405↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 14:11:22.457643 tst handover.py:18: Test FAILED (7.0 sec) 14:11:22.484711 run osmo-hlr_10.42.42.2(pid=31478): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31478)] 14:11:22.535457 run osmo-hlr_10.42.42.2(pid=31478): stdout: | (launched: 2022-12-14_14:11:19.445407) 14:11:22.587096 run osmo-hlr_10.42.42.2(pid=31478): stderr: | 20221214141119646 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141119646 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141119646 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141119646 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141119646 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141119646 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141119663 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141119672 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141119672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141119673 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:22.659119 run osmo-msc_10.42.42.6(pid=31484): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31484)] 14:11:22.708578 run osmo-msc_10.42.42.6(pid=31484): stdout: | (launched: 2022-12-14_14:11:21.465354) 14:11:22.760173 run osmo-msc_10.42.42.6(pid=31484): stderr: | 20221214141121787 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141121787 DLGLOBAL DEBUG validating counter group 0x7fe5e2948c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141121787 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141121788 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141121788 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141121788 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141121790 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141121790 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141121790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141121790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:11:22.812000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31477): Terminating (SIGTERM) 14:11:22.853870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31480): Terminating (SIGTERM) 14:11:22.895925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31483): Terminating (SIGTERM) 14:11:22.938042 --- ParallelTerminationStrategy: PID 31477 died... 14:11:22.958222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31477): Terminated: ok {rc=0} 14:11:23.004505 --- ParallelTerminationStrategy: PID 31480 died... 14:11:23.024326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31480): Terminated: ok {rc=0} 14:11:23.070670 --- ParallelTerminationStrategy: PID 31483 died... 14:11:23.090517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31483): Terminated: ok {rc=0} 14:11:23.178308 bus /sierra_3: Setting Powered False 14:11:24.276505 bus /sierra_3: Setting Powered False 14:11:25.391857 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:11:26.649398 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:11:26.655171 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:11:26.711078 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:11:26.738074 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:11:26.790094 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:11:26.843881 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:11:26.869910 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:11:27.423427 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:11:27.428899 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:11:27.440086 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:11:27.478412 tst handover.py: using LAC 41437 14:11:27.598500 tst handover.py: using RAC 127 14:11:27.717260 tst handover.py: using CellId 41437 14:11:27.836667 tst handover.py: using BVCI 41438 14:11:27.947654 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:11:27.995945 tst handover.py: using LAC 41438 14:11:28.134512 tst handover.py: using RAC 128 14:11:28.272248 tst handover.py: using CellId 41438 14:11:28.401940 tst handover.py: using BVCI 41439 14:11:28.522317 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:11:28.533934 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:11:28.545131 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:11:28.556526 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:11:28.568266 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:11:28.580075 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:11:28.696694 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:11:28.816807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:29.295425 run create_hlr_db(pid=31489): Launched 14:11:29.420778 bus /sierra_2: Setting Powered False 14:11:30.482022 run create_hlr_db(pid=31489): Terminated: ok {rc=0} 14:11:30.923773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31491): Launched 14:11:31.267999 run osmo-hlr_10.42.42.2(pid=31492): Launched 14:11:31.538689 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:32.112435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31494): Launched 14:11:32.436146 run osmo-stp_10.42.42.5(pid=31495): Launched 14:11:32.553526 run osmo-msc_10.42.42.6: Starting osmo-msc 14:11:33.080031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31497): Launched 14:11:33.387629 run osmo-msc_10.42.42.6(pid=31498): Launched 14:11:33.558373 run osmo-stp_10.42.42.5(pid=31495): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31495)] 14:11:33.687194 run osmo-stp_10.42.42.5(pid=31495): stdout: | (launched: 2022-12-14_14:11:32.379225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:33.815283 run osmo-stp_10.42.42.5(pid=31495): stderr: | 20221214141132552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141132552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141132553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141132553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141132554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141132554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141132554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:33.942179 run osmo-stp_10.42.42.5(pid=31495): stdout: | (launched: 2022-12-14_14:11:32.379225) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:34.063865 run osmo-stp_10.42.42.5(pid=31495): stderr: | 20221214141132552 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141132552 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141132553 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141132553 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141132554 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141132554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141132554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:34.209273 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31495): Process ended prematurely: osmo-stp_10.42.42.5(pid=31495) [trial-2405↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31495)] [trial-2405↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 14:11:34.217692 tst handover.py:18: Test FAILED (6.8 sec) 14:11:34.243636 run osmo-hlr_10.42.42.2(pid=31492): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31492)] 14:11:34.291601 run osmo-hlr_10.42.42.2(pid=31492): stdout: | (launched: 2022-12-14_14:11:31.199242) 14:11:34.340676 run osmo-hlr_10.42.42.2(pid=31492): stderr: | 20221214141131423 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141131423 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141131423 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141131423 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141131423 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141131423 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141131436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141131444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141131444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141131444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:34.409022 run osmo-msc_10.42.42.6(pid=31498): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31498)] 14:11:34.456372 run osmo-msc_10.42.42.6(pid=31498): stdout: | (launched: 2022-12-14_14:11:33.330835) 14:11:34.505467 run osmo-msc_10.42.42.6(pid=31498): stderr: | 20221214141133601 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141133601 DLGLOBAL DEBUG validating counter group 0x7fd85a94dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141133601 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141133601 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141133602 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141133602 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141133603 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141133604 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141133604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141133604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:11:34.554701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31491): Terminating (SIGTERM) 14:11:34.594368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31494): Terminating (SIGTERM) 14:11:34.633862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31497): Terminating (SIGTERM) 14:11:34.673522 --- ParallelTerminationStrategy: PID 31491 died... 14:11:34.692407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31491): Terminated: ok {rc=0} 14:11:34.736204 --- ParallelTerminationStrategy: PID 31494 died... 14:11:34.754665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31494): Terminated: ok {rc=0} 14:11:34.798478 --- ParallelTerminationStrategy: PID 31497 died... 14:11:34.817058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31497): Terminated: ok {rc=0} 14:11:34.903004 bus /sierra_3: Setting Powered False 14:11:36.002244 bus /sierra_3: Setting Powered False 14:11:37.115588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 14:11:38.378845 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:11:38.383745 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:11:38.424327 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:11:38.450687 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:11:38.502023 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:11:38.545469 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:11:38.572771 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:11:39.124305 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 14:11:39.130096 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:11:39.141430 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 14:11:39.183953 tst handover.py: using LAC 41439 14:11:39.313071 tst handover.py: using RAC 129 14:11:39.440481 tst handover.py: using CellId 41439 14:11:39.567384 tst handover.py: using BVCI 41440 14:11:39.686140 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 14:11:39.720542 tst handover.py: using LAC 41440 14:11:39.847240 tst handover.py: using RAC 130 14:11:39.975237 tst handover.py: using CellId 41440 14:11:40.101740 tst handover.py: using BVCI 41441 14:11:40.222431 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:11:40.233840 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:11:40.244858 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:11:40.256096 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:11:40.267638 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:11:40.279262 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 14:11:40.395512 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 14:11:40.516061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:40.996175 run create_hlr_db(pid=31503): Launched 14:11:41.120682 bus /sierra_2: Setting Powered False 14:11:42.185518 run create_hlr_db(pid=31503): Terminated: ok {rc=0} 14:11:42.612195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31505): Launched 14:11:42.939803 run osmo-hlr_10.42.42.2(pid=31506): Launched 14:11:43.065526 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:43.602933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31508): Launched 14:11:43.930727 run osmo-stp_10.42.42.5(pid=31509): Launched 14:11:44.056595 run osmo-msc_10.42.42.6: Starting osmo-msc 14:11:44.620432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31511): Launched 14:11:44.948552 run osmo-msc_10.42.42.6(pid=31512): Launched 14:11:45.131436 run osmo-stp_10.42.42.5(pid=31509): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31509)] 14:11:45.269508 run osmo-stp_10.42.42.5(pid=31509): stdout: | (launched: 2022-12-14_14:11:43.870776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:45.408321 run osmo-stp_10.42.42.5(pid=31509): stderr: | 20221214141144062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141144062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141144063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141144063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141144063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141144063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141144064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:45.545975 run osmo-stp_10.42.42.5(pid=31509): stdout: | (launched: 2022-12-14_14:11:43.870776) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:45.676918 run osmo-stp_10.42.42.5(pid=31509): stderr: | 20221214141144062 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141144062 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141144063 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141144063 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141144063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141144063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141144064 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:45.835115 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31509): Process ended prematurely: osmo-stp_10.42.42.5(pid=31509) [trial-2405↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31509)] [trial-2405↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 14:11:45.849311 tst handover.py:18: Test FAILED (6.7 sec) 14:11:45.879182 run osmo-hlr_10.42.42.2(pid=31506): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31506)] 14:11:45.940295 run osmo-hlr_10.42.42.2(pid=31506): stdout: | (launched: 2022-12-14_14:11:42.879902) 14:11:45.990900 run osmo-hlr_10.42.42.2(pid=31506): stderr: | 20221214141143079 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141143079 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141143079 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141143079 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141143079 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141143079 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141143092 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141143100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141143100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141143100 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:46.063195 run osmo-msc_10.42.42.6(pid=31512): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31512)] 14:11:46.113703 run osmo-msc_10.42.42.6(pid=31512): stdout: | (launched: 2022-12-14_14:11:44.888025) 14:11:46.166132 run osmo-msc_10.42.42.6(pid=31512): stderr: | 20221214141145211 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141145211 DLGLOBAL DEBUG validating counter group 0x7fb43860cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141145211 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141145211 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141145211 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141145211 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141145213 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141145213 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141145214 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141145214 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:11:46.217613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31505): Terminating (SIGTERM) 14:11:46.259300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31508): Terminating (SIGTERM) 14:11:46.304102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31511): Terminating (SIGTERM) 14:11:46.350102 --- ParallelTerminationStrategy: PID 31505 died... 14:11:46.370271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31505): Terminated: ok {rc=0} 14:11:46.417873 --- ParallelTerminationStrategy: PID 31508 died... 14:11:46.437436 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31508): Terminated: ok {rc=0} 14:11:46.483841 --- ParallelTerminationStrategy: PID 31511 died... 14:11:46.504598 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31511): Terminated: ok {rc=0} 14:11:46.592354 bus /sierra_3: Setting Powered False 14:11:47.690137 bus /sierra_3: Setting Powered False 14:11:48.806226 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 14:11:50.055697 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:11:50.061950 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:11:50.115714 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:11:50.141935 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:11:50.191252 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:11:50.244089 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:11:50.270410 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:11:50.823351 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 14:11:50.829057 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:11:50.839943 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:11:50.880403 tst handover.py: using LAC 41441 14:11:50.999343 tst handover.py: using RAC 131 14:11:51.126779 tst handover.py: using CellId 41441 14:11:51.253595 tst handover.py: using BVCI 41442 14:11:51.375483 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:11:51.425392 tst handover.py: using LAC 41442 14:11:51.553135 tst handover.py: using RAC 132 14:11:51.680084 tst handover.py: using CellId 41442 14:11:51.806812 tst handover.py: using BVCI 41443 14:11:51.927599 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:11:51.939071 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:11:51.950644 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:11:51.961928 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:11:51.973571 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:11:51.985114 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:11:52.100933 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:11:52.221522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:11:52.704129 run create_hlr_db(pid=31517): Launched 14:11:52.829735 bus /sierra_2: Setting Powered False 14:11:53.894176 run create_hlr_db(pid=31517): Terminated: ok {rc=0} 14:11:54.307685 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31519): Launched 14:11:54.617077 run osmo-hlr_10.42.42.2(pid=31520): Launched 14:11:54.734873 run osmo-stp_10.42.42.5: Starting osmo-stp 14:11:55.241670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31522): Launched 14:11:55.549124 run osmo-stp_10.42.42.5(pid=31523): Launched 14:11:55.666411 run osmo-msc_10.42.42.6: Starting osmo-msc 14:11:56.195320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31525): Launched 14:11:56.502357 run osmo-msc_10.42.42.6(pid=31526): Launched 14:11:56.676325 run osmo-stp_10.42.42.5(pid=31523): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31523)] 14:11:56.813437 run osmo-stp_10.42.42.5(pid=31523): stdout: | (launched: 2022-12-14_14:11:55.492280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:56.954151 run osmo-stp_10.42.42.5(pid=31523): stderr: | 20221214141155664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141155664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141155664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141155664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141155665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141155665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141155665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:57.091827 run osmo-stp_10.42.42.5(pid=31523): stdout: | (launched: 2022-12-14_14:11:55.492280) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:11:57.223110 run osmo-stp_10.42.42.5(pid=31523): stderr: | 20221214141155664 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141155664 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141155664 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141155664 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141155665 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141155665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141155665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:11:57.380802 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31523): Process ended prematurely: osmo-stp_10.42.42.5(pid=31523) [trial-2405↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31523)] [trial-2405↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 14:11:57.389954 tst handover.py:18: Test FAILED (6.6 sec) 14:11:57.417282 run osmo-hlr_10.42.42.2(pid=31520): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31520)] 14:11:57.468035 run osmo-hlr_10.42.42.2(pid=31520): stdout: | (launched: 2022-12-14_14:11:54.560055) 14:11:57.520540 run osmo-hlr_10.42.42.2(pid=31520): stderr: | 20221214141154740 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141154740 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141154740 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141154741 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141154741 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141154741 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141154753 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141154761 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141154762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141154762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:11:57.592905 run osmo-msc_10.42.42.6(pid=31526): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31526)] 14:11:57.642310 run osmo-msc_10.42.42.6(pid=31526): stdout: | (launched: 2022-12-14_14:11:56.445539) 14:11:57.693926 run osmo-msc_10.42.42.6(pid=31526): stderr: | 20221214141156717 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141156717 DLGLOBAL DEBUG validating counter group 0x7fc01ff6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141156717 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141156717 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141156717 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141156718 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141156719 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141156721 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141156721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141156721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:11:57.745980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31519): Terminating (SIGTERM) 14:11:57.788217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31522): Terminating (SIGTERM) 14:11:57.830623 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31525): Terminating (SIGTERM) 14:11:57.873309 --- ParallelTerminationStrategy: PID 31519 died... 14:11:57.893903 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31519): Terminated: ok {rc=0} 14:11:57.941242 --- ParallelTerminationStrategy: PID 31522 died... 14:11:57.961369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31522): Terminated: ok {rc=0} 14:11:58.008128 --- ParallelTerminationStrategy: PID 31525 died... 14:11:58.028357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31525): Terminated: ok {rc=0} 14:11:58.116751 bus /sierra_3: Setting Powered False 14:11:59.216640 bus /sierra_3: Setting Powered False 14:12:00.331989 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 14:12:01.596446 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:12:01.602319 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:12:01.671162 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:12:01.705814 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:12:01.772569 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:12:01.846371 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:12:01.881927 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:12:02.405943 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 14:12:02.411641 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:12:02.423034 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:12:02.461678 tst handover.py: using LAC 41443 14:12:02.590325 tst handover.py: using RAC 133 14:12:02.717626 tst handover.py: using CellId 41443 14:12:02.846417 tst handover.py: using BVCI 41444 14:12:02.965636 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:12:03.012745 tst handover.py: using LAC 41444 14:12:03.139746 tst handover.py: using RAC 134 14:12:03.266194 tst handover.py: using CellId 41444 14:12:03.393951 tst handover.py: using BVCI 41445 14:12:03.515832 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:12:03.527368 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:12:03.538679 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:12:03.549944 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:12:03.562091 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:12:03.574239 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:12:03.693636 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:12:03.809575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:04.258166 run create_hlr_db(pid=31531): Launched 14:12:04.384440 bus /sierra_2: Setting Powered False 14:12:05.446809 run create_hlr_db(pid=31531): Terminated: ok {rc=0} 14:12:05.866531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31533): Launched 14:12:06.194796 run osmo-hlr_10.42.42.2(pid=31534): Launched 14:12:06.321259 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:06.857235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31536): Launched 14:12:07.185855 run osmo-stp_10.42.42.5(pid=31537): Launched 14:12:07.311322 run osmo-msc_10.42.42.6: Starting osmo-msc 14:12:07.875427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31539): Launched 14:12:08.205571 run osmo-msc_10.42.42.6(pid=31540): Launched 14:12:08.390571 run osmo-stp_10.42.42.5(pid=31537): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31537)] 14:12:08.529667 run osmo-stp_10.42.42.5(pid=31537): stdout: | (launched: 2022-12-14_14:12:07.125621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:08.668739 run osmo-stp_10.42.42.5(pid=31537): stderr: | 20221214141207319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141207319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141207319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141207319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141207320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141207320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141207320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:08.801083 run osmo-stp_10.42.42.5(pid=31537): stdout: | (launched: 2022-12-14_14:12:07.125621) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:08.924072 run osmo-stp_10.42.42.5(pid=31537): stderr: | 20221214141207319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141207319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141207319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141207319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141207320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141207320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141207320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:09.070834 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31537): Process ended prematurely: osmo-stp_10.42.42.5(pid=31537) [trial-2405↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31537)] [trial-2405↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 14:12:09.079254 tst handover.py:18: Test FAILED (6.7 sec) 14:12:09.105585 run osmo-hlr_10.42.42.2(pid=31534): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31534)] 14:12:09.154011 run osmo-hlr_10.42.42.2(pid=31534): stdout: | (launched: 2022-12-14_14:12:06.134974) 14:12:09.204159 run osmo-hlr_10.42.42.2(pid=31534): stderr: | 20221214141206334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141206335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141206335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141206335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141206335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141206335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141206349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141206357 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141206357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141206357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:09.273805 run osmo-msc_10.42.42.6(pid=31540): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31540)] 14:12:09.321904 run osmo-msc_10.42.42.6(pid=31540): stdout: | (launched: 2022-12-14_14:12:08.145238) 14:12:09.371668 run osmo-msc_10.42.42.6(pid=31540): stderr: | 20221214141208466 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141208467 DLGLOBAL DEBUG validating counter group 0x7f009a5fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141208467 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141208467 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141208467 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141208467 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141208469 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141208469 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141208469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141208469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:12:09.422097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31533): Terminating (SIGTERM) 14:12:09.462717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31536): Terminating (SIGTERM) 14:12:09.503567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31539): Terminating (SIGTERM) 14:12:09.544267 --- ParallelTerminationStrategy: PID 31533 died... 14:12:09.563874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31533): Terminated: ok {rc=0} 14:12:09.608456 --- ParallelTerminationStrategy: PID 31536 died... 14:12:09.627319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31536): Terminated: ok {rc=0} 14:12:09.672061 --- ParallelTerminationStrategy: PID 31539 died... 14:12:09.691290 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31539): Terminated: ok {rc=0} 14:12:09.776252 bus /sierra_3: Setting Powered False 14:12:10.875308 bus /sierra_3: Setting Powered False 14:12:11.994809 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 14:12:13.253556 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:12:13.259009 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 14:12:13.295702 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 14:12:13.322118 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 14:12:13.372818 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 14:12:13.409372 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 14:12:13.435848 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 14:12:13.985810 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 14:12:13.991191 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:12:14.002271 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 14:12:14.036089 tst handover.py: using LAC 41445 14:12:14.166329 tst handover.py: using RAC 135 14:12:14.294026 tst handover.py: using CellId 41445 14:12:14.423311 tst handover.py: using BVCI 41446 14:12:14.541787 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 14:12:14.577697 tst handover.py: using LAC 41446 14:12:14.706948 tst handover.py: using RAC 136 14:12:14.836202 tst handover.py: using CellId 41446 14:12:14.963629 tst handover.py: using BVCI 41447 14:12:15.082315 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:12:15.093546 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:12:15.104595 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:12:15.115578 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:12:15.126968 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 14:12:15.138425 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 14:12:15.255493 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 14:12:15.373513 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:15.829022 run create_hlr_db(pid=31545): Launched 14:12:15.997982 bus /sierra_2: Setting Powered False 14:12:17.060899 run create_hlr_db(pid=31545): Terminated: ok {rc=0} 14:12:17.487691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31547): Launched 14:12:17.817837 run osmo-hlr_10.42.42.2(pid=31548): Launched 14:12:17.944650 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:18.451485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31550): Launched 14:12:18.759977 run osmo-stp_10.42.42.5(pid=31551): Launched 14:12:18.877372 run osmo-msc_10.42.42.6: Starting osmo-msc 14:12:19.406748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31553): Launched 14:12:19.714557 run osmo-msc_10.42.42.6(pid=31554): Launched 14:12:19.886468 run osmo-stp_10.42.42.5(pid=31551): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31551)] 14:12:20.016074 run osmo-stp_10.42.42.5(pid=31551): stdout: | (launched: 2022-12-14_14:12:18.703086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:20.145843 run osmo-stp_10.42.42.5(pid=31551): stderr: | 20221214141218874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141218874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141218874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141218875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141218877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141218877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141218877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:20.273612 run osmo-stp_10.42.42.5(pid=31551): stdout: | (launched: 2022-12-14_14:12:18.703086) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:20.396005 run osmo-stp_10.42.42.5(pid=31551): stderr: | 20221214141218874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141218874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141218874 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141218875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141218877 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141218877 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141218877 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:20.542358 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31551): Process ended prematurely: osmo-stp_10.42.42.5(pid=31551) [trial-2405↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31551)] [trial-2405↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 14:12:20.550737 tst handover.py:18: Test FAILED (6.6 sec) 14:12:20.576436 run osmo-hlr_10.42.42.2(pid=31548): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31548)] 14:12:20.624382 run osmo-hlr_10.42.42.2(pid=31548): stdout: | (launched: 2022-12-14_14:12:17.757790) 14:12:20.673449 run osmo-hlr_10.42.42.2(pid=31548): stderr: | 20221214141217959 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141217959 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141217959 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141217959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141217959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141217959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141217972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141217980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141217980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141217980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:20.741628 run osmo-msc_10.42.42.6(pid=31554): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31554)] 14:12:20.788758 run osmo-msc_10.42.42.6(pid=31554): stdout: | (launched: 2022-12-14_14:12:19.657906) 14:12:20.837601 run osmo-msc_10.42.42.6(pid=31554): stderr: | 20221214141219930 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141219930 DLGLOBAL DEBUG validating counter group 0x7fc058395c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141219930 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141219930 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141219931 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141219931 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141219932 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141219933 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141219933 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141219933 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:12:20.886690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31547): Terminating (SIGTERM) 14:12:20.925829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31550): Terminating (SIGTERM) 14:12:20.965310 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31553): Terminating (SIGTERM) 14:12:21.005669 --- ParallelTerminationStrategy: PID 31547 died... 14:12:21.024746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31547): Terminated: ok {rc=0} 14:12:21.068697 --- ParallelTerminationStrategy: PID 31550 died... 14:12:21.087496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31550): Terminated: ok {rc=0} 14:12:21.131288 --- ParallelTerminationStrategy: PID 31553 died... 14:12:21.149936 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31553): Terminated: ok {rc=0} 14:12:21.235447 bus /sierra_3: Setting Powered False 14:12:22.334678 bus /sierra_3: Setting Powered False 14:12:23.448701 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 14:12:24.684710 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:12:24.689765 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:12:24.739549 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:12:24.766283 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:12:24.816902 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:12:24.866260 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:12:24.892413 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:12:25.443181 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 14:12:25.448290 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:12:25.459295 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:12:25.497748 tst handover.py: using LAC 41447 14:12:25.625305 tst handover.py: using RAC 137 14:12:25.752013 tst handover.py: using CellId 41447 14:12:25.878284 tst handover.py: using BVCI 41448 14:12:25.997258 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:12:26.045812 tst handover.py: using LAC 41448 14:12:26.166260 tst handover.py: using RAC 138 14:12:26.289888 tst handover.py: using CellId 41448 14:12:26.419692 tst handover.py: using BVCI 41449 14:12:26.540658 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:12:26.551984 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:12:26.562927 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:12:26.573901 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:12:26.585788 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:12:26.597803 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:12:26.715795 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:12:26.837390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:27.288273 run create_hlr_db(pid=31559): Launched 14:12:27.415104 bus /sierra_2: Setting Powered False 14:12:28.476291 run create_hlr_db(pid=31559): Terminated: ok {rc=0} 14:12:28.896518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31561): Launched 14:12:29.226509 run osmo-hlr_10.42.42.2(pid=31562): Launched 14:12:29.353254 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:29.891036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31564): Launched 14:12:30.220049 run osmo-stp_10.42.42.5(pid=31565): Launched 14:12:30.346419 run osmo-msc_10.42.42.6: Starting osmo-msc 14:12:30.955939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31567): Launched 14:12:31.293019 run osmo-msc_10.42.42.6(pid=31568): Launched 14:12:31.708761 run osmo-stp_10.42.42.5(pid=31565): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31565)] 14:12:31.988188 run osmo-stp_10.42.42.5(pid=31565): stdout: | (launched: 2022-12-14_14:12:30.159894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:32.142748 run osmo-stp_10.42.42.5(pid=31565): stderr: | 20221214141230356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141230356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141230356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141230357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141230357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141230357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141230357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:32.275435 run osmo-stp_10.42.42.5(pid=31565): stdout: | (launched: 2022-12-14_14:12:30.159894) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:32.398160 run osmo-stp_10.42.42.5(pid=31565): stderr: | 20221214141230356 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141230356 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141230356 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141230357 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141230357 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141230357 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141230357 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:32.546039 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31565): Process ended prematurely: osmo-stp_10.42.42.5(pid=31565) [trial-2405↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31565)] [trial-2405↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 14:12:32.554331 tst handover.py:18: Test FAILED (7.1 sec) 14:12:32.580557 run osmo-hlr_10.42.42.2(pid=31562): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31562)] 14:12:32.628487 run osmo-hlr_10.42.42.2(pid=31562): stdout: | (launched: 2022-12-14_14:12:29.166755) 14:12:32.678002 run osmo-hlr_10.42.42.2(pid=31562): stderr: | 20221214141229366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141229366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141229366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141229366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141229366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141229367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141229379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141229389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141229389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141229389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:32.746862 run osmo-msc_10.42.42.6(pid=31568): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31568)] 14:12:32.794337 run osmo-msc_10.42.42.6(pid=31568): stdout: | (launched: 2022-12-14_14:12:31.231450) 14:12:32.843317 run osmo-msc_10.42.42.6(pid=31568): stderr: | 20221214141231640 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141231640 DLGLOBAL DEBUG validating counter group 0x7f01cb8bec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141231640 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141231640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141231640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141231641 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141231642 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141231643 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141231643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141231643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:12:32.892737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31561): Terminating (SIGTERM) 14:12:32.932405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31564): Terminating (SIGTERM) 14:12:32.972034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31567): Terminating (SIGTERM) 14:12:33.011971 --- ParallelTerminationStrategy: PID 31561 died... 14:12:33.031255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31561): Terminated: ok {rc=0} 14:12:33.075607 --- ParallelTerminationStrategy: PID 31564 died... 14:12:33.094340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31564): Terminated: ok {rc=0} 14:12:33.138466 --- ParallelTerminationStrategy: PID 31567 died... 14:12:33.157183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31567): Terminated: ok {rc=0} 14:12:33.242739 bus /sierra_3: Setting Powered False 14:12:34.342448 bus /sierra_3: Setting Powered False 14:12:35.454626 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:12:36.705373 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:12:36.710538 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:12:36.756421 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:12:36.782897 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:12:36.833754 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:12:36.879751 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:12:36.906287 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:12:37.457581 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:12:37.462899 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:12:37.474031 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:12:37.508033 tst handover.py: using LAC 41449 14:12:37.629758 tst handover.py: using RAC 139 14:12:37.752808 tst handover.py: using CellId 41449 14:12:37.882553 tst handover.py: using BVCI 41450 14:12:38.002958 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:12:38.048268 tst handover.py: using LAC 41450 14:12:38.178250 tst handover.py: using RAC 140 14:12:38.306440 tst handover.py: using CellId 41450 14:12:38.436024 tst handover.py: using BVCI 41451 14:12:38.554671 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:12:38.566160 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:12:38.577326 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:12:38.588472 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:12:38.600112 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:12:38.611595 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:12:38.729783 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:12:38.847368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:39.299880 run create_hlr_db(pid=31573): Launched 14:12:39.426350 bus /sierra_2: Setting Powered False 14:12:40.488036 run create_hlr_db(pid=31573): Terminated: ok {rc=0} 14:12:40.909513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31575): Launched 14:12:41.239172 run osmo-hlr_10.42.42.2(pid=31576): Launched 14:12:41.366640 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:41.907624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31578): Launched 14:12:42.215573 run osmo-stp_10.42.42.5(pid=31579): Launched 14:12:42.333068 run osmo-msc_10.42.42.6: Starting osmo-msc 14:12:42.861496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31581): Launched 14:12:43.169635 run osmo-msc_10.42.42.6(pid=31582): Launched 14:12:43.342039 run osmo-stp_10.42.42.5(pid=31579): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31579)] 14:12:43.472228 run osmo-stp_10.42.42.5(pid=31579): stdout: | (launched: 2022-12-14_14:12:42.158763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:43.602264 run osmo-stp_10.42.42.5(pid=31579): stderr: | 20221214141242332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141242332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141242332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141242333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141242333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141242333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141242333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:43.730287 run osmo-stp_10.42.42.5(pid=31579): stdout: | (launched: 2022-12-14_14:12:42.158763) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:43.853196 run osmo-stp_10.42.42.5(pid=31579): stderr: | 20221214141242332 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141242332 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141242332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141242333 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141242333 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141242333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141242333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:43.999119 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31579): Process ended prematurely: osmo-stp_10.42.42.5(pid=31579) [trial-2405↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31579)] [trial-2405↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 14:12:44.007437 tst handover.py:18: Test FAILED (6.5 sec) 14:12:44.033452 run osmo-hlr_10.42.42.2(pid=31576): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31576)] 14:12:44.082286 run osmo-hlr_10.42.42.2(pid=31576): stdout: | (launched: 2022-12-14_14:12:41.178847) 14:12:44.131905 run osmo-hlr_10.42.42.2(pid=31576): stderr: | 20221214141241379 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141241379 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141241379 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141241379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141241379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141241379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141241392 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141241401 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141241401 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141241401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:44.201125 run osmo-msc_10.42.42.6(pid=31582): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31582)] 14:12:44.248675 run osmo-msc_10.42.42.6(pid=31582): stdout: | (launched: 2022-12-14_14:12:43.112646) 14:12:44.298114 run osmo-msc_10.42.42.6(pid=31582): stderr: | 20221214141243383 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141243383 DLGLOBAL DEBUG validating counter group 0x7fee357fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141243383 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141243383 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141243383 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141243384 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141243385 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141243386 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141243386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141243386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:12:44.348288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31575): Terminating (SIGTERM) 14:12:44.388011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31578): Terminating (SIGTERM) 14:12:44.427590 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31581): Terminating (SIGTERM) 14:12:44.467302 --- ParallelTerminationStrategy: PID 31575 died... 14:12:44.486335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31575): Terminated: ok {rc=0} 14:12:44.530071 --- ParallelTerminationStrategy: PID 31578 died... 14:12:44.548577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31578): Terminated: ok {rc=0} 14:12:44.592270 --- ParallelTerminationStrategy: PID 31581 died... 14:12:44.611022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31581): Terminated: ok {rc=0} 14:12:44.695677 bus /sierra_3: Setting Powered False 14:12:45.794057 bus /sierra_3: Setting Powered False 14:12:46.907718 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:12:48.170707 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:12:48.176377 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:12:48.229640 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:12:48.256831 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:12:48.311094 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:12:48.362308 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:12:48.388618 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:12:48.942816 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:12:48.949337 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:12:48.961556 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:12:49.001870 tst handover.py: using LAC 41451 14:12:49.123583 tst handover.py: using RAC 141 14:12:49.244048 tst handover.py: using CellId 41451 14:12:49.362261 tst handover.py: using BVCI 41452 14:12:49.475116 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:12:49.522317 tst handover.py: using LAC 41452 14:12:49.641037 tst handover.py: using RAC 142 14:12:49.759864 tst handover.py: using CellId 41452 14:12:49.879346 tst handover.py: using BVCI 41453 14:12:49.990560 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:12:50.001475 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:12:50.012182 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:12:50.022851 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:12:50.033795 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:12:50.044476 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:12:50.163758 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:12:50.280898 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:12:50.731907 run create_hlr_db(pid=31588): Launched 14:12:50.857833 bus /sierra_2: Setting Powered False 14:12:51.918932 run create_hlr_db(pid=31588): Terminated: ok {rc=0} 14:12:52.338346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31590): Launched 14:12:52.669237 run osmo-hlr_10.42.42.2(pid=31591): Launched 14:12:52.795168 run osmo-stp_10.42.42.5: Starting osmo-stp 14:12:53.332196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31593): Launched 14:12:53.662457 run osmo-stp_10.42.42.5(pid=31594): Launched 14:12:53.787773 run osmo-msc_10.42.42.6: Starting osmo-msc 14:12:54.353605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31596): Launched 14:12:54.683393 run osmo-msc_10.42.42.6(pid=31597): Launched 14:12:54.867069 run osmo-stp_10.42.42.5(pid=31594): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31594)] 14:12:55.005696 run osmo-stp_10.42.42.5(pid=31594): stdout: | (launched: 2022-12-14_14:12:53.602189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:55.144422 run osmo-stp_10.42.42.5(pid=31594): stderr: | 20221214141253797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141253797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141253797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141253798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141253800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141253800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141253800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:55.281634 run osmo-stp_10.42.42.5(pid=31594): stdout: | (launched: 2022-12-14_14:12:53.602189) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:12:55.413527 run osmo-stp_10.42.42.5(pid=31594): stderr: | 20221214141253797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141253797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141253797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141253798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141253800 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141253800 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141253800 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:12:55.570666 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31594): Process ended prematurely: osmo-stp_10.42.42.5(pid=31594) [trial-2405↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31594)] [trial-2405↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 14:12:55.579520 tst handover.py:18: Test FAILED (6.6 sec) 14:12:55.606712 run osmo-hlr_10.42.42.2(pid=31591): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31591)] 14:12:55.657650 run osmo-hlr_10.42.42.2(pid=31591): stdout: | (launched: 2022-12-14_14:12:52.608766) 14:12:55.709633 run osmo-hlr_10.42.42.2(pid=31591): stderr: | 20221214141252811 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141252811 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141252811 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141252812 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141252812 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141252812 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141252848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141252857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141252858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141252858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:12:55.781723 run osmo-msc_10.42.42.6(pid=31597): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31597)] 14:12:55.831775 run osmo-msc_10.42.42.6(pid=31597): stdout: | (launched: 2022-12-14_14:12:54.623240) 14:12:55.883596 run osmo-msc_10.42.42.6(pid=31597): stderr: | 20221214141254946 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141254946 DLGLOBAL DEBUG validating counter group 0x7f0c6197dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141254946 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141254946 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141254947 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141254947 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141254948 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141254949 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141254949 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141254949 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:12:55.935675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31590): Terminating (SIGTERM) 14:12:55.977202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31593): Terminating (SIGTERM) 14:12:56.018833 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31596): Terminating (SIGTERM) 14:12:56.061366 --- ParallelTerminationStrategy: PID 31590 died... 14:12:56.081794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31590): Terminated: ok {rc=0} 14:12:56.128358 --- ParallelTerminationStrategy: PID 31593 died... 14:12:56.148270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31593): Terminated: ok {rc=0} 14:12:56.194523 --- ParallelTerminationStrategy: PID 31596 died... 14:12:56.214451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31596): Terminated: ok {rc=0} 14:12:56.301897 bus /sierra_3: Setting Powered False 14:12:57.401277 bus /sierra_3: Setting Powered False 14:12:58.517445 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 14:12:59.778306 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:12:59.783739 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:12:59.823841 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:12:59.851704 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:12:59.904466 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:12:59.943403 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:12:59.971156 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:13:00.522146 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 14:13:00.527905 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:13:00.539266 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 14:13:00.575536 tst handover.py: using LAC 41453 14:13:00.698812 tst handover.py: using RAC 143 14:13:00.822887 tst handover.py: using CellId 41453 14:13:00.983258 tst handover.py: using BVCI 41454 14:13:01.098302 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 14:13:01.133313 tst handover.py: using LAC 41454 14:13:01.264932 tst handover.py: using RAC 144 14:13:01.394188 tst handover.py: using CellId 41454 14:13:01.527833 tst handover.py: using BVCI 41455 14:13:01.692132 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:13:01.707870 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:13:01.724348 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:13:01.739082 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:13:01.751310 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:13:01.762800 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 14:13:01.906746 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 14:13:02.042612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:02.573480 run create_hlr_db(pid=31602): Launched 14:13:02.699385 bus /sierra_2: Setting Powered False 14:13:03.764350 run create_hlr_db(pid=31602): Terminated: ok {rc=0} 14:13:04.193062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31604): Launched 14:13:04.523165 run osmo-hlr_10.42.42.2(pid=31605): Launched 14:13:04.649454 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:05.185879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31607): Launched 14:13:05.516149 run osmo-stp_10.42.42.5(pid=31608): Launched 14:13:05.642336 run osmo-msc_10.42.42.6: Starting osmo-msc 14:13:06.208722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31610): Launched 14:13:06.538932 run osmo-msc_10.42.42.6(pid=31611): Launched 14:13:06.722860 run osmo-stp_10.42.42.5(pid=31608): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31608)] 14:13:06.861754 run osmo-stp_10.42.42.5(pid=31608): stdout: | (launched: 2022-12-14_14:13:05.456004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:07.001205 run osmo-stp_10.42.42.5(pid=31608): stderr: | 20221214141305649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141305649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141305649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141305650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141305650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141305650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141305650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:07.139583 run osmo-stp_10.42.42.5(pid=31608): stdout: | (launched: 2022-12-14_14:13:05.456004) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:07.270924 run osmo-stp_10.42.42.5(pid=31608): stderr: | 20221214141305649 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141305649 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141305649 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141305650 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141305650 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141305650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141305650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:07.428548 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31608): Process ended prematurely: osmo-stp_10.42.42.5(pid=31608) [trial-2405↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31608)] [trial-2405↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 14:13:07.437358 tst handover.py:18: Test FAILED (6.9 sec) 14:13:07.464842 run osmo-hlr_10.42.42.2(pid=31605): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31605)] 14:13:07.516128 run osmo-hlr_10.42.42.2(pid=31605): stdout: | (launched: 2022-12-14_14:13:04.462958) 14:13:07.568002 run osmo-hlr_10.42.42.2(pid=31605): stderr: | 20221214141304661 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141304661 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141304661 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141304661 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141304661 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141304661 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141304674 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141304682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141304683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141304683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:13:07.640618 run osmo-msc_10.42.42.6(pid=31611): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31611)] 14:13:07.690425 run osmo-msc_10.42.42.6(pid=31611): stdout: | (launched: 2022-12-14_14:13:06.478588) 14:13:07.742300 run osmo-msc_10.42.42.6(pid=31611): stderr: | 20221214141306800 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141306801 DLGLOBAL DEBUG validating counter group 0x7f96477d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141306801 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141306801 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141306801 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141306801 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141306803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141306803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141306803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141306803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:13:07.793890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31604): Terminating (SIGTERM) 14:13:07.835523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31607): Terminating (SIGTERM) 14:13:07.877782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31610): Terminating (SIGTERM) 14:13:07.919850 --- ParallelTerminationStrategy: PID 31604 died... 14:13:07.940382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31604): Terminated: ok {rc=0} 14:13:07.987420 --- ParallelTerminationStrategy: PID 31607 died... 14:13:08.007335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31607): Terminated: ok {rc=0} 14:13:08.053684 --- ParallelTerminationStrategy: PID 31610 died... 14:13:08.073458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31610): Terminated: ok {rc=0} 14:13:08.162044 bus /sierra_3: Setting Powered False 14:13:09.260275 bus /sierra_3: Setting Powered False 14:13:10.375976 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 14:13:11.619333 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:13:11.624867 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:13:11.677071 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:13:11.704289 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:13:11.757249 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:13:11.808938 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:13:11.836174 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:13:12.390164 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 14:13:12.396116 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:13:12.408450 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:13:12.445219 tst handover.py: using LAC 41455 14:13:12.578110 tst handover.py: using RAC 145 14:13:12.709722 tst handover.py: using CellId 41455 14:13:12.838053 tst handover.py: using BVCI 41456 14:13:12.958516 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:13:13.007204 tst handover.py: using LAC 41456 14:13:13.127071 tst handover.py: using RAC 146 14:13:13.247326 tst handover.py: using CellId 41456 14:13:13.367349 tst handover.py: using BVCI 41457 14:13:13.479808 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:13:13.490545 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:13:13.501088 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:13:13.511628 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:13:13.522505 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:13:13.533020 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:13:13.651043 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:13:13.770596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:14.251437 run create_hlr_db(pid=31616): Launched 14:13:14.379134 bus /sierra_2: Setting Powered False 14:13:15.443205 run create_hlr_db(pid=31616): Terminated: ok {rc=0} 14:13:15.857767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31618): Launched 14:13:16.233680 run osmo-hlr_10.42.42.2(pid=31619): Launched 14:13:16.451984 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:17.089753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31621): Launched 14:13:17.449707 run osmo-stp_10.42.42.5(pid=31622): Launched 14:13:17.577486 run osmo-msc_10.42.42.6: Starting osmo-msc 14:13:18.145525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31624): Launched 14:13:18.474620 run osmo-msc_10.42.42.6(pid=31625): Launched 14:13:18.659049 run osmo-stp_10.42.42.5(pid=31622): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31622)] 14:13:18.797745 run osmo-stp_10.42.42.5(pid=31622): stdout: | (launched: 2022-12-14_14:13:17.388333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:18.936787 run osmo-stp_10.42.42.5(pid=31622): stderr: | 20221214141317585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141317585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141317586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141317586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141317586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141317587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141317587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:19.074716 run osmo-stp_10.42.42.5(pid=31622): stdout: | (launched: 2022-12-14_14:13:17.388333) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:19.205634 run osmo-stp_10.42.42.5(pid=31622): stderr: | 20221214141317585 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141317585 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141317586 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141317586 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141317586 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141317587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141317587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:19.363208 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31622): Process ended prematurely: osmo-stp_10.42.42.5(pid=31622) [trial-2405↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31622)] [trial-2405↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 14:13:19.372011 tst handover.py:18: Test FAILED (7.0 sec) 14:13:19.399563 run osmo-hlr_10.42.42.2(pid=31619): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31619)] 14:13:19.450064 run osmo-hlr_10.42.42.2(pid=31619): stdout: | (launched: 2022-12-14_14:13:16.163246) 14:13:19.501660 run osmo-hlr_10.42.42.2(pid=31619): stderr: | 20221214141316377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141316377 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141316377 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141316377 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141316378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141316378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141316401 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141316431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141316431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141316431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:13:19.573638 run osmo-msc_10.42.42.6(pid=31625): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31625)] 14:13:19.622915 run osmo-msc_10.42.42.6(pid=31625): stdout: | (launched: 2022-12-14_14:13:18.414489) 14:13:19.674257 run osmo-msc_10.42.42.6(pid=31625): stderr: | 20221214141318738 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141318738 DLGLOBAL DEBUG validating counter group 0x7f72e8a04c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141318738 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141318738 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141318738 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141318738 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141318740 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141318740 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141318740 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141318740 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:13:19.725701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31618): Terminating (SIGTERM) 14:13:19.767193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31621): Terminating (SIGTERM) 14:13:19.808838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31624): Terminating (SIGTERM) 14:13:19.850899 --- ParallelTerminationStrategy: PID 31618 died... 14:13:19.871106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31618): Terminated: ok {rc=0} 14:13:19.917516 --- ParallelTerminationStrategy: PID 31621 died... 14:13:19.937363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31621): Terminated: ok {rc=0} 14:13:19.983486 --- ParallelTerminationStrategy: PID 31624 died... 14:13:20.003276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31624): Terminated: ok {rc=0} 14:13:20.091636 bus /sierra_3: Setting Powered False 14:13:21.190291 bus /sierra_3: Setting Powered False 14:13:22.305939 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 14:13:23.570385 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:13:23.575774 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:13:23.627195 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:13:23.654304 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:13:23.708233 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:13:23.760263 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:13:23.787440 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:13:24.336221 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 14:13:24.341914 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:13:24.353260 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:13:24.393373 tst handover.py: using LAC 41457 14:13:24.522643 tst handover.py: using RAC 147 14:13:24.650389 tst handover.py: using CellId 41457 14:13:24.783016 tst handover.py: using BVCI 41458 14:13:24.903560 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:13:24.951489 tst handover.py: using LAC 41458 14:13:25.078633 tst handover.py: using RAC 148 14:13:25.205653 tst handover.py: using CellId 41458 14:13:25.334969 tst handover.py: using BVCI 41459 14:13:25.454932 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:13:25.466378 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:13:25.477426 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:13:25.488633 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:13:25.500668 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:13:25.512627 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:13:25.632491 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:13:25.754590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:26.237287 run create_hlr_db(pid=31630): Launched 14:13:26.364113 bus /sierra_2: Setting Powered False 14:13:27.426144 run create_hlr_db(pid=31630): Terminated: ok {rc=0} 14:13:27.847720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31632): Launched 14:13:28.178650 run osmo-hlr_10.42.42.2(pid=31633): Launched 14:13:28.305640 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:28.836243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31635): Launched 14:13:29.143948 run osmo-stp_10.42.42.5(pid=31636): Launched 14:13:29.261236 run osmo-msc_10.42.42.6: Starting osmo-msc 14:13:29.791665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31638): Launched 14:13:30.099499 run osmo-msc_10.42.42.6(pid=31639): Launched 14:13:30.272109 run osmo-stp_10.42.42.5(pid=31636): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31636)] 14:13:30.402287 run osmo-stp_10.42.42.5(pid=31636): stdout: | (launched: 2022-12-14_14:13:29.087398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:30.531594 run osmo-stp_10.42.42.5(pid=31636): stderr: | 20221214141329261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141329262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141329262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141329262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141329263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141329263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141329263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:30.658867 run osmo-stp_10.42.42.5(pid=31636): stdout: | (launched: 2022-12-14_14:13:29.087398) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:30.780672 run osmo-stp_10.42.42.5(pid=31636): stderr: | 20221214141329261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141329262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141329262 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141329262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141329263 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141329263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141329263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:30.949753 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31636): Process ended prematurely: osmo-stp_10.42.42.5(pid=31636) [trial-2405↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31636)] [trial-2405↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 14:13:30.959768 tst handover.py:18: Test FAILED (6.6 sec) 14:13:30.988380 run osmo-hlr_10.42.42.2(pid=31633): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31633)] 14:13:31.043622 run osmo-hlr_10.42.42.2(pid=31633): stdout: | (launched: 2022-12-14_14:13:28.118470) 14:13:31.098268 run osmo-hlr_10.42.42.2(pid=31633): stderr: | 20221214141328320 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141328320 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141328320 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141328320 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141328320 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141328320 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141328335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141328345 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141328345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141328345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:13:31.174015 run osmo-msc_10.42.42.6(pid=31639): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31639)] 14:13:31.225366 run osmo-msc_10.42.42.6(pid=31639): stdout: | (launched: 2022-12-14_14:13:30.042548) 14:13:31.280170 run osmo-msc_10.42.42.6(pid=31639): stderr: | 20221214141330318 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141330318 DLGLOBAL DEBUG validating counter group 0x7fd473d79c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141330318 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141330318 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141330318 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141330318 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141330320 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141330320 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141330320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141330320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:13:31.335812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31632): Terminating (SIGTERM) 14:13:31.379829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31635): Terminating (SIGTERM) 14:13:31.424489 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31638): Terminating (SIGTERM) 14:13:31.470781 --- ParallelTerminationStrategy: PID 31632 died... 14:13:31.492908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31632): Terminated: ok {rc=0} 14:13:31.545660 --- ParallelTerminationStrategy: PID 31635 died... 14:13:31.566555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31635): Terminated: ok {rc=0} 14:13:31.615647 --- ParallelTerminationStrategy: PID 31638 died... 14:13:31.637480 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31638): Terminated: ok {rc=0} 14:13:31.731085 bus /sierra_3: Setting Powered False 14:13:32.830861 bus /sierra_3: Setting Powered False 14:13:33.946185 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 14:13:35.202507 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:13:35.207406 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 14:13:35.255369 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 14:13:35.281594 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 14:13:35.332819 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 14:13:35.381102 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 14:13:35.407434 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 14:13:35.957209 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 14:13:35.962463 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:13:35.973404 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:13:36.006713 tst handover.py: using LAC 41459 14:13:36.128590 tst handover.py: using RAC 149 14:13:36.252005 tst handover.py: using CellId 41459 14:13:36.373823 tst handover.py: using BVCI 41460 14:13:36.486323 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 14:13:36.534269 tst handover.py: using LAC 41460 14:13:36.654831 tst handover.py: using RAC 150 14:13:36.777689 tst handover.py: using CellId 41460 14:13:36.899799 tst handover.py: using BVCI 41461 14:13:37.011384 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:13:37.022329 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:13:37.033205 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:13:37.043912 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:13:37.055278 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 14:13:37.066646 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:13:37.188809 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 14:13:37.305281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:37.755210 run create_hlr_db(pid=31645): Launched 14:13:37.881254 bus /sierra_2: Setting Powered False 14:13:38.942811 run create_hlr_db(pid=31645): Terminated: ok {rc=0} 14:13:39.363099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31647): Launched 14:13:39.693129 run osmo-hlr_10.42.42.2(pid=31648): Launched 14:13:39.818823 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:40.359082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31650): Launched 14:13:40.688547 run osmo-stp_10.42.42.5(pid=31651): Launched 14:13:40.813919 run osmo-msc_10.42.42.6: Starting osmo-msc 14:13:41.383091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31653): Launched 14:13:41.713614 run osmo-msc_10.42.42.6(pid=31654): Launched 14:13:41.898350 run osmo-stp_10.42.42.5(pid=31651): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31651)] 14:13:42.037293 run osmo-stp_10.42.42.5(pid=31651): stdout: | (launched: 2022-12-14_14:13:40.628216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:42.176415 run osmo-stp_10.42.42.5(pid=31651): stderr: | 20221214141340825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141340825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141340825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141340826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141340826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141340826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141340826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:42.313991 run osmo-stp_10.42.42.5(pid=31651): stdout: | (launched: 2022-12-14_14:13:40.628216) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:42.445507 run osmo-stp_10.42.42.5(pid=31651): stderr: | 20221214141340825 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141340825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141340825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141340826 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141340826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141340826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141340826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:42.602122 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31651): Process ended prematurely: osmo-stp_10.42.42.5(pid=31651) [trial-2405↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31651)] [trial-2405↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 14:13:42.611023 tst handover.py:18: Test FAILED (6.6 sec) 14:13:42.638392 run osmo-hlr_10.42.42.2(pid=31648): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31648)] 14:13:42.689205 run osmo-hlr_10.42.42.2(pid=31648): stdout: | (launched: 2022-12-14_14:13:39.632772) 14:13:42.740906 run osmo-hlr_10.42.42.2(pid=31648): stderr: | 20221214141339835 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141339835 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141339835 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141339835 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141339835 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141339835 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141339847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141339855 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141339855 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141339855 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:13:42.813384 run osmo-msc_10.42.42.6(pid=31654): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31654)] 14:13:42.863045 run osmo-msc_10.42.42.6(pid=31654): stdout: | (launched: 2022-12-14_14:13:41.653289) 14:13:42.914867 run osmo-msc_10.42.42.6(pid=31654): stderr: | 20221214141341974 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141341974 DLGLOBAL DEBUG validating counter group 0x7f951f1b1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141341974 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141341974 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141341974 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141341974 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141341976 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141341976 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141341977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141341977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:13:42.966946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31647): Terminating (SIGTERM) 14:13:43.008548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31650): Terminating (SIGTERM) 14:13:43.050460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31653): Terminating (SIGTERM) 14:13:43.093106 --- ParallelTerminationStrategy: PID 31647 died... 14:13:43.113516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31647): Terminated: ok {rc=0} 14:13:43.160110 --- ParallelTerminationStrategy: PID 31650 died... 14:13:43.180012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31650): Terminated: ok {rc=0} 14:13:43.226455 --- ParallelTerminationStrategy: PID 31653 died... 14:13:43.246446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31653): Terminated: ok {rc=0} 14:13:43.335191 bus /sierra_3: Setting Powered False 14:13:44.432474 bus /sierra_3: Setting Powered False 14:13:45.548008 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:13:46.805791 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:13:46.814294 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:13:46.877466 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:13:46.910105 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:13:46.962053 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:13:47.019475 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:13:47.053272 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:13:47.586840 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:13:47.592648 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:13:47.604384 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:13:47.639019 tst handover.py: using LAC 41461 14:13:47.767549 tst handover.py: using RAC 151 14:13:47.896762 tst handover.py: using CellId 41461 14:13:48.030017 tst handover.py: using BVCI 41462 14:13:48.150128 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:13:48.193953 tst handover.py: using LAC 41462 14:13:48.320555 tst handover.py: using RAC 152 14:13:48.447469 tst handover.py: using CellId 41462 14:13:48.573368 tst handover.py: using BVCI 41463 14:13:48.692334 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:13:48.703814 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:13:48.715055 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:13:48.726426 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:13:48.738028 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:13:48.749745 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:13:48.866993 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:13:48.982156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:13:49.433529 run create_hlr_db(pid=31659): Launched 14:13:49.560458 bus /sierra_2: Setting Powered False 14:13:50.621603 run create_hlr_db(pid=31659): Terminated: ok {rc=0} 14:13:51.041742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31661): Launched 14:13:51.371777 run osmo-hlr_10.42.42.2(pid=31662): Launched 14:13:51.498614 run osmo-stp_10.42.42.5: Starting osmo-stp 14:13:52.042352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31664): Launched 14:13:52.372446 run osmo-stp_10.42.42.5(pid=31665): Launched 14:13:52.499290 run osmo-msc_10.42.42.6: Starting osmo-msc 14:13:53.065717 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31667): Launched 14:13:53.395587 run osmo-msc_10.42.42.6(pid=31668): Launched 14:13:53.581315 run osmo-stp_10.42.42.5(pid=31665): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31665)] 14:13:53.720473 run osmo-stp_10.42.42.5(pid=31665): stdout: | (launched: 2022-12-14_14:13:52.312017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:53.860268 run osmo-stp_10.42.42.5(pid=31665): stderr: | 20221214141352506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141352506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141352507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141352507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141352509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141352510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141352510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:53.998693 run osmo-stp_10.42.42.5(pid=31665): stdout: | (launched: 2022-12-14_14:13:52.312017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:13:54.130602 run osmo-stp_10.42.42.5(pid=31665): stderr: | 20221214141352506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141352506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141352507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141352507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141352509 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141352510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141352510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:13:54.287890 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31665): Process ended prematurely: osmo-stp_10.42.42.5(pid=31665) [trial-2405↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31665)] [trial-2405↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 14:13:54.296608 tst handover.py:18: Test FAILED (6.7 sec) 14:13:54.324292 run osmo-hlr_10.42.42.2(pid=31662): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31662)] 14:13:54.374983 run osmo-hlr_10.42.42.2(pid=31662): stdout: | (launched: 2022-12-14_14:13:51.311622) 14:13:54.427053 run osmo-hlr_10.42.42.2(pid=31662): stderr: | 20221214141351510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141351510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141351510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141351510 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141351510 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141351510 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141351522 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141351531 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141351531 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141351531 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:13:54.499462 run osmo-msc_10.42.42.6(pid=31668): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31668)] 14:13:54.549166 run osmo-msc_10.42.42.6(pid=31668): stdout: | (launched: 2022-12-14_14:13:53.334929) 14:13:54.600661 run osmo-msc_10.42.42.6(pid=31668): stderr: | 20221214141353656 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141353656 DLGLOBAL DEBUG validating counter group 0x7f432e97fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141353657 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141353657 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141353657 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141353657 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141353659 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141353659 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141353659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141353659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:13:54.652623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31661): Terminating (SIGTERM) 14:13:54.694717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31664): Terminating (SIGTERM) 14:13:54.737122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31667): Terminating (SIGTERM) 14:13:54.779436 --- ParallelTerminationStrategy: PID 31661 died... 14:13:54.799972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31661): Terminated: ok {rc=0} 14:13:54.846542 --- ParallelTerminationStrategy: PID 31664 died... 14:13:54.866553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31664): Terminated: ok {rc=0} 14:13:54.912934 --- ParallelTerminationStrategy: PID 31667 died... 14:13:54.932756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31667): Terminated: ok {rc=0} 14:13:55.020294 bus /sierra_3: Setting Powered False 14:13:56.119341 bus /sierra_3: Setting Powered False 14:13:57.232333 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:13:58.483092 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:13:58.488089 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:13:58.537337 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:13:58.563688 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:13:58.614245 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:13:58.663281 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:13:58.689947 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:13:59.245524 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:13:59.251073 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:13:59.262640 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:13:59.296493 tst handover.py: using LAC 41463 14:13:59.426439 tst handover.py: using RAC 153 14:13:59.556904 tst handover.py: using CellId 41463 14:13:59.686693 tst handover.py: using BVCI 41464 14:13:59.807613 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:13:59.857443 tst handover.py: using LAC 41464 14:13:59.977601 tst handover.py: using RAC 154 14:14:00.098284 tst handover.py: using CellId 41464 14:14:00.219320 tst handover.py: using BVCI 41465 14:14:00.330483 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:00.341545 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:00.352480 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:00.363355 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:00.374193 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:00.384878 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:14:00.503224 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:14:00.620046 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:01.087133 run create_hlr_db(pid=31673): Launched 14:14:01.253825 bus /sierra_2: Setting Powered False 14:14:02.320188 run create_hlr_db(pid=31673): Terminated: ok {rc=0} 14:14:02.724327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31675): Launched 14:14:03.031483 run osmo-hlr_10.42.42.2(pid=31676): Launched 14:14:03.148596 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:03.669555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31678): Launched 14:14:03.977485 run osmo-stp_10.42.42.5(pid=31679): Launched 14:14:04.094885 run osmo-msc_10.42.42.6: Starting osmo-msc 14:14:04.625286 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31681): Launched 14:14:04.933743 run osmo-msc_10.42.42.6(pid=31682): Launched 14:14:05.105938 run osmo-stp_10.42.42.5(pid=31679): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31679)] 14:14:05.236682 run osmo-stp_10.42.42.5(pid=31679): stdout: | (launched: 2022-12-14_14:14:03.920350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:05.366516 run osmo-stp_10.42.42.5(pid=31679): stderr: | 20221214141404091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141404091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141404091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141404092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141404094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141404095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141404095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:05.494604 run osmo-stp_10.42.42.5(pid=31679): stdout: | (launched: 2022-12-14_14:14:03.920350) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:05.617180 run osmo-stp_10.42.42.5(pid=31679): stderr: | 20221214141404091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141404091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141404091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141404092 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141404094 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141404095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141404095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:05.763568 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31679): Process ended prematurely: osmo-stp_10.42.42.5(pid=31679) [trial-2405↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31679)] [trial-2405↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 14:14:05.771746 tst handover.py:18: Test FAILED (6.5 sec) 14:14:05.797781 run osmo-hlr_10.42.42.2(pid=31676): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31676)] 14:14:05.845398 run osmo-hlr_10.42.42.2(pid=31676): stdout: | (launched: 2022-12-14_14:14:02.974906) 14:14:05.894857 run osmo-hlr_10.42.42.2(pid=31676): stderr: | 20221214141403155 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141403155 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141403155 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141403155 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141403155 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141403155 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141403167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141403175 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141403176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141403176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:05.964030 run osmo-msc_10.42.42.6(pid=31682): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31682)] 14:14:06.011894 run osmo-msc_10.42.42.6(pid=31682): stdout: | (launched: 2022-12-14_14:14:04.876657) 14:14:06.061440 run osmo-msc_10.42.42.6(pid=31682): stderr: | 20221214141405150 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141405150 DLGLOBAL DEBUG validating counter group 0x7f9aaea95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141405150 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141405150 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141405150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141405151 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141405152 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141405153 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141405153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141405153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:14:06.111344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31675): Terminating (SIGTERM) 14:14:06.151011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31678): Terminating (SIGTERM) 14:14:06.190696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31681): Terminating (SIGTERM) 14:14:06.230571 --- ParallelTerminationStrategy: PID 31675 died... 14:14:06.249713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31675): Terminated: ok {rc=0} 14:14:06.293639 --- ParallelTerminationStrategy: PID 31678 died... 14:14:06.312237 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31678): Terminated: ok {rc=0} 14:14:06.355881 --- ParallelTerminationStrategy: PID 31681 died... 14:14:06.374639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31681): Terminated: ok {rc=0} 14:14:06.458504 bus /sierra_3: Setting Powered False 14:14:07.555283 bus /sierra_3: Setting Powered False 14:14:08.672409 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 14:14:09.927442 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:14:09.932355 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:14:09.968750 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:14:09.995257 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:14:10.045484 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:14:10.081541 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:14:10.107710 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:14:10.661791 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 14:14:10.668206 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:14:10.679957 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 14:14:10.714249 tst handover.py: using LAC 41465 14:14:10.843732 tst handover.py: using RAC 155 14:14:10.973874 tst handover.py: using CellId 41465 14:14:11.104548 tst handover.py: using BVCI 41466 14:14:11.224293 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 14:14:11.260437 tst handover.py: using LAC 41466 14:14:11.396425 tst handover.py: using RAC 156 14:14:11.524602 tst handover.py: using CellId 41466 14:14:11.644887 tst handover.py: using BVCI 41467 14:14:11.756008 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:14:11.766695 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:14:11.777235 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:14:11.787661 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:14:11.798189 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:14:11.808564 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 14:14:11.929307 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 14:14:12.050342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:12.532512 run create_hlr_db(pid=31687): Launched 14:14:12.659324 bus /sierra_2: Setting Powered False 14:14:13.723862 run create_hlr_db(pid=31687): Terminated: ok {rc=0} 14:14:14.152453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31689): Launched 14:14:14.483148 run osmo-hlr_10.42.42.2(pid=31690): Launched 14:14:14.609785 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:15.146178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31692): Launched 14:14:15.476399 run osmo-stp_10.42.42.5(pid=31693): Launched 14:14:15.602644 run osmo-msc_10.42.42.6: Starting osmo-msc 14:14:16.188434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31695): Launched 14:14:16.545580 run osmo-msc_10.42.42.6(pid=31696): Launched 14:14:16.919904 run osmo-stp_10.42.42.5(pid=31693): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31693)] 14:14:17.178353 run osmo-stp_10.42.42.5(pid=31693): stdout: | (launched: 2022-12-14_14:14:15.415828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:17.318721 run osmo-stp_10.42.42.5(pid=31693): stderr: | 20221214141415610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141415610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141415611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141415611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141415611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141415612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141415612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:17.456330 run osmo-stp_10.42.42.5(pid=31693): stdout: | (launched: 2022-12-14_14:14:15.415828) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:17.588308 run osmo-stp_10.42.42.5(pid=31693): stderr: | 20221214141415610 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141415610 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141415611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141415611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141415611 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141415612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141415612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:17.745258 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31693): Process ended prematurely: osmo-stp_10.42.42.5(pid=31693) [trial-2405↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31693)] [trial-2405↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 14:14:17.754086 tst handover.py:18: Test FAILED (7.1 sec) 14:14:17.781465 run osmo-hlr_10.42.42.2(pid=31690): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31690)] 14:14:17.832214 run osmo-hlr_10.42.42.2(pid=31690): stdout: | (launched: 2022-12-14_14:14:14.422539) 14:14:17.884399 run osmo-hlr_10.42.42.2(pid=31690): stderr: | 20221214141414623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141414623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141414623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141414623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141414623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141414624 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141414635 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141414643 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141414644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141414644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:17.957340 run osmo-msc_10.42.42.6(pid=31696): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31696)] 14:14:18.007367 run osmo-msc_10.42.42.6(pid=31696): stdout: | (launched: 2022-12-14_14:14:16.473452) 14:14:18.059335 run osmo-msc_10.42.42.6(pid=31696): stderr: | 20221214141416921 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141416922 DLGLOBAL DEBUG validating counter group 0x7fa72db88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141416922 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141416922 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141416922 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141416922 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141416924 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141416924 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141416924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141416924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:14:18.112367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31689): Terminating (SIGTERM) 14:14:18.154233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31692): Terminating (SIGTERM) 14:14:18.196584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31695): Terminating (SIGTERM) 14:14:18.239041 --- ParallelTerminationStrategy: PID 31689 died... 14:14:18.259341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31689): Terminated: ok {rc=0} 14:14:18.305901 --- ParallelTerminationStrategy: PID 31692 died... 14:14:18.325808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31692): Terminated: ok {rc=0} 14:14:18.372161 --- ParallelTerminationStrategy: PID 31695 died... 14:14:18.392379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31695): Terminated: ok {rc=0} 14:14:18.482454 bus /sierra_3: Setting Powered False 14:14:19.582353 bus /sierra_3: Setting Powered False 14:14:20.697448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 14:14:21.940283 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:14:21.946018 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:14:21.996794 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:14:22.023806 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:14:22.076044 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:14:22.126333 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:14:22.153534 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:14:22.704930 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 14:14:22.710466 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:14:22.721855 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:14:22.755753 tst handover.py: using LAC 41467 14:14:22.885552 tst handover.py: using RAC 157 14:14:23.006814 tst handover.py: using CellId 41467 14:14:23.128824 tst handover.py: using BVCI 41468 14:14:23.241470 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:14:23.292551 tst handover.py: using LAC 41468 14:14:23.413334 tst handover.py: using RAC 158 14:14:23.534230 tst handover.py: using CellId 41468 14:14:23.654115 tst handover.py: using BVCI 41469 14:14:23.765531 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:14:23.776277 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:14:23.786915 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:14:23.797598 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:14:23.808257 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:14:23.818856 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:14:23.939337 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:14:24.056463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:24.507686 run create_hlr_db(pid=31702): Launched 14:14:24.634039 bus /sierra_2: Setting Powered False 14:14:25.694672 run create_hlr_db(pid=31702): Terminated: ok {rc=0} 14:14:26.114564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31704): Launched 14:14:26.427642 run osmo-hlr_10.42.42.2(pid=31705): Launched 14:14:26.544361 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:27.045196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31707): Launched 14:14:27.352312 run osmo-stp_10.42.42.5(pid=31708): Launched 14:14:27.468830 run osmo-msc_10.42.42.6: Starting osmo-msc 14:14:27.999493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31710): Launched 14:14:28.308318 run osmo-msc_10.42.42.6(pid=31711): Launched 14:14:28.479364 run osmo-stp_10.42.42.5(pid=31708): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31708)] 14:14:28.608778 run osmo-stp_10.42.42.5(pid=31708): stdout: | (launched: 2022-12-14_14:14:27.295265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:28.737598 run osmo-stp_10.42.42.5(pid=31708): stderr: | 20221214141427467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141427468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141427468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141427468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141427469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141427469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141427469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:28.864721 run osmo-stp_10.42.42.5(pid=31708): stdout: | (launched: 2022-12-14_14:14:27.295265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:28.986707 run osmo-stp_10.42.42.5(pid=31708): stderr: | 20221214141427467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141427468 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141427468 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141427468 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141427469 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141427469 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141427469 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:29.132553 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31708): Process ended prematurely: osmo-stp_10.42.42.5(pid=31708) [trial-2405↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31708)] [trial-2405↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 14:14:29.140858 tst handover.py:18: Test FAILED (6.4 sec) 14:14:29.166750 run osmo-hlr_10.42.42.2(pid=31705): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31705)] 14:14:29.214320 run osmo-hlr_10.42.42.2(pid=31705): stdout: | (launched: 2022-12-14_14:14:26.370559) 14:14:29.263367 run osmo-hlr_10.42.42.2(pid=31705): stderr: | 20221214141426552 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141426552 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141426552 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141426552 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141426552 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141426552 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141426564 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141426573 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141426573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141426573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:29.331695 run osmo-msc_10.42.42.6(pid=31711): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31711)] 14:14:29.379534 run osmo-msc_10.42.42.6(pid=31711): stdout: | (launched: 2022-12-14_14:14:28.250353) 14:14:29.428785 run osmo-msc_10.42.42.6(pid=31711): stderr: | 20221214141428523 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141428523 DLGLOBAL DEBUG validating counter group 0x7f6304fb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141428523 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141428523 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141428524 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141428524 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141428526 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141428526 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141428526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141428526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:14:29.478108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31704): Terminating (SIGTERM) 14:14:29.517523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31707): Terminating (SIGTERM) 14:14:29.557063 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31710): Terminating (SIGTERM) 14:14:29.597026 --- ParallelTerminationStrategy: PID 31704 died... 14:14:29.616376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31704): Terminated: ok {rc=0} 14:14:29.660742 --- ParallelTerminationStrategy: PID 31707 died... 14:14:29.679597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31707): Terminated: ok {rc=0} 14:14:29.723837 --- ParallelTerminationStrategy: PID 31710 died... 14:14:29.742658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31710): Terminated: ok {rc=0} 14:14:29.828354 bus /sierra_3: Setting Powered False 14:14:30.939829 bus /sierra_3: Setting Powered False 14:14:32.070043 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 14:14:33.345913 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:14:33.353226 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:14:33.404845 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:14:33.432087 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:14:33.483707 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:14:33.533930 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:14:33.561182 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:14:34.109579 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 14:14:34.114600 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:14:34.125397 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:14:34.158765 tst handover.py: using LAC 41469 14:14:34.290855 tst handover.py: using RAC 159 14:14:34.418466 tst handover.py: using CellId 41469 14:14:34.548300 tst handover.py: using BVCI 41470 14:14:34.661882 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:14:34.708008 tst handover.py: using LAC 41470 14:14:34.827342 tst handover.py: using RAC 160 14:14:34.960314 tst handover.py: using CellId 41470 14:14:35.084600 tst handover.py: using BVCI 41471 14:14:35.197396 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:14:35.208232 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:14:35.218836 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:14:35.229351 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:14:35.240069 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:14:35.250767 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:14:35.367099 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:14:35.484843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:35.937298 run create_hlr_db(pid=31716): Launched 14:14:36.064545 bus /sierra_2: Setting Powered False 14:14:37.125481 run create_hlr_db(pid=31716): Terminated: ok {rc=0} 14:14:37.529721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31718): Launched 14:14:37.839334 run osmo-hlr_10.42.42.2(pid=31719): Launched 14:14:37.956203 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:38.472117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31721): Launched 14:14:38.780847 run osmo-stp_10.42.42.5(pid=31722): Launched 14:14:38.898761 run osmo-msc_10.42.42.6: Starting osmo-msc 14:14:39.429207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31724): Launched 14:14:39.737483 run osmo-msc_10.42.42.6(pid=31725): Launched 14:14:39.910141 run osmo-stp_10.42.42.5(pid=31722): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31722)] 14:14:40.041980 run osmo-stp_10.42.42.5(pid=31722): stdout: | (launched: 2022-12-14_14:14:38.724065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:40.171860 run osmo-stp_10.42.42.5(pid=31722): stderr: | 20221214141438893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141438894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141438894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141438894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141438896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141438897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141438897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:40.299726 run osmo-stp_10.42.42.5(pid=31722): stdout: | (launched: 2022-12-14_14:14:38.724065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:40.422562 run osmo-stp_10.42.42.5(pid=31722): stderr: | 20221214141438893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141438894 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141438894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141438894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141438896 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141438897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141438897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:40.569497 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31722): Process ended prematurely: osmo-stp_10.42.42.5(pid=31722) [trial-2405↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31722)] [trial-2405↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 14:14:40.577777 tst handover.py:18: Test FAILED (6.5 sec) 14:14:40.604215 run osmo-hlr_10.42.42.2(pid=31719): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31719)] 14:14:40.652123 run osmo-hlr_10.42.42.2(pid=31719): stdout: | (launched: 2022-12-14_14:14:37.781568) 14:14:40.701487 run osmo-hlr_10.42.42.2(pid=31719): stderr: | 20221214141437958 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141437958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141437958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141437959 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141437959 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141437959 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141437971 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141437980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141437980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141437980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:40.769781 run osmo-msc_10.42.42.6(pid=31725): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31725)] 14:14:40.817217 run osmo-msc_10.42.42.6(pid=31725): stdout: | (launched: 2022-12-14_14:14:39.680140) 14:14:40.866392 run osmo-msc_10.42.42.6(pid=31725): stderr: | 20221214141439954 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141439954 DLGLOBAL DEBUG validating counter group 0x7f6dd00e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141439954 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141439954 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141439954 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141439954 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141439956 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141439957 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141439957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141439957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:14:40.915409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31718): Terminating (SIGTERM) 14:14:40.954819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31721): Terminating (SIGTERM) 14:14:40.994240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31724): Terminating (SIGTERM) 14:14:41.033827 --- ParallelTerminationStrategy: PID 31718 died... 14:14:41.052733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31718): Terminated: ok {rc=0} 14:14:41.096632 --- ParallelTerminationStrategy: PID 31721 died... 14:14:41.115277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31721): Terminated: ok {rc=0} 14:14:41.158843 --- ParallelTerminationStrategy: PID 31724 died... 14:14:41.177399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31724): Terminated: ok {rc=0} 14:14:41.262777 bus /sierra_3: Setting Powered False 14:14:42.360132 bus /sierra_3: Setting Powered False 14:14:43.474405 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 14:14:44.725490 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:14:44.730518 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 14:14:44.788509 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 14:14:44.814761 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 14:14:44.865922 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 14:14:44.924499 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 14:14:44.950704 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 14:14:45.503061 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 14:14:45.508410 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:14:45.519566 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:14:45.567383 tst handover.py: using LAC 41471 14:14:45.697714 tst handover.py: using RAC 161 14:14:45.828240 tst handover.py: using CellId 41471 14:14:45.985294 tst handover.py: using BVCI 41472 14:14:46.114553 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 14:14:46.159638 tst handover.py: using LAC 41472 14:14:46.290727 tst handover.py: using RAC 162 14:14:46.420015 tst handover.py: using CellId 41472 14:14:46.550310 tst handover.py: using BVCI 41473 14:14:46.672544 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:14:46.684621 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:14:46.696501 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:14:46.708543 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:14:46.720918 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 14:14:46.733378 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:14:46.874331 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 14:14:47.025740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:47.536307 run create_hlr_db(pid=31731): Launched 14:14:47.663110 bus /sierra_2: Setting Powered False 14:14:48.727571 run create_hlr_db(pid=31731): Terminated: ok {rc=0} 14:14:49.156064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31733): Launched 14:14:49.486020 run osmo-hlr_10.42.42.2(pid=31734): Launched 14:14:49.611651 run osmo-stp_10.42.42.5: Starting osmo-stp 14:14:50.151994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31736): Launched 14:14:50.482622 run osmo-stp_10.42.42.5(pid=31737): Launched 14:14:50.608608 run osmo-msc_10.42.42.6: Starting osmo-msc 14:14:51.174317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31739): Launched 14:14:51.505282 run osmo-msc_10.42.42.6(pid=31740): Launched 14:14:51.690021 run osmo-stp_10.42.42.5(pid=31737): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31737)] 14:14:51.830115 run osmo-stp_10.42.42.5(pid=31737): stdout: | (launched: 2022-12-14_14:14:50.421879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:51.970755 run osmo-stp_10.42.42.5(pid=31737): stderr: | 20221214141450615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141450615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141450615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141450616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141450616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141450616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141450616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:52.108111 run osmo-stp_10.42.42.5(pid=31737): stdout: | (launched: 2022-12-14_14:14:50.421879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:14:52.239457 run osmo-stp_10.42.42.5(pid=31737): stderr: | 20221214141450615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141450615 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141450615 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141450616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141450616 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141450616 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141450616 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:14:52.396373 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31737): Process ended prematurely: osmo-stp_10.42.42.5(pid=31737) [trial-2405↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31737)] [trial-2405↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 14:14:52.405170 tst handover.py:18: Test FAILED (6.9 sec) 14:14:52.432756 run osmo-hlr_10.42.42.2(pid=31734): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31734)] 14:14:52.483547 run osmo-hlr_10.42.42.2(pid=31734): stdout: | (launched: 2022-12-14_14:14:49.425440) 14:14:52.535435 run osmo-hlr_10.42.42.2(pid=31734): stderr: | 20221214141449626 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141449626 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141449626 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141449626 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141449626 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141449626 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141449639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141449649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141449649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141449650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:14:52.608143 run osmo-msc_10.42.42.6(pid=31740): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31740)] 14:14:52.658192 run osmo-msc_10.42.42.6(pid=31740): stdout: | (launched: 2022-12-14_14:14:51.444534) 14:14:52.710554 run osmo-msc_10.42.42.6(pid=31740): stderr: | 20221214141451765 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141451765 DLGLOBAL DEBUG validating counter group 0x7f7cc34d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141451765 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141451765 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141451765 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141451766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141451767 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141451768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141451768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141451768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:14:52.762922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31733): Terminating (SIGTERM) 14:14:52.804573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31736): Terminating (SIGTERM) 14:14:52.846827 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31739): Terminating (SIGTERM) 14:14:52.889151 --- ParallelTerminationStrategy: PID 31733 died... 14:14:52.909434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31733): Terminated: ok {rc=0} 14:14:52.955933 --- ParallelTerminationStrategy: PID 31736 died... 14:14:52.975717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31736): Terminated: ok {rc=0} 14:14:53.022093 --- ParallelTerminationStrategy: PID 31739 died... 14:14:53.041977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31739): Terminated: ok {rc=0} 14:14:53.130597 bus /sierra_3: Setting Powered False 14:14:54.230465 bus /sierra_3: Setting Powered False 14:14:55.346335 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:14:56.615810 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:14:56.621333 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:14:56.686995 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:14:56.714060 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:14:56.767543 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:14:56.833688 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:14:56.860798 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:14:57.407678 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:14:57.413799 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:57.425359 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:14:57.473349 tst handover.py: using LAC 41473 14:14:57.595291 tst handover.py: using RAC 163 14:14:57.717436 tst handover.py: using CellId 41473 14:14:57.838772 tst handover.py: using BVCI 41474 14:14:57.961698 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:14:58.011520 tst handover.py: using LAC 41474 14:14:58.133390 tst handover.py: using RAC 164 14:14:58.265204 tst handover.py: using CellId 41474 14:14:58.387824 tst handover.py: using BVCI 41475 14:14:58.501426 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:58.512442 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:58.523508 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:58.534511 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:58.545818 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:14:58.557166 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:14:58.676393 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:14:58.794069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:14:59.246855 run create_hlr_db(pid=31746): Launched 14:14:59.373213 bus /sierra_2: Setting Powered False 14:15:00.438300 run create_hlr_db(pid=31746): Terminated: ok {rc=0} 14:15:00.880148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31748): Launched 14:15:01.249678 run osmo-hlr_10.42.42.2(pid=31752): Launched 14:15:01.498821 run osmo-stp_10.42.42.5: Starting osmo-stp 14:15:02.236230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31761): Launched 14:15:02.650817 run osmo-stp_10.42.42.5(pid=31762): Launched 14:15:02.881435 run osmo-msc_10.42.42.6: Starting osmo-msc 14:15:03.443818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31764): Launched 14:15:03.774197 run osmo-msc_10.42.42.6(pid=31765): Launched 14:15:03.957859 run osmo-stp_10.42.42.5(pid=31762): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31762)] 14:15:04.097517 run osmo-stp_10.42.42.5(pid=31762): stdout: | (launched: 2022-12-14_14:15:02.572652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:04.247584 run osmo-stp_10.42.42.5(pid=31762): stderr: | 20221214141502790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141502791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141502791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141502791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141502792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141502792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141502792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:04.385197 run osmo-stp_10.42.42.5(pid=31762): stdout: | (launched: 2022-12-14_14:15:02.572652) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:04.517177 run osmo-stp_10.42.42.5(pid=31762): stderr: | 20221214141502790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141502791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141502791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141502791 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141502792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141502792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141502792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:04.674360 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=31762): Process ended prematurely: osmo-stp_10.42.42.5(pid=31762) [trial-2405↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31762)] [trial-2405↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 14:15:04.683317 tst handover.py:18: Test FAILED (7.3 sec) 14:15:04.710768 run osmo-hlr_10.42.42.2(pid=31752): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31752)] 14:15:04.761738 run osmo-hlr_10.42.42.2(pid=31752): stdout: | (launched: 2022-12-14_14:15:01.168363) 14:15:04.813794 run osmo-hlr_10.42.42.2(pid=31752): stderr: | 20221214141501480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141501480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141501480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141501480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141501480 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141501480 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141501500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141501518 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141501518 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141501518 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:04.886657 run osmo-msc_10.42.42.6(pid=31765): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31765)] 14:15:04.936758 run osmo-msc_10.42.42.6(pid=31765): stdout: | (launched: 2022-12-14_14:15:03.713506) 14:15:04.989567 run osmo-msc_10.42.42.6(pid=31765): stderr: | 20221214141504065 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141504065 DLGLOBAL DEBUG validating counter group 0x7fb518c94c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141504066 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141504066 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141504066 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141504066 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141504068 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141504068 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141504068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141504068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:15:05.042236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31748): Terminating (SIGTERM) 14:15:05.084247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31761): Terminating (SIGTERM) 14:15:05.126976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31764): Terminating (SIGTERM) 14:15:05.169642 --- ParallelTerminationStrategy: PID 31748 died... 14:15:05.190327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31748): Terminated: ok {rc=0} 14:15:05.236837 --- ParallelTerminationStrategy: PID 31761 died... 14:15:05.256896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31761): Terminated: ok {rc=0} 14:15:05.303487 --- ParallelTerminationStrategy: PID 31764 died... 14:15:05.323519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31764): Terminated: ok {rc=0} 14:15:05.411452 bus /sierra_3: Setting Powered False 14:15:06.510272 bus /sierra_3: Setting Powered False 14:15:07.625918 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 14:15:08.900159 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:15:08.905704 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:15:08.958146 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:15:08.984540 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:15:09.041384 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:15:09.094127 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:15:09.121304 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:15:09.662834 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 14:15:09.668194 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:09.679117 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 14:15:09.726323 tst handover.py: using LAC 41475 14:15:09.847754 tst handover.py: using RAC 165 14:15:09.968569 tst handover.py: using CellId 41475 14:15:10.087266 tst handover.py: using BVCI 41476 14:15:10.199538 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 14:15:10.233487 tst handover.py: using LAC 41476 14:15:10.352113 tst handover.py: using RAC 166 14:15:10.470505 tst handover.py: using CellId 41476 14:15:10.590456 tst handover.py: using BVCI 41477 14:15:10.703017 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:10.713914 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:10.724550 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:10.735093 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:10.745803 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:10.756472 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 14:15:10.876211 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 14:15:10.993561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:11.477914 run create_hlr_db(pid=31770): Launched 14:15:11.605455 bus /sierra_2: Setting Powered False 14:15:12.669407 run create_hlr_db(pid=31770): Terminated: ok {rc=0} 14:15:13.089910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31877): Launched 14:15:13.438774 run osmo-hlr_10.42.42.2(pid=31951): Launched 14:15:13.602590 run osmo-stp_10.42.42.5: Starting osmo-stp 14:15:14.264135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32066): Launched 14:15:14.612660 run osmo-stp_10.42.42.5(pid=32127): Launched 14:15:14.739257 run osmo-msc_10.42.42.6: Starting osmo-msc 14:15:15.306678 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32129): Launched 14:15:15.637635 run osmo-msc_10.42.42.6(pid=32130): Launched 14:15:15.820728 run osmo-stp_10.42.42.5(pid=32127): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32127)] 14:15:16.167093 run osmo-stp_10.42.42.5(pid=32127): stdout: | (launched: 2022-12-14_14:15:14.551919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:16.365402 run osmo-stp_10.42.42.5(pid=32127): stderr: | 20221214141514747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141514747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141514747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141514747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141514748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141514748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141514748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:16.495927 run osmo-stp_10.42.42.5(pid=32127): stdout: | (launched: 2022-12-14_14:15:14.551919) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:16.623619 run osmo-stp_10.42.42.5(pid=32127): stderr: | 20221214141514747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141514747 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141514747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141514747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141514748 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141514748 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141514748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:16.774702 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32127): Process ended prematurely: osmo-stp_10.42.42.5(pid=32127) [trial-2405↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32127)] [trial-2405↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 14:15:16.783149 tst handover.py:18: Test FAILED (7.1 sec) 14:15:16.810051 run osmo-hlr_10.42.42.2(pid=31951): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31951)] 14:15:16.859427 run osmo-hlr_10.42.42.2(pid=31951): stdout: | (launched: 2022-12-14_14:15:13.373570) 14:15:16.911790 run osmo-hlr_10.42.42.2(pid=31951): stderr: | 20221214141513715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141513715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141513715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141513715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141513715 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141513715 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141513734 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141513747 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141513747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141513747 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:16.984847 run osmo-msc_10.42.42.6(pid=32130): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32130)] 14:15:17.034238 run osmo-msc_10.42.42.6(pid=32130): stdout: | (launched: 2022-12-14_14:15:15.577115) 14:15:17.084290 run osmo-msc_10.42.42.6(pid=32130): stderr: | 20221214141515944 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141515945 DLGLOBAL DEBUG validating counter group 0x7fa4bcf7bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141515945 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141515945 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141515945 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141515945 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141515947 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141515947 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141515947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141515947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:15:17.141233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31877): Terminating (SIGTERM) 14:15:17.184019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32066): Terminating (SIGTERM) 14:15:17.228705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32129): Terminating (SIGTERM) 14:15:17.274537 --- ParallelTerminationStrategy: PID 31877 died... 14:15:17.296519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31877): Terminated: ok {rc=0} 14:15:17.345348 --- ParallelTerminationStrategy: PID 32066 died... 14:15:17.366576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32066): Terminated: ok {rc=0} 14:15:17.415247 --- ParallelTerminationStrategy: PID 32129 died... 14:15:17.437221 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32129): Terminated: ok {rc=0} 14:15:17.528048 bus /sierra_3: Setting Powered False 14:15:18.626655 bus /sierra_3: Setting Powered False 14:15:19.744500 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 14:15:20.997687 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:15:21.002792 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:15:21.064704 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:15:21.091185 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:15:21.141996 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:15:21.203949 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:15:21.230221 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:15:21.781869 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 14:15:21.788487 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:15:21.801209 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:15:21.851941 tst handover.py: using LAC 41477 14:15:21.982882 tst handover.py: using RAC 167 14:15:22.113281 tst handover.py: using CellId 41477 14:15:22.242314 tst handover.py: using BVCI 41478 14:15:22.363363 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:15:22.412006 tst handover.py: using LAC 41478 14:15:22.533342 tst handover.py: using RAC 168 14:15:22.653750 tst handover.py: using CellId 41478 14:15:22.776841 tst handover.py: using BVCI 41479 14:15:22.893102 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:15:22.904319 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:15:22.915506 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:15:22.926732 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:15:22.938290 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:15:22.949845 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:15:23.069849 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:15:23.188591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:23.675178 run create_hlr_db(pid=32284): Launched 14:15:23.815685 bus /sierra_2: Setting Powered False 14:15:24.878441 run create_hlr_db(pid=32284): Terminated: ok {rc=0} 14:15:25.293773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32312): Launched 14:15:25.621674 run osmo-hlr_10.42.42.2(pid=32313): Launched 14:15:25.867820 run osmo-stp_10.42.42.5: Starting osmo-stp 14:15:26.515753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32315): Launched 14:15:26.862481 run osmo-stp_10.42.42.5(pid=32316): Launched 14:15:27.113599 run osmo-msc_10.42.42.6: Starting osmo-msc 14:15:27.771427 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32318): Launched 14:15:28.126529 run osmo-msc_10.42.42.6(pid=32319): Launched 14:15:28.500810 run osmo-stp_10.42.42.5(pid=32316): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32316)] 14:15:28.688706 run osmo-stp_10.42.42.5(pid=32316): stdout: | (launched: 2022-12-14_14:15:26.800139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:28.940885 run osmo-stp_10.42.42.5(pid=32316): stderr: | 20221214141527090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141527090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141527091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141527091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141527092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141527092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141527092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:29.082031 run osmo-stp_10.42.42.5(pid=32316): stdout: | (launched: 2022-12-14_14:15:26.800139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:29.215873 run osmo-stp_10.42.42.5(pid=32316): stderr: | 20221214141527090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141527090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141527091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141527091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141527092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141527092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141527092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:29.374659 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32316): Process ended prematurely: osmo-stp_10.42.42.5(pid=32316) [trial-2405↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32316)] [trial-2405↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 14:15:29.383737 tst handover.py:18: Test FAILED (7.6 sec) 14:15:29.411333 run osmo-hlr_10.42.42.2(pid=32313): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32313)] 14:15:29.462843 run osmo-hlr_10.42.42.2(pid=32313): stdout: | (launched: 2022-12-14_14:15:25.553505) 14:15:29.516037 run osmo-hlr_10.42.42.2(pid=32313): stderr: | 20221214141525858 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141525858 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141525858 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141525858 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141525858 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141525858 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141525878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141525886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141525887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141525887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:29.589154 run osmo-msc_10.42.42.6(pid=32319): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32319)] 14:15:29.639330 run osmo-msc_10.42.42.6(pid=32319): stdout: | (launched: 2022-12-14_14:15:28.060531) 14:15:29.691554 run osmo-msc_10.42.42.6(pid=32319): stderr: | 20221214141528533 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141528533 DLGLOBAL DEBUG validating counter group 0x7fc81e96dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141528533 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141528533 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141528533 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141528534 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141528535 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141528536 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141528536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141528536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:15:29.744215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32312): Terminating (SIGTERM) 14:15:29.786531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32315): Terminating (SIGTERM) 14:15:29.829122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32318): Terminating (SIGTERM) 14:15:29.872011 --- ParallelTerminationStrategy: PID 32312 died... 14:15:29.892920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32312): Terminated: ok {rc=0} 14:15:29.940576 --- ParallelTerminationStrategy: PID 32315 died... 14:15:29.960899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32315): Terminated: ok {rc=0} 14:15:30.008032 --- ParallelTerminationStrategy: PID 32318 died... 14:15:30.028587 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32318): Terminated: ok {rc=0} 14:15:30.117415 bus /sierra_3: Setting Powered False 14:15:31.222637 bus /sierra_3: Setting Powered False 14:15:32.354910 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 14:15:33.630826 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:15:33.636819 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:15:33.698944 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:15:33.725338 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:15:33.778198 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:15:33.844086 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:15:33.871287 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:15:34.419340 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 14:15:34.425096 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:15:34.436782 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:15:34.489337 tst handover.py: using LAC 41479 14:15:34.623575 tst handover.py: using RAC 169 14:15:34.751751 tst handover.py: using CellId 41479 14:15:34.881066 tst handover.py: using BVCI 41480 14:15:35.001169 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:15:35.049392 tst handover.py: using LAC 41480 14:15:35.179157 tst handover.py: using RAC 170 14:15:35.307364 tst handover.py: using CellId 41480 14:15:35.428267 tst handover.py: using BVCI 41481 14:15:35.551340 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:15:35.562822 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:15:35.574155 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:15:35.585598 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:15:35.597438 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:15:35.609322 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:15:35.726492 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:15:35.847723 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:36.332368 run create_hlr_db(pid=32325): Launched 14:15:36.460078 bus /sierra_2: Setting Powered False 14:15:37.525759 run create_hlr_db(pid=32325): Terminated: ok {rc=0} 14:15:37.956098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32327): Launched 14:15:38.286809 run osmo-hlr_10.42.42.2(pid=32328): Launched 14:15:38.415109 run osmo-stp_10.42.42.5: Starting osmo-stp 14:15:38.954305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32330): Launched 14:15:39.285260 run osmo-stp_10.42.42.5(pid=32331): Launched 14:15:39.411746 run osmo-msc_10.42.42.6: Starting osmo-msc 14:15:39.980934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32333): Launched 14:15:40.311214 run osmo-msc_10.42.42.6(pid=32334): Launched 14:15:40.498487 run osmo-stp_10.42.42.5(pid=32331): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32331)] 14:15:40.637656 run osmo-stp_10.42.42.5(pid=32331): stdout: | (launched: 2022-12-14_14:15:39.224482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:40.777685 run osmo-stp_10.42.42.5(pid=32331): stderr: | 20221214141539419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141539419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141539419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141539420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141539420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141539420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141539420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:40.916003 run osmo-stp_10.42.42.5(pid=32331): stdout: | (launched: 2022-12-14_14:15:39.224482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:41.048226 run osmo-stp_10.42.42.5(pid=32331): stderr: | 20221214141539419 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141539419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141539419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141539420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141539420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141539420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141539420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:41.206257 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32331): Process ended prematurely: osmo-stp_10.42.42.5(pid=32331) [trial-2405↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32331)] [trial-2405↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 14:15:41.215370 tst handover.py:18: Test FAILED (6.8 sec) 14:15:41.242994 run osmo-hlr_10.42.42.2(pid=32328): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32328)] 14:15:41.294375 run osmo-hlr_10.42.42.2(pid=32328): stdout: | (launched: 2022-12-14_14:15:38.226679) 14:15:41.347645 run osmo-hlr_10.42.42.2(pid=32328): stderr: | 20221214141538428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141538428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141538428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141538428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141538428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141538428 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141538440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141538448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141538448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141538448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:41.420583 run osmo-msc_10.42.42.6(pid=32334): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32334)] 14:15:41.471162 run osmo-msc_10.42.42.6(pid=32334): stdout: | (launched: 2022-12-14_14:15:40.250775) 14:15:41.523420 run osmo-msc_10.42.42.6(pid=32334): stderr: | 20221214141540573 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141540574 DLGLOBAL DEBUG validating counter group 0x7f2b43ecfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141540574 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141540574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141540574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141540574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141540576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141540576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141540576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141540576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:15:41.575670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32327): Terminating (SIGTERM) 14:15:41.617799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32330): Terminating (SIGTERM) 14:15:41.660573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32333): Terminating (SIGTERM) 14:15:41.703675 --- ParallelTerminationStrategy: PID 32327 died... 14:15:41.724280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32327): Terminated: ok {rc=0} 14:15:41.771353 --- ParallelTerminationStrategy: PID 32330 died... 14:15:41.791376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32330): Terminated: ok {rc=0} 14:15:41.838222 --- ParallelTerminationStrategy: PID 32333 died... 14:15:41.858236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32333): Terminated: ok {rc=0} 14:15:41.956285 bus /sierra_3: Setting Powered False 14:15:43.055149 bus /sierra_3: Setting Powered False 14:15:44.173799 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 14:15:45.452729 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:15:45.458758 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 14:15:45.520625 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:15:45.548625 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:15:45.600734 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 14:15:45.660522 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:15:45.687093 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:15:46.242477 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 14:15:46.250342 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:15:46.264265 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:15:46.318543 tst handover.py: using LAC 41481 14:15:46.454935 tst handover.py: using RAC 171 14:15:46.622934 tst handover.py: using CellId 41481 14:15:46.754371 tst handover.py: using BVCI 41482 14:15:46.880447 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 14:15:46.931394 tst handover.py: using LAC 41482 14:15:47.063291 tst handover.py: using RAC 172 14:15:47.228416 tst handover.py: using CellId 41482 14:15:47.361343 tst handover.py: using BVCI 41483 14:15:47.481898 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:15:47.493882 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:15:47.505472 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:15:47.517132 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:15:47.529059 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:15:47.540923 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:15:47.657909 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:15:47.777589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:48.262320 run create_hlr_db(pid=32339): Launched 14:15:48.390336 bus /sierra_2: Setting Powered False 14:15:49.455644 run create_hlr_db(pid=32339): Terminated: ok {rc=0} 14:15:49.870043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32341): Launched 14:15:50.179973 run osmo-hlr_10.42.42.2(pid=32342): Launched 14:15:50.298337 run osmo-stp_10.42.42.5: Starting osmo-stp 14:15:50.804704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32344): Launched 14:15:51.114723 run osmo-stp_10.42.42.5(pid=32345): Launched 14:15:51.235613 run osmo-msc_10.42.42.6: Starting osmo-msc 14:15:51.769311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32347): Launched 14:15:52.088931 run osmo-msc_10.42.42.6(pid=32349): Launched 14:15:52.276152 run osmo-stp_10.42.42.5(pid=32345): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32345)] 14:15:52.420195 run osmo-stp_10.42.42.5(pid=32345): stdout: | (launched: 2022-12-14_14:15:51.057536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:52.556824 run osmo-stp_10.42.42.5(pid=32345): stderr: | 20221214141551229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141551229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141551229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141551230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141551232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141551232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141551232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:52.694249 run osmo-stp_10.42.42.5(pid=32345): stdout: | (launched: 2022-12-14_14:15:51.057536) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:15:52.826393 run osmo-stp_10.42.42.5(pid=32345): stderr: | 20221214141551229 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141551229 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141551229 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141551230 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141551232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141551232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141551232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:15:52.983629 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32345): Process ended prematurely: osmo-stp_10.42.42.5(pid=32345) [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32345)] [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 14:15:52.992741 tst handover.py:18: Test FAILED (6.7 sec) 14:15:53.020455 run osmo-hlr_10.42.42.2(pid=32342): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32342)] 14:15:53.071445 run osmo-hlr_10.42.42.2(pid=32342): stdout: | (launched: 2022-12-14_14:15:50.122954) 14:15:53.123893 run osmo-hlr_10.42.42.2(pid=32342): stderr: | 20221214141550300 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141550300 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141550300 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141550300 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141550300 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141550300 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141550315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141550323 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141550324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141550324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:15:53.196637 run osmo-msc_10.42.42.6(pid=32349): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32349)] 14:15:53.246478 run osmo-msc_10.42.42.6(pid=32349): stdout: | (launched: 2022-12-14_14:15:52.026554) 14:15:53.298756 run osmo-msc_10.42.42.6(pid=32349): stderr: | 20221214141552349 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141552349 DLGLOBAL DEBUG validating counter group 0x7f80e3178c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141552350 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141552350 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141552350 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141552350 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141552352 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141552352 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141552352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141552352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:15:53.351159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32341): Terminating (SIGTERM) 14:15:53.392797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32344): Terminating (SIGTERM) 14:15:53.435325 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32347): Terminating (SIGTERM) 14:15:53.478039 --- ParallelTerminationStrategy: PID 32341 died... 14:15:53.498665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32341): Terminated: ok {rc=0} 14:15:53.545582 --- ParallelTerminationStrategy: PID 32344 died... 14:15:53.565442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32344): Terminated: ok {rc=0} 14:15:53.612058 --- ParallelTerminationStrategy: PID 32347 died... 14:15:53.632014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32347): Terminated: ok {rc=0} 14:15:53.721073 bus /sierra_3: Setting Powered False 14:15:54.819367 bus /sierra_3: Setting Powered False 14:15:55.936175 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 14:15:57.209146 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:15:57.214725 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:15:57.263440 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:15:57.290696 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:15:57.343877 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:15:57.391977 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:15:57.419231 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:15:57.972263 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 14:15:57.978045 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:57.989694 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 14:15:58.038753 tst handover.py: using LAC 41483 14:15:58.166566 tst handover.py: using RAC 173 14:15:58.294063 tst handover.py: using CellId 41483 14:15:58.423223 tst handover.py: using BVCI 41484 14:15:58.543461 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 14:15:58.580926 tst handover.py: using LAC 41484 14:15:58.709736 tst handover.py: using RAC 174 14:15:58.838561 tst handover.py: using CellId 41484 14:15:58.965414 tst handover.py: using BVCI 41485 14:15:59.078178 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:59.089447 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:59.100403 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:59.111440 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:59.123029 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:15:59.134641 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 14:15:59.254604 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 14:15:59.371730 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:15:59.824744 run create_hlr_db(pid=32355): Launched 14:15:59.951779 bus /sierra_2: Setting Powered False 14:16:01.028791 run create_hlr_db(pid=32355): Terminated: ok {rc=0} 14:16:01.526325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32357): Launched 14:16:01.875380 run osmo-hlr_10.42.42.2(pid=32358): Launched 14:16:02.214848 run osmo-stp_10.42.42.5: Starting osmo-stp 14:16:02.787734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32360): Launched 14:16:03.118717 run osmo-stp_10.42.42.5(pid=32361): Launched 14:16:03.246874 run osmo-msc_10.42.42.6: Starting osmo-msc 14:16:03.815404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32363): Launched 14:16:04.147367 run osmo-msc_10.42.42.6(pid=32364): Launched 14:16:04.332678 run osmo-stp_10.42.42.5(pid=32361): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32361)] 14:16:04.472218 run osmo-stp_10.42.42.5(pid=32361): stdout: | (launched: 2022-12-14_14:16:03.058150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:04.611876 run osmo-stp_10.42.42.5(pid=32361): stderr: | 20221214141603252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141603252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141603252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141603252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141603253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141603253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141603253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:04.750971 run osmo-stp_10.42.42.5(pid=32361): stdout: | (launched: 2022-12-14_14:16:03.058150) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:04.882793 run osmo-stp_10.42.42.5(pid=32361): stderr: | 20221214141603252 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141603252 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141603252 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141603252 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141603253 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141603253 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141603253 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:05.040254 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32361): Process ended prematurely: osmo-stp_10.42.42.5(pid=32361) [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32361)] [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 14:16:05.049402 tst handover.py:18: Test FAILED (7.1 sec) 14:16:05.076697 run osmo-hlr_10.42.42.2(pid=32358): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32358)] 14:16:05.127420 run osmo-hlr_10.42.42.2(pid=32358): stdout: | (launched: 2022-12-14_14:16:01.813138) 14:16:05.179178 run osmo-hlr_10.42.42.2(pid=32358): stderr: | 20221214141602072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141602072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141602072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141602072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141602072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141602072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141602085 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141602118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141602119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141602119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:16:05.251714 run osmo-msc_10.42.42.6(pid=32364): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32364)] 14:16:05.301275 run osmo-msc_10.42.42.6(pid=32364): stdout: | (launched: 2022-12-14_14:16:04.086976) 14:16:05.353405 run osmo-msc_10.42.42.6(pid=32364): stderr: | 20221214141604413 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141604413 DLGLOBAL DEBUG validating counter group 0x7f8ab6ba5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141604413 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141604414 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141604414 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141604414 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141604416 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141604416 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141604416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141604416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:16:05.405418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32357): Terminating (SIGTERM) 14:16:05.447664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32360): Terminating (SIGTERM) 14:16:05.489691 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32363): Terminating (SIGTERM) 14:16:05.532068 --- ParallelTerminationStrategy: PID 32357 died... 14:16:05.552649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32357): Terminated: ok {rc=0} 14:16:05.599086 --- ParallelTerminationStrategy: PID 32360 died... 14:16:05.618972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32360): Terminated: ok {rc=0} 14:16:05.665182 --- ParallelTerminationStrategy: PID 32363 died... 14:16:05.685032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32363): Terminated: ok {rc=0} 14:16:05.773669 bus /sierra_3: Setting Powered False 14:16:06.872448 bus /sierra_3: Setting Powered False 14:16:07.989575 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 14:16:09.249109 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:16:09.254779 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:16:09.316049 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:16:09.343376 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:16:09.398438 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:16:09.460375 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:16:09.487825 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:16:10.035751 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 14:16:10.042402 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:10.054663 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:16:10.100341 tst handover.py: using LAC 41485 14:16:10.230471 tst handover.py: using RAC 175 14:16:10.361287 tst handover.py: using CellId 41485 14:16:10.492143 tst handover.py: using BVCI 41486 14:16:10.612184 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:16:10.661363 tst handover.py: using LAC 41486 14:16:10.790251 tst handover.py: using RAC 176 14:16:10.920860 tst handover.py: using CellId 41486 14:16:11.054523 tst handover.py: using BVCI 41487 14:16:11.175490 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:11.187043 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:11.198407 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:11.209752 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:11.221355 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:11.232823 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:16:11.354677 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:16:11.470775 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:16:11.923554 run create_hlr_db(pid=32369): Launched 14:16:12.050392 bus /sierra_2: Setting Powered False 14:16:13.111943 run create_hlr_db(pid=32369): Terminated: ok {rc=0} 14:16:13.534933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32371): Launched 14:16:13.867611 run osmo-hlr_10.42.42.2(pid=32372): Launched 14:16:13.995955 run osmo-stp_10.42.42.5: Starting osmo-stp 14:16:14.537898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32374): Launched 14:16:14.869984 run osmo-stp_10.42.42.5(pid=32375): Launched 14:16:14.997603 run osmo-msc_10.42.42.6: Starting osmo-msc 14:16:15.566065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32377): Launched 14:16:15.905638 run osmo-msc_10.42.42.6(pid=32378): Launched 14:16:16.136161 run osmo-stp_10.42.42.5(pid=32375): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32375)] 14:16:16.523772 run osmo-stp_10.42.42.5(pid=32375): stdout: | (launched: 2022-12-14_14:16:14.809531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:16.684698 run osmo-stp_10.42.42.5(pid=32375): stderr: | 20221214141615006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141615006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141615007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141615007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141615007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141615008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141615008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:16.861398 run osmo-stp_10.42.42.5(pid=32375): stdout: | (launched: 2022-12-14_14:16:14.809531) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:16.991855 run osmo-stp_10.42.42.5(pid=32375): stderr: | 20221214141615006 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141615006 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141615007 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141615007 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141615007 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141615008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141615008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:17.142517 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32375): Process ended prematurely: osmo-stp_10.42.42.5(pid=32375) [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32375)] [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 14:16:17.152008 tst handover.py:18: Test FAILED (7.1 sec) 14:16:17.180535 run osmo-hlr_10.42.42.2(pid=32372): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32372)] 14:16:17.230075 run osmo-hlr_10.42.42.2(pid=32372): stdout: | (launched: 2022-12-14_14:16:13.807167) 14:16:17.282063 run osmo-hlr_10.42.42.2(pid=32372): stderr: | 20221214141614009 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141614009 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141614009 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141614009 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141614009 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141614009 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141614022 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141614030 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141614030 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141614030 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:16:17.354811 run osmo-msc_10.42.42.6(pid=32378): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32378)] 14:16:17.403246 run osmo-msc_10.42.42.6(pid=32378): stdout: | (launched: 2022-12-14_14:16:15.839773) 14:16:17.453821 run osmo-msc_10.42.42.6(pid=32378): stderr: | 20221214141616474 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141616474 DLGLOBAL DEBUG validating counter group 0x7ffb55b82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141616474 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141616474 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141616474 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141616474 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141616476 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141616476 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141616477 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141616477 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:16:17.504383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32371): Terminating (SIGTERM) 14:16:17.543903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32374): Terminating (SIGTERM) 14:16:17.588332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32377): Terminating (SIGTERM) 14:16:17.631162 --- ParallelTerminationStrategy: PID 32371 died... 14:16:17.652096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32371): Terminated: ok {rc=0} 14:16:17.698968 --- ParallelTerminationStrategy: PID 32374 died... 14:16:17.719383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32374): Terminated: ok {rc=0} 14:16:17.766076 --- ParallelTerminationStrategy: PID 32377 died... 14:16:17.786577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32377): Terminated: ok {rc=0} 14:16:17.874649 bus /sierra_3: Setting Powered False 14:16:18.972174 bus /sierra_3: Setting Powered False 14:16:20.087352 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 14:16:21.363075 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:16:21.368724 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:16:21.429228 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:16:21.457132 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:16:21.511361 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:16:21.571707 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:16:21.599210 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:16:22.151978 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 14:16:22.157762 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:22.169600 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:16:22.218745 tst handover.py: using LAC 41487 14:16:22.348077 tst handover.py: using RAC 177 14:16:22.479046 tst handover.py: using CellId 41487 14:16:22.607833 tst handover.py: using BVCI 41488 14:16:22.729592 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:16:22.777346 tst handover.py: using LAC 41488 14:16:22.901860 tst handover.py: using RAC 178 14:16:23.032153 tst handover.py: using CellId 41488 14:16:23.160560 tst handover.py: using BVCI 41489 14:16:23.273404 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:23.284545 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:23.295327 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:23.306359 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:23.317409 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:23.328389 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:16:23.443517 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:16:23.565630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:16:24.021378 run create_hlr_db(pid=32383): Launched 14:16:24.149140 bus /sierra_2: Setting Powered False 14:16:25.211192 run create_hlr_db(pid=32383): Terminated: ok {rc=0} 14:16:25.635489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32385): Launched 14:16:25.968049 run osmo-hlr_10.42.42.2(pid=32386): Launched 14:16:26.094961 run osmo-stp_10.42.42.5: Starting osmo-stp 14:16:26.638078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32388): Launched 14:16:26.969429 run osmo-stp_10.42.42.5(pid=32389): Launched 14:16:27.098415 run osmo-msc_10.42.42.6: Starting osmo-msc 14:16:27.668376 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32391): Launched 14:16:28.000221 run osmo-msc_10.42.42.6(pid=32392): Launched 14:16:28.184601 run osmo-stp_10.42.42.5(pid=32389): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32389)] 14:16:28.323746 run osmo-stp_10.42.42.5(pid=32389): stdout: | (launched: 2022-12-14_14:16:26.908727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:28.464318 run osmo-stp_10.42.42.5(pid=32389): stderr: | 20221214141627101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141627101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141627102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141627102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141627104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141627104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141627104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:28.603650 run osmo-stp_10.42.42.5(pid=32389): stdout: | (launched: 2022-12-14_14:16:26.908727) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:28.735778 run osmo-stp_10.42.42.5(pid=32389): stderr: | 20221214141627101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141627101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141627102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141627102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141627104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141627104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141627104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:28.893776 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32389): Process ended prematurely: osmo-stp_10.42.42.5(pid=32389) [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32389)] [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 14:16:28.902849 tst handover.py:18: Test FAILED (6.7 sec) 14:16:28.930588 run osmo-hlr_10.42.42.2(pid=32386): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32386)] 14:16:28.982196 run osmo-hlr_10.42.42.2(pid=32386): stdout: | (launched: 2022-12-14_14:16:25.906901) 14:16:29.034574 run osmo-hlr_10.42.42.2(pid=32386): stderr: | 20221214141626105 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141626105 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141626105 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141626105 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141626105 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141626105 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141626118 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141626126 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141626126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141626126 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:16:29.108008 run osmo-msc_10.42.42.6(pid=32392): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32392)] 14:16:29.158144 run osmo-msc_10.42.42.6(pid=32392): stdout: | (launched: 2022-12-14_14:16:27.939470) 14:16:29.210231 run osmo-msc_10.42.42.6(pid=32392): stderr: | 20221214141628263 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141628263 DLGLOBAL DEBUG validating counter group 0x7ff811c0dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141628263 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141628263 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141628264 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141628264 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141628266 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141628266 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141628266 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141628266 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:16:29.262630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32385): Terminating (SIGTERM) 14:16:29.304330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32388): Terminating (SIGTERM) 14:16:29.346289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32391): Terminating (SIGTERM) 14:16:29.388220 --- ParallelTerminationStrategy: PID 32385 died... 14:16:29.408743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32385): Terminated: ok {rc=0} 14:16:29.455908 --- ParallelTerminationStrategy: PID 32388 died... 14:16:29.476189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32388): Terminated: ok {rc=0} 14:16:29.523379 --- ParallelTerminationStrategy: PID 32391 died... 14:16:29.543885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32391): Terminated: ok {rc=0} 14:16:29.633587 bus /sierra_3: Setting Powered False 14:16:30.732218 bus /sierra_3: Setting Powered False 14:16:31.854597 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 14:16:33.124720 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:16:33.130331 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 14:16:33.183289 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 14:16:33.210511 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 14:16:33.263675 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 14:16:33.315300 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 14:16:33.341907 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 14:16:33.893904 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 14:16:33.898972 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:16:33.910007 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 14:16:33.958630 tst handover.py: using LAC 41489 14:16:34.080166 tst handover.py: using RAC 179 14:16:34.203640 tst handover.py: using CellId 41489 14:16:34.329814 tst handover.py: using BVCI 41490 14:16:34.442892 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 14:16:34.476749 tst handover.py: using LAC 41490 14:16:34.595988 tst handover.py: using RAC 180 14:16:34.714274 tst handover.py: using CellId 41490 14:16:34.838001 tst handover.py: using BVCI 41491 14:16:34.950917 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:16:34.961939 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:16:34.972674 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:16:34.983413 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:16:34.994262 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 14:16:35.005060 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 14:16:35.120237 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 14:16:35.235892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:16:35.689971 run create_hlr_db(pid=32397): Launched 14:16:35.817686 bus /sierra_2: Setting Powered False 14:16:36.879167 run create_hlr_db(pid=32397): Terminated: ok {rc=0} 14:16:37.301234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32399): Launched 14:16:37.634018 run osmo-hlr_10.42.42.2(pid=32400): Launched 14:16:37.762547 run osmo-stp_10.42.42.5: Starting osmo-stp 14:16:38.303030 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32402): Launched 14:16:38.637091 run osmo-stp_10.42.42.5(pid=32403): Launched 14:16:38.763409 run osmo-msc_10.42.42.6: Starting osmo-msc 14:16:39.332382 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32405): Launched 14:16:39.666281 run osmo-msc_10.42.42.6(pid=32406): Launched 14:16:39.851998 run osmo-stp_10.42.42.5(pid=32403): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32403)] 14:16:39.993282 run osmo-stp_10.42.42.5(pid=32403): stdout: | (launched: 2022-12-14_14:16:38.576224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:40.133433 run osmo-stp_10.42.42.5(pid=32403): stderr: | 20221214141638771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141638771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141638771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141638772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141638774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141638774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141638774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:40.272129 run osmo-stp_10.42.42.5(pid=32403): stdout: | (launched: 2022-12-14_14:16:38.576224) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:40.404421 run osmo-stp_10.42.42.5(pid=32403): stderr: | 20221214141638771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141638771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141638771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141638772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141638774 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141638774 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141638774 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:40.562989 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32403): Process ended prematurely: osmo-stp_10.42.42.5(pid=32403) [trial-2405↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32403)] [trial-2405↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 14:16:40.572142 tst handover.py:18: Test FAILED (6.7 sec) 14:16:40.599910 run osmo-hlr_10.42.42.2(pid=32400): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32400)] 14:16:40.651057 run osmo-hlr_10.42.42.2(pid=32400): stdout: | (launched: 2022-12-14_14:16:37.573293) 14:16:40.703697 run osmo-hlr_10.42.42.2(pid=32400): stderr: | 20221214141637775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141637775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141637776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141637776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141637776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141637776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141637831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141637840 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141637841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141637841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:16:40.777155 run osmo-msc_10.42.42.6(pid=32406): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32406)] 14:16:40.827267 run osmo-msc_10.42.42.6(pid=32406): stdout: | (launched: 2022-12-14_14:16:39.605617) 14:16:40.879603 run osmo-msc_10.42.42.6(pid=32406): stderr: | 20221214141639927 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141639927 DLGLOBAL DEBUG validating counter group 0x7fd4eac52c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141639927 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141639927 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141639927 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141639928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141639929 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141639930 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141639930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141639930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:16:40.932507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32399): Terminating (SIGTERM) 14:16:40.974901 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32402): Terminating (SIGTERM) 14:16:41.017665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32405): Terminating (SIGTERM) 14:16:41.060528 --- ParallelTerminationStrategy: PID 32399 died... 14:16:41.081103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32399): Terminated: ok {rc=0} 14:16:41.127802 --- ParallelTerminationStrategy: PID 32402 died... 14:16:41.147856 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32402): Terminated: ok {rc=0} 14:16:41.194965 --- ParallelTerminationStrategy: PID 32405 died... 14:16:41.215168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32405): Terminated: ok {rc=0} 14:16:41.303232 bus /sierra_3: Setting Powered False 14:16:42.402431 bus /sierra_3: Setting Powered False 14:16:43.522714 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 14:16:44.779339 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:16:44.784403 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:16:44.847031 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:16:44.873426 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:16:44.924612 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:16:44.991859 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:16:45.018347 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:16:45.566997 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 14:16:45.572396 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:45.583652 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:16:45.632463 tst handover.py: using LAC 41491 14:16:45.763511 tst handover.py: using RAC 181 14:16:45.899680 tst handover.py: using CellId 41491 14:16:46.035750 tst handover.py: using BVCI 41492 14:16:46.213974 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:16:46.265147 tst handover.py: using LAC 41492 14:16:46.410880 tst handover.py: using RAC 182 14:16:46.567302 tst handover.py: using CellId 41492 14:16:46.696918 tst handover.py: using BVCI 41493 14:16:46.852667 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:46.868340 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:46.883736 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:46.897669 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:46.911242 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:16:46.923493 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:16:47.050426 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:16:47.191223 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:16:47.652797 run create_hlr_db(pid=32411): Launched 14:16:47.781323 bus /sierra_2: Setting Powered False 14:16:48.842625 run create_hlr_db(pid=32411): Terminated: ok {rc=0} 14:16:49.246119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32413): Launched 14:16:49.557989 run osmo-hlr_10.42.42.2(pid=32414): Launched 14:16:49.676776 run osmo-stp_10.42.42.5: Starting osmo-stp 14:16:50.194893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32416): Launched 14:16:50.504534 run osmo-stp_10.42.42.5(pid=32417): Launched 14:16:50.622520 run osmo-msc_10.42.42.6: Starting osmo-msc 14:16:51.152817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32419): Launched 14:16:51.462154 run osmo-msc_10.42.42.6(pid=32420): Launched 14:16:51.636286 run osmo-stp_10.42.42.5(pid=32417): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32417)] 14:16:51.766808 run osmo-stp_10.42.42.5(pid=32417): stdout: | (launched: 2022-12-14_14:16:50.447432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:51.896326 run osmo-stp_10.42.42.5(pid=32417): stderr: | 20221214141650623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141650623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141650623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141650623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141650624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141650624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141650624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:52.024255 run osmo-stp_10.42.42.5(pid=32417): stdout: | (launched: 2022-12-14_14:16:50.447432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:16:52.146978 run osmo-stp_10.42.42.5(pid=32417): stderr: | 20221214141650623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141650623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141650623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141650623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141650624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141650624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141650624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:16:52.294249 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32417): Process ended prematurely: osmo-stp_10.42.42.5(pid=32417) [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32417)] [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 14:16:52.302523 tst handover.py:18: Test FAILED (6.7 sec) 14:16:52.328671 run osmo-hlr_10.42.42.2(pid=32414): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32414)] 14:16:52.376788 run osmo-hlr_10.42.42.2(pid=32414): stdout: | (launched: 2022-12-14_14:16:49.501126) 14:16:52.425735 run osmo-hlr_10.42.42.2(pid=32414): stderr: | 20221214141649677 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141649677 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141649677 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141649677 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141649677 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141649677 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141649689 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141649697 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141649697 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141649697 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:16:52.494056 run osmo-msc_10.42.42.6(pid=32420): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32420)] 14:16:52.541346 run osmo-msc_10.42.42.6(pid=32420): stdout: | (launched: 2022-12-14_14:16:51.404987) 14:16:52.590022 run osmo-msc_10.42.42.6(pid=32420): stderr: | 20221214141651680 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141651680 DLGLOBAL DEBUG validating counter group 0x7f8cfae30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141651680 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141651680 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141651680 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141651680 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141651682 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141651682 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141651683 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141651683 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:16:52.639246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32413): Terminating (SIGTERM) 14:16:52.678425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32416): Terminating (SIGTERM) 14:16:52.717557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32419): Terminating (SIGTERM) 14:16:52.756856 --- ParallelTerminationStrategy: PID 32413 died... 14:16:52.775667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32413): Terminated: ok {rc=0} 14:16:52.819483 --- ParallelTerminationStrategy: PID 32416 died... 14:16:52.838019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32416): Terminated: ok {rc=0} 14:16:52.881368 --- ParallelTerminationStrategy: PID 32419 died... 14:16:52.899808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32419): Terminated: ok {rc=0} 14:16:52.985602 bus /sierra_3: Setting Powered False 14:16:54.085083 bus /sierra_3: Setting Powered False 14:16:55.199514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 14:16:56.473455 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:16:56.478575 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:16:56.540273 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:16:56.566541 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:16:56.617786 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:16:56.680374 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:16:56.706677 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:16:57.258757 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 14:16:57.264213 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:57.275528 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:16:57.323782 tst handover.py: using LAC 41493 14:16:57.449288 tst handover.py: using RAC 183 14:16:57.570250 tst handover.py: using CellId 41493 14:16:57.690322 tst handover.py: using BVCI 41494 14:16:57.804487 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:16:57.852033 tst handover.py: using LAC 41494 14:16:57.980719 tst handover.py: using RAC 184 14:16:58.108742 tst handover.py: using CellId 41494 14:16:58.236401 tst handover.py: using BVCI 41495 14:16:58.356830 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:58.368299 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:58.379644 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:58.391004 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:58.403212 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:16:58.415249 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:16:58.532524 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:16:58.652410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:16:59.137424 run create_hlr_db(pid=32425): Launched 14:16:59.263883 bus /sierra_2: Setting Powered False 14:17:00.329884 run create_hlr_db(pid=32425): Terminated: ok {rc=0} 14:17:00.744327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32427): Launched 14:17:01.058607 run osmo-hlr_10.42.42.2(pid=32428): Launched 14:17:01.391593 run osmo-stp_10.42.42.5: Starting osmo-stp 14:17:02.011606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32433): Launched 14:17:02.369519 run osmo-stp_10.42.42.5(pid=32434): Launched 14:17:02.507161 run osmo-msc_10.42.42.6: Starting osmo-msc 14:17:03.080067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32436): Launched 14:17:03.413835 run osmo-msc_10.42.42.6(pid=32437): Launched 14:17:03.602025 run osmo-stp_10.42.42.5(pid=32434): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32434)] 14:17:03.741704 run osmo-stp_10.42.42.5(pid=32434): stdout: | (launched: 2022-12-14_14:17:02.307777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:17:03.881801 run osmo-stp_10.42.42.5(pid=32434): stderr: | 20221214141702521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141702521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141702522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141702522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141702522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141702522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141702523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:17:04.019835 run osmo-stp_10.42.42.5(pid=32434): stdout: | (launched: 2022-12-14_14:17:02.307777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:17:04.152357 run osmo-stp_10.42.42.5(pid=32434): stderr: | 20221214141702521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141702521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141702522 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141702522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141702522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141702522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141702523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:17:04.310805 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32434): Process ended prematurely: osmo-stp_10.42.42.5(pid=32434) [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32434)] [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 14:17:04.319437 tst handover.py:18: Test FAILED (7.0 sec) 14:17:04.347083 run osmo-hlr_10.42.42.2(pid=32428): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32428)] 14:17:04.407702 run osmo-hlr_10.42.42.2(pid=32428): stdout: | (launched: 2022-12-14_14:17:01.000353) 14:17:04.457354 run osmo-hlr_10.42.42.2(pid=32428): stderr: | 20221214141701371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141701371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141701371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141701371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141701371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141701371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141701408 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141701431 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141701431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141701431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:17:04.526607 run osmo-msc_10.42.42.6(pid=32437): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32437)] 14:17:04.574711 run osmo-msc_10.42.42.6(pid=32437): stdout: | (launched: 2022-12-14_14:17:03.352648) 14:17:04.624797 run osmo-msc_10.42.42.6(pid=32437): stderr: | 20221214141703678 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141703678 DLGLOBAL DEBUG validating counter group 0x7f9e105e6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141703678 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141703678 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141703679 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141703679 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141703680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141703681 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141703681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141703681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:17:04.674453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32427): Terminating (SIGTERM) 14:17:04.713819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32433): Terminating (SIGTERM) 14:17:04.753243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32436): Terminating (SIGTERM) 14:17:04.796308 --- ParallelTerminationStrategy: PID 32427 died... 14:17:04.818158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32427): Terminated: ok {rc=0} 14:17:04.861779 --- ParallelTerminationStrategy: PID 32433 died... 14:17:04.880287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32433): Terminated: ok {rc=0} 14:17:04.923519 --- ParallelTerminationStrategy: PID 32436 died... 14:17:04.942064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32436): Terminated: ok {rc=0} 14:17:05.025120 bus /sierra_3: Setting Powered False 14:17:06.122407 bus /sierra_3: Setting Powered False 14:17:07.239278 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 14:17:08.521228 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:17:08.527190 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 14:17:08.579678 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 14:17:08.606868 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 14:17:08.657637 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 14:17:08.709695 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 14:17:08.737119 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 14:17:09.291084 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 14:17:09.296247 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:17:09.307352 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:17:09.340424 tst handover.py: using LAC 41495 14:17:09.470327 tst handover.py: using RAC 185 14:17:09.598371 tst handover.py: using CellId 41495 14:17:09.725595 tst handover.py: using BVCI 41496 14:17:09.839697 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 14:17:09.887309 tst handover.py: using LAC 41496 14:17:10.006700 tst handover.py: using RAC 186 14:17:10.127519 tst handover.py: using CellId 41496 14:17:10.247073 tst handover.py: using BVCI 41497 14:17:10.360034 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:17:10.370911 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:17:10.381533 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:17:10.392076 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:17:10.402764 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 14:17:10.413322 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:17:10.535349 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 14:17:10.652544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:17:11.104803 run create_hlr_db(pid=32447): Launched 14:17:11.231313 bus /sierra_2: Setting Powered False 14:17:12.292856 run create_hlr_db(pid=32447): Terminated: ok {rc=0} 14:17:12.697543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32449): Launched 14:17:13.006117 run osmo-hlr_10.42.42.2(pid=32450): Launched 14:17:13.124253 run osmo-stp_10.42.42.5: Starting osmo-stp 14:17:13.630212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32452): Launched 14:17:13.942280 run osmo-stp_10.42.42.5(pid=32453): Launched 14:17:14.062053 run osmo-msc_10.42.42.6: Starting osmo-msc 14:17:14.595493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32455): Launched 14:17:14.905411 run osmo-msc_10.42.42.6(pid=32456): Launched 14:17:15.077594 run osmo-stp_10.42.42.5(pid=32453): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32453)] 14:17:15.208325 run osmo-stp_10.42.42.5(pid=32453): stdout: | (launched: 2022-12-14_14:17:13.884818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:17:15.338422 run osmo-stp_10.42.42.5(pid=32453): stderr: | 20221214141714059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141714059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141714059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141714060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141714060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141714060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141714060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:17:15.466597 run osmo-stp_10.42.42.5(pid=32453): stdout: | (launched: 2022-12-14_14:17:13.884818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:17:15.589454 run osmo-stp_10.42.42.5(pid=32453): stderr: | 20221214141714059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141714059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141714059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141714060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141714060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141714060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141714060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:17:15.736264 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32453): Process ended prematurely: osmo-stp_10.42.42.5(pid=32453) [trial-2405↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32453)] [trial-2405↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 14:17:15.744588 tst handover.py:18: Test FAILED (6.4 sec) 14:17:15.770696 run osmo-hlr_10.42.42.2(pid=32450): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32450)] 14:17:15.818614 run osmo-hlr_10.42.42.2(pid=32450): stdout: | (launched: 2022-12-14_14:17:12.948825) 14:17:15.878973 run osmo-hlr_10.42.42.2(pid=32450): stderr: | 20221214141713127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141713127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141713127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141713127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141713127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141713127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141713140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141713148 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141713149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141713149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:17:15.962656 run osmo-msc_10.42.42.6(pid=32456): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32456)] 14:17:16.017204 run osmo-msc_10.42.42.6(pid=32456): stdout: | (launched: 2022-12-14_14:17:14.848309) 14:17:16.072013 run osmo-msc_10.42.42.6(pid=32456): stderr: | 20221214141715123 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141715124 DLGLOBAL DEBUG validating counter group 0x7f4687c2ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141715124 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141715124 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141715124 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141715124 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141715126 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141715126 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141715126 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141715127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:17:16.127054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32449): Terminating (SIGTERM) 14:17:16.171165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32452): Terminating (SIGTERM) 14:17:16.218604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32455): Terminating (SIGTERM) 14:17:16.266325 --- ParallelTerminationStrategy: PID 32449 died... 14:17:16.288628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32449): Terminated: ok {rc=0} 14:17:16.339216 --- ParallelTerminationStrategy: PID 32452 died... 14:17:16.360755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32452): Terminated: ok {rc=0} 14:17:16.410883 --- ParallelTerminationStrategy: PID 32455 died... 14:17:16.431939 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32455): Terminated: ok {rc=0} 14:17:16.525226 bus /sierra_3: Setting Powered False 14:17:17.626872 bus /sierra_3: Setting Powered False 14:17:18.743311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 14:17:20.001714 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:17:20.007485 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:17:20.059250 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:17:20.086418 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:17:20.139636 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:17:20.189270 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:17:20.215744 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:17:20.769631 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 14:17:20.775039 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:20.786408 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:17:20.821096 tst handover.py: using LAC 41497 14:17:20.942208 tst handover.py: using RAC 187 14:17:21.064420 tst handover.py: using CellId 41497 14:17:21.185449 tst handover.py: using BVCI 41498 14:17:21.298388 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:17:21.357243 tst handover.py: using LAC 41498 14:17:21.497025 tst handover.py: using RAC 188 14:17:21.627490 tst handover.py: using CellId 41498 14:17:21.755501 tst handover.py: using BVCI 41499 14:17:21.875793 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:21.887299 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:21.898462 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:21.909557 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:21.921585 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:21.933426 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:17:22.052827 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:17:22.174205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:17:22.630070 run create_hlr_db(pid=32461): Launched 14:17:22.759830 bus /sierra_2: Setting Powered False 14:17:23.820814 run create_hlr_db(pid=32461): Terminated: ok {rc=0} 14:17:24.244747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32463): Launched 14:17:24.579043 run osmo-hlr_10.42.42.2(pid=32464): Launched 14:17:24.707446 run osmo-stp_10.42.42.5: Starting osmo-stp 14:17:25.251547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32466): Launched 14:17:25.585940 run osmo-stp_10.42.42.5(pid=32467): Launched 14:17:25.714263 run osmo-msc_10.42.42.6: Starting osmo-msc 14:17:26.284869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32469): Launched 14:17:26.618690 run osmo-msc_10.42.42.6(pid=32470): Launched 14:17:26.805628 run osmo-stp_10.42.42.5(pid=32467): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32467)] 14:17:26.945761 run osmo-stp_10.42.42.5(pid=32467): stdout: | (launched: 2022-12-14_14:17:25.525087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:17:27.086623 run osmo-stp_10.42.42.5(pid=32467): stderr: | 20221214141725719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141725719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141725719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141725720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141725722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141725722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141725722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:17:27.225049 run osmo-stp_10.42.42.5(pid=32467): stdout: | (launched: 2022-12-14_14:17:25.525087) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:17:27.358090 run osmo-stp_10.42.42.5(pid=32467): stderr: | 20221214141725719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141725719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141725719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141725720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141725722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141725722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141725722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:17:27.516834 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32467): Process ended prematurely: osmo-stp_10.42.42.5(pid=32467) [trial-2405↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32467)] [trial-2405↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 14:17:27.525889 tst handover.py:18: Test FAILED (6.7 sec) 14:17:27.553509 run osmo-hlr_10.42.42.2(pid=32464): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32464)] 14:17:27.604806 run osmo-hlr_10.42.42.2(pid=32464): stdout: | (launched: 2022-12-14_14:17:24.517851) 14:17:27.657305 run osmo-hlr_10.42.42.2(pid=32464): stderr: | 20221214141724720 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141724720 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141724720 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141724720 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141724720 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141724720 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141724733 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141724741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141724742 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141724742 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:17:27.730517 run osmo-msc_10.42.42.6(pid=32470): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32470)] 14:17:27.780609 run osmo-msc_10.42.42.6(pid=32470): stdout: | (launched: 2022-12-14_14:17:26.557866) 14:17:27.832717 run osmo-msc_10.42.42.6(pid=32470): stderr: | 20221214141726880 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141726880 DLGLOBAL DEBUG validating counter group 0x7f08218dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141726880 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141726880 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141726881 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141726881 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141726882 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141726883 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141726883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141726883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:17:27.885373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32463): Terminating (SIGTERM) 14:17:27.927904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32466): Terminating (SIGTERM) 14:17:27.970393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32469): Terminating (SIGTERM) 14:17:28.013328 --- ParallelTerminationStrategy: PID 32463 died... 14:17:28.033866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32463): Terminated: ok {rc=0} 14:17:28.080906 --- ParallelTerminationStrategy: PID 32466 died... 14:17:28.101107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32466): Terminated: ok {rc=0} 14:17:28.147890 --- ParallelTerminationStrategy: PID 32469 died... 14:17:28.168157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32469): Terminated: ok {rc=0} 14:17:28.257864 bus /sierra_3: Setting Powered False 14:17:29.354033 bus /sierra_3: Setting Powered False 14:17:30.467822 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2405 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 14:17:31.732204 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:17:31.738099 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 14:17:31.803540 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:17:31.831199 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 14:17:31.892836 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 14:17:31.987919 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:17:32.016219 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 14:17:32.525434 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2405 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 14:17:32.532758 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:32.544268 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:17:32.592416 tst handover.py: using LAC 41499 14:17:32.713054 tst handover.py: using RAC 189 14:17:32.833598 tst handover.py: using CellId 41499 14:17:32.954944 tst handover.py: using BVCI 41500 14:17:33.078891 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 14:17:33.130632 tst handover.py: using LAC 41500 14:17:33.260030 tst handover.py: using RAC 190 14:17:33.388026 tst handover.py: using CellId 41500 14:17:33.516932 tst handover.py: using BVCI 41501 14:17:33.637503 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:33.648862 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:33.660077 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:33.671278 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:33.683167 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 14:17:33.695088 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:17:33.814046 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 14:17:33.936120 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:17:34.422115 run create_hlr_db(pid=32475): Launched 14:17:34.548812 bus /sierra_2: Setting Powered False 14:17:35.614072 run create_hlr_db(pid=32475): Terminated: ok {rc=0} 14:17:36.030079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32477): Launched 14:17:36.344238 run osmo-hlr_10.42.42.2(pid=32478): Launched 14:17:36.463036 run osmo-stp_10.42.42.5: Starting osmo-stp 14:17:37.007130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32480): Launched 14:17:37.338376 run osmo-stp_10.42.42.5(pid=32481): Launched 14:17:37.466411 run osmo-msc_10.42.42.6: Starting osmo-msc 14:17:38.035616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32483): Launched 14:17:38.368324 run osmo-msc_10.42.42.6(pid=32484): Launched 14:17:38.553518 run osmo-stp_10.42.42.5(pid=32481): ERR: Terminated: ERROR {rc=1} [trial-2405↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32481)] 14:17:38.692025 run osmo-stp_10.42.42.5(pid=32481): stdout: | (launched: 2022-12-14_14:17:37.277865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:17:38.831341 run osmo-stp_10.42.42.5(pid=32481): stderr: | 20221214141737474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141737474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141737474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141737475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141737475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141737475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141737475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:17:38.970504 run osmo-stp_10.42.42.5(pid=32481): stdout: | (launched: 2022-12-14_14:17:37.277865) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:17:39.102183 run osmo-stp_10.42.42.5(pid=32481): stderr: | 20221214141737474 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214141737474 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214141737474 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214141737475 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214141737475 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214141737475 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214141737475 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:17:39.259747 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=32481): Process ended prematurely: osmo-stp_10.42.42.5(pid=32481) [trial-2405↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32481)] [trial-2405↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 14:17:39.268505 tst handover.py:18: Test FAILED (6.7 sec) 14:17:39.296181 run osmo-hlr_10.42.42.2(pid=32478): ERR: Terminated: ERROR {rc=237} [trial-2405↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32478)] 14:17:39.346891 run osmo-hlr_10.42.42.2(pid=32478): stdout: | (launched: 2022-12-14_14:17:36.286656) 14:17:39.398891 run osmo-hlr_10.42.42.2(pid=32478): stderr: | 20221214141736467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214141736467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214141736467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214141736467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214141736467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214141736467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214141736487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214141736496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214141736497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214141736497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:17:39.471081 run osmo-msc_10.42.42.6(pid=32484): ERR: Terminated: ERROR {rc=2} [trial-2405↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32484)] 14:17:39.521277 run osmo-msc_10.42.42.6(pid=32484): stdout: | (launched: 2022-12-14_14:17:38.307685) 14:17:39.573300 run osmo-msc_10.42.42.6(pid=32484): stderr: | 20221214141738632 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214141738632 DLGLOBAL DEBUG validating counter group 0x7f93d2729c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214141738632 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214141738632 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214141738633 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214141738633 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214141738634 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214141738635 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214141738635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214141738635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:17:39.625772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32477): Terminating (SIGTERM) 14:17:39.667635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32480): Terminating (SIGTERM) 14:17:39.709737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32483): Terminating (SIGTERM) 14:17:39.752076 --- ParallelTerminationStrategy: PID 32477 died... 14:17:39.772645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32477): Terminated: ok {rc=0} 14:17:39.819300 --- ParallelTerminationStrategy: PID 32480 died... 14:17:39.839115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32480): Terminated: ok {rc=0} 14:17:39.886170 --- ParallelTerminationStrategy: PID 32483 died... 14:17:39.906441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32483): Terminated: ok {rc=0} 14:17:39.995533 bus /sierra_3: Setting Powered False 14:17:41.094122 bus /sierra_3: Setting Powered False 14:17:42.209895 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2405 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 14:17:43.486304 tst trial-2405: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405/run.2022-12-14_12-53-19/trial-2405.xml -------------------------------------------------------------------------------------------- trial-2405 FAIL -------------------------------------------------------------------------------------------- 14:17:45.426468 tst trial-2405: trial-2405: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=24313): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24313) [trial-2405↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24313)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.5 sec) Error: osmo-stp_10.42.42.5(pid=24324): Process ended prematurely: osmo-stp_10.42.42.5(pid=24324) [trial-2405↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24324)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=24335): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24335) [trial-2405↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24335)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24346): Process ended prematurely: osmo-stp_10.42.42.5(pid=24346) [trial-2405↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24346)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24360): Process ended prematurely: osmo-stp_10.42.42.5(pid=24360) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24360)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24371): Process ended prematurely: osmo-stp_10.42.42.5(pid=24371) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24371)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24385): Process ended prematurely: osmo-stp_10.42.42.5(pid=24385) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24385)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24396): Process ended prematurely: osmo-stp_10.42.42.5(pid=24396) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24396)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24410): Process ended prematurely: osmo-stp_10.42.42.5(pid=24410) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24410)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24421): Process ended prematurely: osmo-stp_10.42.42.5(pid=24421) [trial-2405↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24421)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24435): Process ended prematurely: osmo-stp_10.42.42.5(pid=24435) [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24435)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24446): Process ended prematurely: osmo-stp_10.42.42.5(pid=24446) [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24446)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24460): Process ended prematurely: osmo-stp_10.42.42.5(pid=24460) [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24460)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24471): Process ended prematurely: osmo-stp_10.42.42.5(pid=24471) [trial-2405↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24471)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24485): Process ended prematurely: osmo-stp_10.42.42.5(pid=24485) [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24485)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=24496): Process ended prematurely: osmo-stp_10.42.42.5(pid=24496) [trial-2405↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24496)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24512): Process ended prematurely: osmo-stp_10.42.42.5(pid=24512) [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24512)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24523): Process ended prematurely: osmo-stp_10.42.42.5(pid=24523) [trial-2405↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24523)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24537): Process ended prematurely: osmo-stp_10.42.42.5(pid=24537) [trial-2405↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24537)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24548): Process ended prematurely: osmo-stp_10.42.42.5(pid=24548) [trial-2405↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24548)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.0 sec) Error: osmo-stp_10.42.42.5(pid=24566): Process ended prematurely: osmo-stp_10.42.42.5(pid=24566) [trial-2405↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24566)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24578): Process ended prematurely: osmo-stp_10.42.42.5(pid=24578) [trial-2405↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24578)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=24597): Process ended prematurely: osmo-stp_10.42.42.5(pid=24597) [trial-2405↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24597)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24607): Process ended prematurely: osmo-stp_10.42.42.5(pid=24607) [trial-2405↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24607)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24620): Process ended prematurely: osmo-stp_10.42.42.5(pid=24620) [trial-2405↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24620)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=24638): Process ended prematurely: osmo-stp_10.42.42.5(pid=24638) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24638)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24650): Process ended prematurely: osmo-stp_10.42.42.5(pid=24650) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24650)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=24668): Process ended prematurely: osmo-stp_10.42.42.5(pid=24668) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24668)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24680): Process ended prematurely: osmo-stp_10.42.42.5(pid=24680) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24680)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24690): Process ended prematurely: osmo-stp_10.42.42.5(pid=24690) [trial-2405↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24690)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=24707): Process ended prematurely: osmo-stp_10.42.42.5(pid=24707) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24707)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=24719): Process ended prematurely: osmo-stp_10.42.42.5(pid=24719) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24719)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=24737): Process ended prematurely: osmo-stp_10.42.42.5(pid=24737) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24737)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24747): Process ended prematurely: osmo-stp_10.42.42.5(pid=24747) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24747)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24757): Process ended prematurely: osmo-stp_10.42.42.5(pid=24757) [trial-2405↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24757)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=24775): Process ended prematurely: osmo-stp_10.42.42.5(pid=24775) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24775)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=24788): Process ended prematurely: osmo-stp_10.42.42.5(pid=24788) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24788)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=24806): Process ended prematurely: osmo-stp_10.42.42.5(pid=24806) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24806)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=24816): Process ended prematurely: osmo-stp_10.42.42.5(pid=24816) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24816)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=24827): Process ended prematurely: osmo-stp_10.42.42.5(pid=24827) [trial-2405↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24827)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24841): Process ended prematurely: osmo-stp_10.42.42.5(pid=24841) [trial-2405↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24841)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24854): Process ended prematurely: osmo-stp_10.42.42.5(pid=24854) [trial-2405↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24854)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=24862): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24862) [trial-2405↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24862)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=24872): Process ended prematurely: osmo-stp_10.42.42.5(pid=24872) [trial-2405↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24872)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=24881): Process ended prematurely: osmo-nitb_10.42.42.2(pid=24881) [trial-2405↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=24881)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=24891): Process ended prematurely: osmo-stp_10.42.42.5(pid=24891) [trial-2405↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24891)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24905): Process ended prematurely: osmo-stp_10.42.42.5(pid=24905) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24905)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=24916): Process ended prematurely: osmo-stp_10.42.42.5(pid=24916) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24916)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24931): Process ended prematurely: osmo-stp_10.42.42.5(pid=24931) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24931)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24942): Process ended prematurely: osmo-stp_10.42.42.5(pid=24942) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24942)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=24956): Process ended prematurely: osmo-stp_10.42.42.5(pid=24956) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24956)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=24967): Process ended prematurely: osmo-stp_10.42.42.5(pid=24967) [trial-2405↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24967)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=24984): Process ended prematurely: osmo-stp_10.42.42.5(pid=24984) [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24984)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=24996): Process ended prematurely: osmo-stp_10.42.42.5(pid=24996) [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=24996)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25010): Process ended prematurely: osmo-stp_10.42.42.5(pid=25010) [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25010)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25021): Process ended prematurely: osmo-stp_10.42.42.5(pid=25021) [trial-2405↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25021)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25035): Process ended prematurely: osmo-stp_10.42.42.5(pid=25035) [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25035)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25046): Process ended prematurely: osmo-stp_10.42.42.5(pid=25046) [trial-2405↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25046)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25060): Process ended prematurely: osmo-stp_10.42.42.5(pid=25060) [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25060)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25071): Process ended prematurely: osmo-stp_10.42.42.5(pid=25071) [trial-2405↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25071)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25085): Process ended prematurely: osmo-stp_10.42.42.5(pid=25085) [trial-2405↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25085)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25096): Process ended prematurely: osmo-stp_10.42.42.5(pid=25096) [trial-2405↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25096)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=25117): Process ended prematurely: osmo-stp_10.42.42.5(pid=25117) [trial-2405↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25117)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=25129): Process ended prematurely: osmo-stp_10.42.42.5(pid=25129) [trial-2405↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25129)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=25147): Process ended prematurely: osmo-stp_10.42.42.5(pid=25147) [trial-2405↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25147)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=25157): Process ended prematurely: osmo-stp_10.42.42.5(pid=25157) [trial-2405↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25157)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25167): Process ended prematurely: osmo-stp_10.42.42.5(pid=25167) [trial-2405↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25167)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25184): Process ended prematurely: osmo-stp_10.42.42.5(pid=25184) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25184)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=25196): Process ended prematurely: osmo-stp_10.42.42.5(pid=25196) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25196)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=25214): Process ended prematurely: osmo-stp_10.42.42.5(pid=25214) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25214)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25224): Process ended prematurely: osmo-stp_10.42.42.5(pid=25224) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25224)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25234): Process ended prematurely: osmo-stp_10.42.42.5(pid=25234) [trial-2405↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25234)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=25522): Process ended prematurely: osmo-stp_10.42.42.5(pid=25522) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25522)] FAIL: iperf3.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=25536): Process ended prematurely: osmo-stp_10.42.42.5(pid=25536) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25536)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=25554): Process ended prematurely: osmo-stp_10.42.42.5(pid=25554) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25554)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25564): Process ended prematurely: osmo-stp_10.42.42.5(pid=25564) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25564)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25574): Process ended prematurely: osmo-stp_10.42.42.5(pid=25574) [trial-2405↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25574)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25595): Process ended prematurely: osmo-stp_10.42.42.5(pid=25595) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25595)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=25608): Process ended prematurely: osmo-stp_10.42.42.5(pid=25608) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25608)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=25627): Process ended prematurely: osmo-stp_10.42.42.5(pid=25627) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25627)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25637): Process ended prematurely: osmo-stp_10.42.42.5(pid=25637) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25637)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25650): Process ended prematurely: osmo-stp_10.42.42.5(pid=25650) [trial-2405↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25650)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25663): Process ended prematurely: osmo-stp_10.42.42.5(pid=25663) [trial-2405↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25663)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25676): Process ended prematurely: osmo-stp_10.42.42.5(pid=25676) [trial-2405↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25676)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=25685): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25685) [trial-2405↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25685)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=25695): Process ended prematurely: osmo-stp_10.42.42.5(pid=25695) [trial-2405↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25695)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=25704): Process ended prematurely: osmo-nitb_10.42.42.2(pid=25704) [trial-2405↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=25704)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=25714): Process ended prematurely: osmo-stp_10.42.42.5(pid=25714) [trial-2405↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25714)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25728): Process ended prematurely: osmo-stp_10.42.42.5(pid=25728) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25728)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25739): Process ended prematurely: osmo-stp_10.42.42.5(pid=25739) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25739)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25753): Process ended prematurely: osmo-stp_10.42.42.5(pid=25753) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25753)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=25764): Process ended prematurely: osmo-stp_10.42.42.5(pid=25764) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25764)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25778): Process ended prematurely: osmo-stp_10.42.42.5(pid=25778) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25778)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25789): Process ended prematurely: osmo-stp_10.42.42.5(pid=25789) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25789)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25803): Process ended prematurely: osmo-stp_10.42.42.5(pid=25803) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25803)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25814): Process ended prematurely: osmo-stp_10.42.42.5(pid=25814) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25814)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=25828): Process ended prematurely: osmo-stp_10.42.42.5(pid=25828) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25828)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25839): Process ended prematurely: osmo-stp_10.42.42.5(pid=25839) [trial-2405↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25839)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=25854): Process ended prematurely: osmo-stp_10.42.42.5(pid=25854) [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25854)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=25865): Process ended prematurely: osmo-stp_10.42.42.5(pid=25865) [trial-2405↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25865)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25879): Process ended prematurely: osmo-stp_10.42.42.5(pid=25879) [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25879)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25890): Process ended prematurely: osmo-stp_10.42.42.5(pid=25890) [trial-2405↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25890)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25904): Process ended prematurely: osmo-stp_10.42.42.5(pid=25904) [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25904)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=25915): Process ended prematurely: osmo-stp_10.42.42.5(pid=25915) [trial-2405↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25915)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=25929): Process ended prematurely: osmo-stp_10.42.42.5(pid=25929) [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25929)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=25941): Process ended prematurely: osmo-stp_10.42.42.5(pid=25941) [trial-2405↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25941)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25958): Process ended prematurely: osmo-stp_10.42.42.5(pid=25958) [trial-2405↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25958)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=25969): Process ended prematurely: osmo-stp_10.42.42.5(pid=25969) [trial-2405↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25969)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=25988): Process ended prematurely: osmo-stp_10.42.42.5(pid=25988) [trial-2405↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=25988)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=26000): Process ended prematurely: osmo-stp_10.42.42.5(pid=26000) [trial-2405↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26000)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26018): Process ended prematurely: osmo-stp_10.42.42.5(pid=26018) [trial-2405↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26018)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26028): Process ended prematurely: osmo-stp_10.42.42.5(pid=26028) [trial-2405↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26028)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26038): Process ended prematurely: osmo-stp_10.42.42.5(pid=26038) [trial-2405↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26038)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26055): Process ended prematurely: osmo-stp_10.42.42.5(pid=26055) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26055)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26067): Process ended prematurely: osmo-stp_10.42.42.5(pid=26067) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26067)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=26088): Process ended prematurely: osmo-stp_10.42.42.5(pid=26088) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26088)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=26098): Process ended prematurely: osmo-stp_10.42.42.5(pid=26098) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26098)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26108): Process ended prematurely: osmo-stp_10.42.42.5(pid=26108) [trial-2405↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26108)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=26129): Process ended prematurely: osmo-stp_10.42.42.5(pid=26129) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26129)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26141): Process ended prematurely: osmo-stp_10.42.42.5(pid=26141) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26141)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=26160): Process ended prematurely: osmo-stp_10.42.42.5(pid=26160) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26160)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26170): Process ended prematurely: osmo-stp_10.42.42.5(pid=26170) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26170)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26180): Process ended prematurely: osmo-stp_10.42.42.5(pid=26180) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26180)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26197): Process ended prematurely: osmo-stp_10.42.42.5(pid=26197) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26197)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26212): Process ended prematurely: osmo-stp_10.42.42.5(pid=26212) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26212)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=26250): Process ended prematurely: osmo-stp_10.42.42.5(pid=26250) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26250)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26260): Process ended prematurely: osmo-stp_10.42.42.5(pid=26260) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26260)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26271): Process ended prematurely: osmo-stp_10.42.42.5(pid=26271) [trial-2405↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26271)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=26288): Process ended prematurely: osmo-stp_10.42.42.5(pid=26288) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26288)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=26300): Process ended prematurely: osmo-stp_10.42.42.5(pid=26300) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26300)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=26322): Process ended prematurely: osmo-stp_10.42.42.5(pid=26322) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26322)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26332): Process ended prematurely: osmo-stp_10.42.42.5(pid=26332) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26332)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26342): Process ended prematurely: osmo-stp_10.42.42.5(pid=26342) [trial-2405↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26342)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=26355): Process ended prematurely: osmo-stp_10.42.42.5(pid=26355) [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26355)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26369): Process ended prematurely: osmo-stp_10.42.42.5(pid=26369) [trial-2405↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26369)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=26380): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26380) [trial-2405↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26380)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=26390): Process ended prematurely: osmo-stp_10.42.42.5(pid=26390) [trial-2405↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26390)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=26399): Process ended prematurely: osmo-nitb_10.42.42.2(pid=26399) [trial-2405↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=26399)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=26409): Process ended prematurely: osmo-stp_10.42.42.5(pid=26409) [trial-2405↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26409)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26423): Process ended prematurely: osmo-stp_10.42.42.5(pid=26423) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26423)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26434): Process ended prematurely: osmo-stp_10.42.42.5(pid=26434) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26434)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26448): Process ended prematurely: osmo-stp_10.42.42.5(pid=26448) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26448)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26459): Process ended prematurely: osmo-stp_10.42.42.5(pid=26459) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26459)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26474): Process ended prematurely: osmo-stp_10.42.42.5(pid=26474) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26474)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=26485): Process ended prematurely: osmo-stp_10.42.42.5(pid=26485) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26485)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26499): Process ended prematurely: osmo-stp_10.42.42.5(pid=26499) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26499)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=26511): Process ended prematurely: osmo-stp_10.42.42.5(pid=26511) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26511)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26526): Process ended prematurely: osmo-stp_10.42.42.5(pid=26526) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26526)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=26537): Process ended prematurely: osmo-stp_10.42.42.5(pid=26537) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26537)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=26551): Process ended prematurely: osmo-stp_10.42.42.5(pid=26551) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26551)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26562): Process ended prematurely: osmo-stp_10.42.42.5(pid=26562) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26562)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26577): Process ended prematurely: osmo-stp_10.42.42.5(pid=26577) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26577)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=26588): Process ended prematurely: osmo-stp_10.42.42.5(pid=26588) [trial-2405↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26588)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26650): Process ended prematurely: osmo-stp_10.42.42.5(pid=26650) [trial-2405↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26650)] FAIL: emergency_preemptive_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26884): Process ended prematurely: osmo-stp_10.42.42.5(pid=26884) [trial-2405↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26884)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26903): Process ended prematurely: osmo-stp_10.42.42.5(pid=26903) [trial-2405↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26903)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=26915): Process ended prematurely: osmo-stp_10.42.42.5(pid=26915) [trial-2405↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26915)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=26933): Process ended prematurely: osmo-stp_10.42.42.5(pid=26933) [trial-2405↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26933)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=26946): Process ended prematurely: osmo-stp_10.42.42.5(pid=26946) [trial-2405↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26946)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=26956): Process ended prematurely: osmo-stp_10.42.42.5(pid=26956) [trial-2405↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26956)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=26973): Process ended prematurely: osmo-stp_10.42.42.5(pid=26973) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26973)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=26985): Process ended prematurely: osmo-stp_10.42.42.5(pid=26985) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=26985)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=27005): Process ended prematurely: osmo-stp_10.42.42.5(pid=27005) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27005)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27016): Process ended prematurely: osmo-stp_10.42.42.5(pid=27016) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27016)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27026): Process ended prematurely: osmo-stp_10.42.42.5(pid=27026) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27026)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=27043): Process ended prematurely: osmo-stp_10.42.42.5(pid=27043) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27043)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=27055): Process ended prematurely: osmo-stp_10.42.42.5(pid=27055) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27055)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=27073): Process ended prematurely: osmo-stp_10.42.42.5(pid=27073) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27073)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27083): Process ended prematurely: osmo-stp_10.42.42.5(pid=27083) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27083)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27093): Process ended prematurely: osmo-stp_10.42.42.5(pid=27093) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27093)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=27110): Process ended prematurely: osmo-stp_10.42.42.5(pid=27110) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27110)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27122): Process ended prematurely: osmo-stp_10.42.42.5(pid=27122) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27122)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27140): Process ended prematurely: osmo-stp_10.42.42.5(pid=27140) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27140)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27150): Process ended prematurely: osmo-stp_10.42.42.5(pid=27150) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27150)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27160): Process ended prematurely: osmo-stp_10.42.42.5(pid=27160) [trial-2405↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27160)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27174): Process ended prematurely: osmo-stp_10.42.42.5(pid=27174) [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27174)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27187): Process ended prematurely: osmo-stp_10.42.42.5(pid=27187) [trial-2405↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27187)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=27196): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27196) [trial-2405↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27196)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27206): Process ended prematurely: osmo-stp_10.42.42.5(pid=27206) [trial-2405↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27206)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=27216): Process ended prematurely: osmo-nitb_10.42.42.2(pid=27216) [trial-2405↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=27216)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27226): Process ended prematurely: osmo-stp_10.42.42.5(pid=27226) [trial-2405↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27226)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27240): Process ended prematurely: osmo-stp_10.42.42.5(pid=27240) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27240)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27251): Process ended prematurely: osmo-stp_10.42.42.5(pid=27251) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27251)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27265): Process ended prematurely: osmo-stp_10.42.42.5(pid=27265) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27265)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27276): Process ended prematurely: osmo-stp_10.42.42.5(pid=27276) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27276)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27293): Process ended prematurely: osmo-stp_10.42.42.5(pid=27293) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27293)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27304): Process ended prematurely: osmo-stp_10.42.42.5(pid=27304) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27304)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27318): Process ended prematurely: osmo-stp_10.42.42.5(pid=27318) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27318)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27329): Process ended prematurely: osmo-stp_10.42.42.5(pid=27329) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27329)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27347): Process ended prematurely: osmo-stp_10.42.42.5(pid=27347) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27347)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27358): Process ended prematurely: osmo-stp_10.42.42.5(pid=27358) [trial-2405↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27358)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27372): Process ended prematurely: osmo-stp_10.42.42.5(pid=27372) [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27372)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=27384): Process ended prematurely: osmo-stp_10.42.42.5(pid=27384) [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27384)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27398): Process ended prematurely: osmo-stp_10.42.42.5(pid=27398) [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27398)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27409): Process ended prematurely: osmo-stp_10.42.42.5(pid=27409) [trial-2405↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27409)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=27423): Process ended prematurely: osmo-stp_10.42.42.5(pid=27423) [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27423)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=27434): Process ended prematurely: osmo-stp_10.42.42.5(pid=27434) [trial-2405↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27434)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=27448): Process ended prematurely: osmo-stp_10.42.42.5(pid=27448) [trial-2405↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27448)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=27459): Process ended prematurely: osmo-stp_10.42.42.5(pid=27459) [trial-2405↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27459)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=27477): Process ended prematurely: osmo-stp_10.42.42.5(pid=27477) [trial-2405↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27477)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27489): Process ended prematurely: osmo-stp_10.42.42.5(pid=27489) [trial-2405↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27489)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27508): Process ended prematurely: osmo-stp_10.42.42.5(pid=27508) [trial-2405↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27508)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=27518): Process ended prematurely: osmo-stp_10.42.42.5(pid=27518) [trial-2405↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27518)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=27528): Process ended prematurely: osmo-stp_10.42.42.5(pid=27528) [trial-2405↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27528)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.2 sec) Error: osmo-stp_10.42.42.5(pid=27545): Process ended prematurely: osmo-stp_10.42.42.5(pid=27545) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27545)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=27558): Process ended prematurely: osmo-stp_10.42.42.5(pid=27558) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27558)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=27576): Process ended prematurely: osmo-stp_10.42.42.5(pid=27576) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27576)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=27586): Process ended prematurely: osmo-stp_10.42.42.5(pid=27586) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27586)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=27596): Process ended prematurely: osmo-stp_10.42.42.5(pid=27596) [trial-2405↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27596)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=27614): Process ended prematurely: osmo-stp_10.42.42.5(pid=27614) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27614)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=27627): Process ended prematurely: osmo-stp_10.42.42.5(pid=27627) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27627)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=27655): Process ended prematurely: osmo-stp_10.42.42.5(pid=27655) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=27655)] FAIL: ping.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=28191): Process ended prematurely: osmo-stp_10.42.42.5(pid=28191) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28191)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28202): Process ended prematurely: osmo-stp_10.42.42.5(pid=28202) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28202)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=28220): Process ended prematurely: osmo-stp_10.42.42.5(pid=28220) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28220)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=28232): Process ended prematurely: osmo-stp_10.42.42.5(pid=28232) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28232)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=28250): Process ended prematurely: osmo-stp_10.42.42.5(pid=28250) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28250)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28261): Process ended prematurely: osmo-stp_10.42.42.5(pid=28261) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28261)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28271): Process ended prematurely: osmo-stp_10.42.42.5(pid=28271) [trial-2405↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28271)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=28288): Process ended prematurely: osmo-stp_10.42.42.5(pid=28288) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28288)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28300): Process ended prematurely: osmo-stp_10.42.42.5(pid=28300) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28300)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=28318): Process ended prematurely: osmo-stp_10.42.42.5(pid=28318) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28318)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28329): Process ended prematurely: osmo-stp_10.42.42.5(pid=28329) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28329)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=28339): Process ended prematurely: osmo-stp_10.42.42.5(pid=28339) [trial-2405↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28339)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28352): Process ended prematurely: osmo-stp_10.42.42.5(pid=28352) [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28352)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28365): Process ended prematurely: osmo-stp_10.42.42.5(pid=28365) [trial-2405↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28365)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28373): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28373) [trial-2405↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28373)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=28383): Process ended prematurely: osmo-stp_10.42.42.5(pid=28383) [trial-2405↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28383)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=28392): Process ended prematurely: osmo-nitb_10.42.42.2(pid=28392) [trial-2405↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=28392)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28402): Process ended prematurely: osmo-stp_10.42.42.5(pid=28402) [trial-2405↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28402)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28416): Process ended prematurely: osmo-stp_10.42.42.5(pid=28416) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28416)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28427): Process ended prematurely: osmo-stp_10.42.42.5(pid=28427) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28427)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28512): Process ended prematurely: osmo-stp_10.42.42.5(pid=28512) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28512)] FAIL: mo_mt_call_osmux.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=28724): Process ended prematurely: osmo-stp_10.42.42.5(pid=28724) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28724)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=28738): Process ended prematurely: osmo-stp_10.42.42.5(pid=28738) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28738)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28749): Process ended prematurely: osmo-stp_10.42.42.5(pid=28749) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28749)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28763): Process ended prematurely: osmo-stp_10.42.42.5(pid=28763) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28763)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28774): Process ended prematurely: osmo-stp_10.42.42.5(pid=28774) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28774)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28791): Process ended prematurely: osmo-stp_10.42.42.5(pid=28791) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28791)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=28802): Process ended prematurely: osmo-stp_10.42.42.5(pid=28802) [trial-2405↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28802)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=28818): Process ended prematurely: osmo-stp_10.42.42.5(pid=28818) [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28818)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28829): Process ended prematurely: osmo-stp_10.42.42.5(pid=28829) [trial-2405↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28829)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28845): Process ended prematurely: osmo-stp_10.42.42.5(pid=28845) [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28845)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=28856): Process ended prematurely: osmo-stp_10.42.42.5(pid=28856) [trial-2405↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28856)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=28870): Process ended prematurely: osmo-stp_10.42.42.5(pid=28870) [trial-2405↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28870)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=28881): Process ended prematurely: osmo-stp_10.42.42.5(pid=28881) [trial-2405↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28881)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=28899): Process ended prematurely: osmo-stp_10.42.42.5(pid=28899) [trial-2405↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28899)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=28911): Process ended prematurely: osmo-stp_10.42.42.5(pid=28911) [trial-2405↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28911)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=28935): Process ended prematurely: osmo-stp_10.42.42.5(pid=28935) [trial-2405↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28935)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28945): Process ended prematurely: osmo-stp_10.42.42.5(pid=28945) [trial-2405↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28945)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=28955): Process ended prematurely: osmo-stp_10.42.42.5(pid=28955) [trial-2405↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28955)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=28972): Process ended prematurely: osmo-stp_10.42.42.5(pid=28972) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28972)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=28984): Process ended prematurely: osmo-stp_10.42.42.5(pid=28984) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=28984)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=29002): Process ended prematurely: osmo-stp_10.42.42.5(pid=29002) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29002)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=29012): Process ended prematurely: osmo-stp_10.42.42.5(pid=29012) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29012)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29022): Process ended prematurely: osmo-stp_10.42.42.5(pid=29022) [trial-2405↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29022)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29041): Process ended prematurely: osmo-stp_10.42.42.5(pid=29041) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29041)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29053): Process ended prematurely: osmo-stp_10.42.42.5(pid=29053) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29053)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=29071): Process ended prematurely: osmo-stp_10.42.42.5(pid=29071) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29071)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29082): Process ended prematurely: osmo-stp_10.42.42.5(pid=29082) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29082)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29092): Process ended prematurely: osmo-stp_10.42.42.5(pid=29092) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29092)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=29111): Process ended prematurely: osmo-stp_10.42.42.5(pid=29111) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29111)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29123): Process ended prematurely: osmo-stp_10.42.42.5(pid=29123) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29123)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=29144): Process ended prematurely: osmo-stp_10.42.42.5(pid=29144) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29144)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29154): Process ended prematurely: osmo-stp_10.42.42.5(pid=29154) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29154)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29164): Process ended prematurely: osmo-stp_10.42.42.5(pid=29164) [trial-2405↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29164)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29177): Process ended prematurely: osmo-stp_10.42.42.5(pid=29177) [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29177)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29190): Process ended prematurely: osmo-stp_10.42.42.5(pid=29190) [trial-2405↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29190)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=29200): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29200) [trial-2405↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29200)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=29210): Process ended prematurely: osmo-stp_10.42.42.5(pid=29210) [trial-2405↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29210)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=29219): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29219) [trial-2405↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29219)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29229): Process ended prematurely: osmo-stp_10.42.42.5(pid=29229) [trial-2405↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29229)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29243): Process ended prematurely: osmo-stp_10.42.42.5(pid=29243) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29243)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29254): Process ended prematurely: osmo-stp_10.42.42.5(pid=29254) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29254)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29268): Process ended prematurely: osmo-stp_10.42.42.5(pid=29268) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29268)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29279): Process ended prematurely: osmo-stp_10.42.42.5(pid=29279) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29279)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29293): Process ended prematurely: osmo-stp_10.42.42.5(pid=29293) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29293)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29304): Process ended prematurely: osmo-stp_10.42.42.5(pid=29304) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29304)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29321): Process ended prematurely: osmo-stp_10.42.42.5(pid=29321) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29321)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29332): Process ended prematurely: osmo-stp_10.42.42.5(pid=29332) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29332)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=29346): Process ended prematurely: osmo-stp_10.42.42.5(pid=29346) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29346)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29357): Process ended prematurely: osmo-stp_10.42.42.5(pid=29357) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29357)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=29371): Process ended prematurely: osmo-stp_10.42.42.5(pid=29371) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29371)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29382): Process ended prematurely: osmo-stp_10.42.42.5(pid=29382) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29382)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29396): Process ended prematurely: osmo-stp_10.42.42.5(pid=29396) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29396)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=29407): Process ended prematurely: osmo-stp_10.42.42.5(pid=29407) [trial-2405↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29407)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29422): Process ended prematurely: osmo-stp_10.42.42.5(pid=29422) [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29422)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29433): Process ended prematurely: osmo-stp_10.42.42.5(pid=29433) [trial-2405↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29433)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=29454): Process ended prematurely: osmo-stp_10.42.42.5(pid=29454) [trial-2405↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29454)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=29466): Process ended prematurely: osmo-stp_10.42.42.5(pid=29466) [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29466)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=29484): Process ended prematurely: osmo-stp_10.42.42.5(pid=29484) [trial-2405↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29484)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29497): Process ended prematurely: osmo-stp_10.42.42.5(pid=29497) [trial-2405↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29497)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29507): Process ended prematurely: osmo-stp_10.42.42.5(pid=29507) [trial-2405↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29507)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=29524): Process ended prematurely: osmo-stp_10.42.42.5(pid=29524) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29524)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29536): Process ended prematurely: osmo-stp_10.42.42.5(pid=29536) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29536)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29557): Process ended prematurely: osmo-stp_10.42.42.5(pid=29557) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29557)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=29567): Process ended prematurely: osmo-stp_10.42.42.5(pid=29567) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29567)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29577): Process ended prematurely: osmo-stp_10.42.42.5(pid=29577) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29577)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=29594): Process ended prematurely: osmo-stp_10.42.42.5(pid=29594) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29594)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=29606): Process ended prematurely: osmo-stp_10.42.42.5(pid=29606) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29606)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=29624): Process ended prematurely: osmo-stp_10.42.42.5(pid=29624) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29624)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=29634): Process ended prematurely: osmo-stp_10.42.42.5(pid=29634) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29634)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29644): Process ended prematurely: osmo-stp_10.42.42.5(pid=29644) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29644)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=29661): Process ended prematurely: osmo-stp_10.42.42.5(pid=29661) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29661)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=29673): Process ended prematurely: osmo-stp_10.42.42.5(pid=29673) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29673)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=29691): Process ended prematurely: osmo-stp_10.42.42.5(pid=29691) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29691)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29702): Process ended prematurely: osmo-stp_10.42.42.5(pid=29702) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29702)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=29712): Process ended prematurely: osmo-stp_10.42.42.5(pid=29712) [trial-2405↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29712)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=29725): Process ended prematurely: osmo-stp_10.42.42.5(pid=29725) [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29725)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=29739): Process ended prematurely: osmo-stp_10.42.42.5(pid=29739) [trial-2405↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29739)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=29747): Process ended prematurely: osmo-nitb_10.42.42.2(pid=29747) [trial-2405↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=29747)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=29757): Process ended prematurely: osmo-stp_10.42.42.5(pid=29757) [trial-2405↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=29757)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=30037): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30037) [trial-2405↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30037)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30047): Process ended prematurely: osmo-stp_10.42.42.5(pid=30047) [trial-2405↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30047)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30062): Process ended prematurely: osmo-stp_10.42.42.5(pid=30062) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30062)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30073): Process ended prematurely: osmo-stp_10.42.42.5(pid=30073) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30073)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30088): Process ended prematurely: osmo-stp_10.42.42.5(pid=30088) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30088)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30099): Process ended prematurely: osmo-stp_10.42.42.5(pid=30099) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30099)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30116): Process ended prematurely: osmo-stp_10.42.42.5(pid=30116) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30116)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30127): Process ended prematurely: osmo-stp_10.42.42.5(pid=30127) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30127)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30141): Process ended prematurely: osmo-stp_10.42.42.5(pid=30141) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30141)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30152): Process ended prematurely: osmo-stp_10.42.42.5(pid=30152) [trial-2405↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30152)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30167): Process ended prematurely: osmo-stp_10.42.42.5(pid=30167) [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30167)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30178): Process ended prematurely: osmo-stp_10.42.42.5(pid=30178) [trial-2405↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30178)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30192): Process ended prematurely: osmo-stp_10.42.42.5(pid=30192) [trial-2405↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30192)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30203): Process ended prematurely: osmo-stp_10.42.42.5(pid=30203) [trial-2405↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30203)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30222): Process ended prematurely: osmo-stp_10.42.42.5(pid=30222) [trial-2405↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30222)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30234): Process ended prematurely: osmo-stp_10.42.42.5(pid=30234) [trial-2405↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30234)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=30252): Process ended prematurely: osmo-stp_10.42.42.5(pid=30252) [trial-2405↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30252)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30262): Process ended prematurely: osmo-stp_10.42.42.5(pid=30262) [trial-2405↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30262)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30272): Process ended prematurely: osmo-stp_10.42.42.5(pid=30272) [trial-2405↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30272)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30289): Process ended prematurely: osmo-stp_10.42.42.5(pid=30289) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30289)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=30301): Process ended prematurely: osmo-stp_10.42.42.5(pid=30301) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30301)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=30319): Process ended prematurely: osmo-stp_10.42.42.5(pid=30319) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30319)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30330): Process ended prematurely: osmo-stp_10.42.42.5(pid=30330) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30330)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=30340): Process ended prematurely: osmo-stp_10.42.42.5(pid=30340) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30340)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30357): Process ended prematurely: osmo-stp_10.42.42.5(pid=30357) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30357)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30369): Process ended prematurely: osmo-stp_10.42.42.5(pid=30369) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30369)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=30387): Process ended prematurely: osmo-stp_10.42.42.5(pid=30387) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30387)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30397): Process ended prematurely: osmo-stp_10.42.42.5(pid=30397) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30397)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=30407): Process ended prematurely: osmo-stp_10.42.42.5(pid=30407) [trial-2405↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30407)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30423): Process ended prematurely: osmo-stp_10.42.42.5(pid=30423) [trial-2405↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30423)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30436): Process ended prematurely: osmo-stp_10.42.42.5(pid=30436) [trial-2405↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30436)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=30445): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30445) [trial-2405↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30445)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30458): Process ended prematurely: osmo-stp_10.42.42.5(pid=30458) [trial-2405↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30458)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30472): Process ended prematurely: osmo-stp_10.42.42.5(pid=30472) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30472)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30483): Process ended prematurely: osmo-stp_10.42.42.5(pid=30483) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30483)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30497): Process ended prematurely: osmo-stp_10.42.42.5(pid=30497) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30497)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30508): Process ended prematurely: osmo-stp_10.42.42.5(pid=30508) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30508)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30522): Process ended prematurely: osmo-stp_10.42.42.5(pid=30522) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30522)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30533): Process ended prematurely: osmo-stp_10.42.42.5(pid=30533) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30533)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30547): Process ended prematurely: osmo-stp_10.42.42.5(pid=30547) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30547)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30559): Process ended prematurely: osmo-stp_10.42.42.5(pid=30559) [trial-2405↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30559)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=30573): Process ended prematurely: osmo-stp_10.42.42.5(pid=30573) [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30573)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=30584): Process ended prematurely: osmo-stp_10.42.42.5(pid=30584) [trial-2405↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30584)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30598): Process ended prematurely: osmo-stp_10.42.42.5(pid=30598) [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30598)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30609): Process ended prematurely: osmo-stp_10.42.42.5(pid=30609) [trial-2405↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30609)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30623): Process ended prematurely: osmo-stp_10.42.42.5(pid=30623) [trial-2405↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30623)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30634): Process ended prematurely: osmo-stp_10.42.42.5(pid=30634) [trial-2405↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30634)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=30652): Process ended prematurely: osmo-stp_10.42.42.5(pid=30652) [trial-2405↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30652)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30665): Process ended prematurely: osmo-stp_10.42.42.5(pid=30665) [trial-2405↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30665)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=30683): Process ended prematurely: osmo-stp_10.42.42.5(pid=30683) [trial-2405↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30683)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30693): Process ended prematurely: osmo-stp_10.42.42.5(pid=30693) [trial-2405↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30693)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30703): Process ended prematurely: osmo-stp_10.42.42.5(pid=30703) [trial-2405↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30703)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=30720): Process ended prematurely: osmo-stp_10.42.42.5(pid=30720) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30720)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=30732): Process ended prematurely: osmo-stp_10.42.42.5(pid=30732) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30732)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=30750): Process ended prematurely: osmo-stp_10.42.42.5(pid=30750) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30750)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30760): Process ended prematurely: osmo-stp_10.42.42.5(pid=30760) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30760)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30771): Process ended prematurely: osmo-stp_10.42.42.5(pid=30771) [trial-2405↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30771)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=30789): Process ended prematurely: osmo-stp_10.42.42.5(pid=30789) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30789)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30804): Process ended prematurely: osmo-stp_10.42.42.5(pid=30804) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30804)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=30822): Process ended prematurely: osmo-stp_10.42.42.5(pid=30822) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30822)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30832): Process ended prematurely: osmo-stp_10.42.42.5(pid=30832) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30832)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=30842): Process ended prematurely: osmo-stp_10.42.42.5(pid=30842) [trial-2405↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30842)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=30863): Process ended prematurely: osmo-stp_10.42.42.5(pid=30863) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30863)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=30875): Process ended prematurely: osmo-stp_10.42.42.5(pid=30875) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30875)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=30893): Process ended prematurely: osmo-stp_10.42.42.5(pid=30893) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30893)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=30903): Process ended prematurely: osmo-stp_10.42.42.5(pid=30903) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30903)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=30913): Process ended prematurely: osmo-stp_10.42.42.5(pid=30913) [trial-2405↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30913)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=30926): Process ended prematurely: osmo-stp_10.42.42.5(pid=30926) [trial-2405↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30926)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=30934): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30934) [trial-2405↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30934)] FAIL: esme_connect_policy_closed.py (2.2 sec) Error: osmo-nitb_10.42.42.2(pid=30936): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30936) [trial-2405↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30936)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=30938): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30938) [trial-2405↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30938)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=30940): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30940) [trial-2405↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30940)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.7 sec) Error: osmo-hlr_10.42.42.2(pid=30949): Process ended prematurely: osmo-hlr_10.42.42.2(pid=30949) [trial-2405↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30949)] FAIL: esme_connect_policy_closed.py (5.8 sec) Error: osmo-hlr_10.42.42.2(pid=30960): Process ended prematurely: osmo-hlr_10.42.42.2(pid=30960) [trial-2405↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30960)] FAIL: esme_ms_sms_storeforward.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=30972): Process ended prematurely: osmo-stp_10.42.42.5(pid=30972) [trial-2405↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30972)] FAIL: esme_ms_sms_transaction.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=30983): Process ended prematurely: osmo-stp_10.42.42.5(pid=30983) [trial-2405↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30983)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=30998): Process ended prematurely: osmo-stp_10.42.42.5(pid=30998) [trial-2405↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30998)] FAIL: register_a5_0_authreq.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=31009): Process ended prematurely: osmo-stp_10.42.42.5(pid=31009) [trial-2405↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31009)] FAIL: register_a5_1_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31020): Process ended prematurely: osmo-stp_10.42.42.5(pid=31020) [trial-2405↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31020)] FAIL: register_a5_3_authreq.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31031): Process ended prematurely: osmo-stp_10.42.42.5(pid=31031) [trial-2405↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31031)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.1 sec) Error: srsepc(pid=31051): Process ended prematurely: srsepc(pid=31051) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31051)] FAIL: iperf3_bidir.py (18.9 sec) Error: srsepc(pid=31067): Process ended prematurely: srsepc(pid=31067) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31067)] FAIL: iperf3_dl.py (21.3 sec) Error: srsepc(pid=31355): Process ended prematurely: srsepc(pid=31355) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31355)] FAIL: iperf3_ul.py (19.1 sec) Error: srsepc(pid=31372): Process ended prematurely: srsepc(pid=31372) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31372)] FAIL: ping.py (18.2 sec) Error: srsepc(pid=31388): Process ended prematurely: srsepc(pid=31388) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31388)] FAIL: rrc_idle_mo_ping.py (18.5 sec) Error: srsepc(pid=31407): Process ended prematurely: srsepc(pid=31407) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31407)] FAIL: rrc_idle_mt_ping.py (18.3 sec) Error: srsepc(pid=31423): Process ended prematurely: srsepc(pid=31423) [trial-2405↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=31423)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31438): Process ended prematurely: osmo-stp_10.42.42.5(pid=31438) [trial-2405↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31438)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31453): Process ended prematurely: osmo-stp_10.42.42.5(pid=31453) [trial-2405↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31453)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31467): Process ended prematurely: osmo-stp_10.42.42.5(pid=31467) [trial-2405↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31467)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31481): Process ended prematurely: osmo-stp_10.42.42.5(pid=31481) [trial-2405↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31481)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31495): Process ended prematurely: osmo-stp_10.42.42.5(pid=31495) [trial-2405↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31495)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31509): Process ended prematurely: osmo-stp_10.42.42.5(pid=31509) [trial-2405↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31509)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31523): Process ended prematurely: osmo-stp_10.42.42.5(pid=31523) [trial-2405↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31523)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31537): Process ended prematurely: osmo-stp_10.42.42.5(pid=31537) [trial-2405↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31537)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31551): Process ended prematurely: osmo-stp_10.42.42.5(pid=31551) [trial-2405↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31551)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=31565): Process ended prematurely: osmo-stp_10.42.42.5(pid=31565) [trial-2405↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31565)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31579): Process ended prematurely: osmo-stp_10.42.42.5(pid=31579) [trial-2405↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31579)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31594): Process ended prematurely: osmo-stp_10.42.42.5(pid=31594) [trial-2405↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31594)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31608): Process ended prematurely: osmo-stp_10.42.42.5(pid=31608) [trial-2405↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31608)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31622): Process ended prematurely: osmo-stp_10.42.42.5(pid=31622) [trial-2405↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31622)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31636): Process ended prematurely: osmo-stp_10.42.42.5(pid=31636) [trial-2405↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31636)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31651): Process ended prematurely: osmo-stp_10.42.42.5(pid=31651) [trial-2405↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31651)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31665): Process ended prematurely: osmo-stp_10.42.42.5(pid=31665) [trial-2405↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31665)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31679): Process ended prematurely: osmo-stp_10.42.42.5(pid=31679) [trial-2405↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31679)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=31693): Process ended prematurely: osmo-stp_10.42.42.5(pid=31693) [trial-2405↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31693)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31708): Process ended prematurely: osmo-stp_10.42.42.5(pid=31708) [trial-2405↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31708)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31722): Process ended prematurely: osmo-stp_10.42.42.5(pid=31722) [trial-2405↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31722)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31737): Process ended prematurely: osmo-stp_10.42.42.5(pid=31737) [trial-2405↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31737)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=31762): Process ended prematurely: osmo-stp_10.42.42.5(pid=31762) [trial-2405↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31762)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=32127): Process ended prematurely: osmo-stp_10.42.42.5(pid=32127) [trial-2405↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32127)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32316): Process ended prematurely: osmo-stp_10.42.42.5(pid=32316) [trial-2405↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32316)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32331): Process ended prematurely: osmo-stp_10.42.42.5(pid=32331) [trial-2405↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32331)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32345): Process ended prematurely: osmo-stp_10.42.42.5(pid=32345) [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32345)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=32361): Process ended prematurely: osmo-stp_10.42.42.5(pid=32361) [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32361)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=32375): Process ended prematurely: osmo-stp_10.42.42.5(pid=32375) [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32375)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32389): Process ended prematurely: osmo-stp_10.42.42.5(pid=32389) [trial-2405↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32389)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32403): Process ended prematurely: osmo-stp_10.42.42.5(pid=32403) [trial-2405↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32403)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32417): Process ended prematurely: osmo-stp_10.42.42.5(pid=32417) [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32417)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32434): Process ended prematurely: osmo-stp_10.42.42.5(pid=32434) [trial-2405↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32434)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32453): Process ended prematurely: osmo-stp_10.42.42.5(pid=32453) [trial-2405↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32453)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32467): Process ended prematurely: osmo-stp_10.42.42.5(pid=32467) [trial-2405↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32467)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32481): Process ended prematurely: osmo-stp_10.42.42.5(pid=32481) [trial-2405↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32481)] + rm -rf trial-2405/inst + cd trial-2405 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-14 12:53:08 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405-run.tgz run.2022-12-14_12-53-19 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2405-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17689.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6695.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2999.tgz osmo-mgw.build-8965.tgz osmo-msc.build-29319.tgz osmo-nitb.build-12996.tgz osmo-pcu-oc2g.build-3913.tgz osmo-pcu-sysmo.build-5196.tgz osmo-pcu.build-5157.tgz osmo-sgsn.build-30106.tgz osmo-stp.build-9261.tgz osmo-trx.build-4687.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE