Started by upstream project "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5197 originally caused by: Started by upstream project "master-osmo-pcu" build number 5365 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5158 originally caused by: Started by upstream project "master-osmo-pcu" build number 5365 originally caused by: Started by an SCM change Started by upstream project "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3914 originally caused by: Started by upstream project "master-osmo-pcu" build number 5365 originally caused by: Started by an SCM change Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17689 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7515 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6695 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8719 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2999 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29319 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5158 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30106 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4687 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12996 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9261 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4714 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8046 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5197 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5542 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3914 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins9553090204241573047.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-14 14:20:32 + trial_dir_prefix=trial- + rm -rf trial-2405 trial-2405-bin.tgz trial-2405-run.tgz + trial_dir=trial-2406 + mkdir -p trial-2406 + mv open5gs.build-8.tgz osmo-bsc.build-17689.tgz osmo-bts-oc2g.build-5542.tgz osmo-bts-sysmo.build-8046.tgz osmo-bts.build-7515.tgz osmo-ggsn.build-6695.tgz osmo-hlr.build-8719.tgz osmo-hnbgw.build-2999.tgz osmo-mgw.build-8965.tgz osmo-msc.build-29319.tgz osmo-nitb.build-12996.tgz osmo-pcu-oc2g.build-3914.tgz osmo-pcu-sysmo.build-5197.tgz osmo-pcu.build-5158.tgz osmo-sgsn.build-30106.tgz osmo-stp.build-9261.tgz osmo-trx.build-4687.tgz osmocom-bb.build-4714.tgz srslte.build-19.tgz trial-2406 + cat open5gs.build-8.md5 osmo-bsc.build-17689.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6695.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2999.md5 osmo-mgw.build-8965.md5 osmo-msc.build-29319.md5 osmo-nitb.build-12996.md5 osmo-pcu-oc2g.build-3914.md5 osmo-pcu-sysmo.build-5197.md5 osmo-pcu.build-5158.md5 osmo-sgsn.build-30106.md5 osmo-stp.build-9261.md5 osmo-trx.build-4687.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17689.md5 osmo-bts-oc2g.build-5542.md5 osmo-bts-sysmo.build-8046.md5 osmo-bts.build-7515.md5 osmo-ggsn.build-6695.md5 osmo-hlr.build-8719.md5 osmo-hnbgw.build-2999.md5 osmo-mgw.build-8965.md5 osmo-msc.build-29319.md5 osmo-nitb.build-12996.md5 osmo-pcu-oc2g.build-3914.md5 osmo-pcu-sysmo.build-5197.md5 osmo-pcu.build-5158.md5 osmo-sgsn.build-30106.md5 osmo-stp.build-9261.md5 osmo-trx.build-4687.md5 osmocom-bb.build-4714.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2406 combinations: None trial: 'trial-2406' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2406 -------------------------------------------------------------------------------------------- 14:20:43.570896 tst trial-2406: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/log --------------------------------------------------------------------- trial-2406 nitb_sms:sysmo --------------------------------------------------------------------- 14:22:51.109620 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:22:51.113192 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 14:22:51.133577 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 14:22:51.140203 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 14:22:51.193458 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 14:22:51.214659 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 14:22:51.221465 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 14:22:51.757808 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 14:22:51.762870 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 14:22:51.773867 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 14:22:52.149706 tst mo_mt_sms.py: using LAC 41501 14:22:52.383342 tst mo_mt_sms.py: using RAC 191 14:22:52.497844 tst mo_mt_sms.py: using CellId 41501 14:22:52.614595 tst mo_mt_sms.py: using BVCI 41502 14:22:52.721102 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 14:22:52.903244 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 14:22:53.022251 tst mo_mt_sms.py:9: start nitb and bts... 14:22:53.240221 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:22:55.569430 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32583): Launched 14:22:55.894498 run osmo-nitb_10.42.42.2(pid=32584): Launched 14:22:56.070232 run osmo-nitb_10.42.42.2(pid=32584): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32584)] 14:22:56.203661 run osmo-nitb_10.42.42.2(pid=32584): stdout: | (launched: 2022-12-14_14:22:55.833945) 14:22:56.338855 run osmo-nitb_10.42.42.2(pid=32584): stderr: | (launched: 2022-12-14_14:22:55.882037) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:22:56.473932 run osmo-nitb_10.42.42.2(pid=32584): stdout: | (launched: 2022-12-14_14:22:55.833945) 14:22:56.602634 run osmo-nitb_10.42.42.2(pid=32584): stderr: | (launched: 2022-12-14_14:22:55.882037) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:22:56.757275 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=32584): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32584) [trial-2406↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32584)] [trial-2406↪nitb_sms:sysmo↪mo_mt_sms.py:11] 14:22:56.766142 tst mo_mt_sms.py:11: Test FAILED (5.0 sec) 14:22:56.773131 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32583): Terminating (SIGTERM) 14:22:56.984737 --- ParallelTerminationStrategy: PID 32583 died... 14:22:57.006595 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32583): Terminated: ok {rc=0} 14:22:57.096380 bus /sierra_3: Setting Powered False 14:22:58.196760 bus /sierra_3: Setting Powered False 14:22:59.316806 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 sms:sysmo --------------------------------------------------------------------- 14:23:00.493688 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:00.497669 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 14:23:00.518292 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 14:23:00.544841 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 14:23:00.596610 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 14:23:00.617971 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 14:23:00.644632 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 14:23:01.190427 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 sms:sysmo mo_mt_sms.py ---------------------------------------------- 14:23:01.196644 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:23:01.209092 tst sms:sysmo: Using 1 x bts (candidates: 1) 14:23:01.251429 tst mo_mt_sms.py: using LAC 41502 14:23:01.393735 tst mo_mt_sms.py: using RAC 192 14:23:01.525348 tst mo_mt_sms.py: using CellId 41502 14:23:01.657382 tst mo_mt_sms.py: using BVCI 41503 14:23:01.768634 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:23:01.779925 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:23:01.791067 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:23:01.802208 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:23:01.813990 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 14:23:01.825770 tst sms:sysmo: Using 1 x modem (candidates: 2) 14:23:01.981720 tst sms:sysmo: Using 1 x modem (candidates: 2) 14:23:02.101945 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:03.811064 run create_hlr_db(pid=32590): Launched 14:23:03.934432 bus /sierra_2: Setting Powered False 14:23:04.993972 run create_hlr_db(pid=32590): Terminated: ok {rc=0} 14:23:05.439660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32592): Launched 14:23:05.766286 run osmo-hlr_10.42.42.2(pid=32593): Launched 14:23:05.889401 run osmo-stp_10.42.42.5: Starting osmo-stp 14:23:08.468769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32595): Launched 14:23:08.795121 run osmo-stp_10.42.42.5(pid=32596): Launched 14:23:08.918578 run osmo-msc_10.42.42.6: Starting osmo-msc 14:23:14.296443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32598): Launched 14:23:14.620620 run osmo-msc_10.42.42.6(pid=32599): Launched 14:23:14.800394 run osmo-stp_10.42.42.5(pid=32596): ERR: Terminated: ERROR {rc=1} [trial-2406↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32596)] 14:23:14.936515 run osmo-stp_10.42.42.5(pid=32596): stdout: | (launched: 2022-12-14_14:23:08.734049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:15.073367 run osmo-stp_10.42.42.5(pid=32596): stderr: | 20221214142308929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142308929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142308929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142308929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142308930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142308930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142308930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:15.209424 run osmo-stp_10.42.42.5(pid=32596): stdout: | (launched: 2022-12-14_14:23:08.734049) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:15.337991 run osmo-stp_10.42.42.5(pid=32596): stderr: | 20221214142308929 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142308929 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142308929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142308929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142308930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142308930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142308930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:15.491570 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32596): Process ended prematurely: osmo-stp_10.42.42.5(pid=32596) [trial-2406↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32596)] [trial-2406↪sms:sysmo↪mo_mt_sms.py:16] 14:23:15.500467 tst mo_mt_sms.py:16: Test FAILED (14.3 sec) 14:23:15.527938 run osmo-hlr_10.42.42.2(pid=32593): ERR: Terminated: ERROR {rc=237} [trial-2406↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32593)] 14:23:15.579009 run osmo-hlr_10.42.42.2(pid=32593): stdout: | (launched: 2022-12-14_14:23:05.705230) 14:23:15.631729 run osmo-hlr_10.42.42.2(pid=32593): stderr: | 20221214142305905 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142305905 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142305905 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142305905 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142305905 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142305905 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142305919 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142305928 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142305929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142305929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:23:15.704870 run osmo-msc_10.42.42.6(pid=32599): ERR: Terminated: ERROR {rc=2} [trial-2406↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32599)] 14:23:15.755362 run osmo-msc_10.42.42.6(pid=32599): stdout: | (launched: 2022-12-14_14:23:14.559773) 14:23:15.807667 run osmo-msc_10.42.42.6(pid=32599): stderr: | 20221214142314884 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142314884 DLGLOBAL DEBUG validating counter group 0x7f95f204dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142314884 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142314884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142314884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142314885 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142314886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142314887 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142314887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142314887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:23:15.887023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32592): Terminating (SIGTERM) 14:23:15.937841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32595): Terminating (SIGTERM) 14:23:15.981107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32598): Terminating (SIGTERM) 14:23:16.024250 --- ParallelTerminationStrategy: PID 32592 died... 14:23:16.046510 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32592): Terminated: ok {rc=0} 14:23:16.106979 --- ParallelTerminationStrategy: PID 32595 died... 14:23:16.130024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32595): Terminated: ok {rc=0} 14:23:16.177215 --- ParallelTerminationStrategy: PID 32598 died... 14:23:16.198297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32598): Terminated: ok {rc=0} 14:23:16.288520 bus /sierra_3: Setting Powered False 14:23:17.387807 bus /sierra_3: Setting Powered False 14:23:18.504879 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 nitb_ussd:sysmo --------------------------------------------------------------------- 14:23:19.721043 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:19.724704 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 14:23:19.745301 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 14:23:19.752153 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 14:23:19.786870 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 14:23:19.809239 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 14:23:19.816372 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 14:23:20.336813 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2406 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 14:23:20.342378 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 14:23:20.353756 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 14:23:20.389674 tst assert_extension.py: using LAC 41503 14:23:20.518578 tst assert_extension.py: using RAC 193 14:23:20.647664 tst assert_extension.py: using CellId 41503 14:23:20.768381 tst assert_extension.py: using BVCI 41504 14:23:20.880254 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 14:23:21.000455 tst assert_extension.py:10: start nitb and bts... 14:23:21.220290 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:23:21.883223 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32604): Launched 14:23:22.208455 run osmo-nitb_10.42.42.2(pid=32605): Launched 14:23:22.387446 run osmo-nitb_10.42.42.2(pid=32605): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32605)] 14:23:22.532783 run osmo-nitb_10.42.42.2(pid=32605): stdout: | (launched: 2022-12-14_14:23:22.147485) 14:23:22.680398 run osmo-nitb_10.42.42.2(pid=32605): stderr: | (launched: 2022-12-14_14:23:22.195611) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:23:22.827341 run osmo-nitb_10.42.42.2(pid=32605): stdout: | (launched: 2022-12-14_14:23:22.147485) 14:23:22.967947 run osmo-nitb_10.42.42.2(pid=32605): stderr: | (launched: 2022-12-14_14:23:22.195611) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32605): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32605) [trial-2406↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32605)] 14:23:23.330955 tst osmo-nitb_10.42.42.2(pid=32605): stdout: | (launched: 2022-12-14_14:23:22.147485) 14:23:23.490579 tst osmo-nitb_10.42.42.2(pid=32605): stderr: | (launched: 2022-12-14_14:23:22.195611) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:23:23.643419 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32605): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32605) [trial-2406↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32605)] [trial-2406↪nitb_ussd:sysmo↪assert_extension.py:12] 14:23:23.652080 tst assert_extension.py:12: Test FAILED (3.3 sec) 14:23:23.659082 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32604): Terminating (SIGTERM) 14:23:23.869110 --- ParallelTerminationStrategy: PID 32604 died... 14:23:23.889601 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32604): Terminated: ok {rc=0} 14:23:23.973598 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 ussd:sysmo --------------------------------------------------------------------- 14:23:25.202242 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:25.207111 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 14:23:25.229032 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 14:23:25.258414 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 14:23:25.293659 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 14:23:25.315456 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 14:23:25.343158 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 14:23:25.872356 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2406 ussd:sysmo assert_extension.py ---------------------------------------------- 14:23:25.877994 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 14:23:25.889160 tst ussd:sysmo: Using 1 x bts (candidates: 1) 14:23:25.925698 tst assert_extension.py: using LAC 41504 14:23:26.053182 tst assert_extension.py: using RAC 194 14:23:26.179177 tst assert_extension.py: using CellId 41504 14:23:26.306641 tst assert_extension.py: using BVCI 41505 14:23:26.425604 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.436561 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.447543 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.458447 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.469680 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 14:23:26.480855 tst ussd:sysmo: Using 1 x modem (candidates: 1) 14:23:26.597166 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:27.069017 run create_hlr_db(pid=32610): Launched 14:23:27.185639 bus /sierra_2: Setting Powered False 14:23:28.245951 run create_hlr_db(pid=32610): Terminated: ok {rc=0} 14:23:28.672745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32612): Launched 14:23:28.979175 run osmo-hlr_10.42.42.2(pid=32613): Launched 14:23:29.094768 run osmo-stp_10.42.42.5: Starting osmo-stp 14:23:29.618662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32615): Launched 14:23:29.925023 run osmo-stp_10.42.42.5(pid=32616): Launched 14:23:30.040937 run osmo-msc_10.42.42.6: Starting osmo-msc 14:23:30.587182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32618): Launched 14:23:30.901633 run osmo-msc_10.42.42.6(pid=32619): Launched 14:23:31.239548 run osmo-stp_10.42.42.5(pid=32616): ERR: Terminated: ERROR {rc=1} [trial-2406↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32616)] 14:23:31.508498 run osmo-stp_10.42.42.5(pid=32616): stdout: | (launched: 2022-12-14_14:23:29.867078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:31.672641 run osmo-stp_10.42.42.5(pid=32616): stderr: | 20221214142330040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142330040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142330041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142330041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142330042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142330042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142330042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:31.813516 run osmo-stp_10.42.42.5(pid=32616): stdout: | (launched: 2022-12-14_14:23:29.867078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:31.946925 run osmo-stp_10.42.42.5(pid=32616): stderr: | 20221214142330040 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142330040 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142330041 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142330041 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142330042 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142330042 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142330042 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:32.105780 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32616): Process ended prematurely: osmo-stp_10.42.42.5(pid=32616) [trial-2406↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32616)] [trial-2406↪ussd:sysmo↪assert_extension.py:17] 14:23:32.115836 tst assert_extension.py:17: Test FAILED (6.2 sec) 14:23:32.144497 run osmo-hlr_10.42.42.2(pid=32613): ERR: Terminated: ERROR {rc=237} [trial-2406↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32613)] 14:23:32.196597 run osmo-hlr_10.42.42.2(pid=32613): stdout: | (launched: 2022-12-14_14:23:28.921062) 14:23:32.251814 run osmo-hlr_10.42.42.2(pid=32613): stderr: | 20221214142329101 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142329101 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142329101 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142329101 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142329101 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142329101 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142329135 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142329145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142329145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142329146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:23:32.326945 run osmo-msc_10.42.42.6(pid=32619): ERR: Terminated: ERROR {rc=2} [trial-2406↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32619)] 14:23:32.378955 run osmo-msc_10.42.42.6(pid=32619): stdout: | (launched: 2022-12-14_14:23:30.837091) 14:23:32.432110 run osmo-msc_10.42.42.6(pid=32619): stderr: | 20221214142331212 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142331213 DLGLOBAL DEBUG validating counter group 0x7f5f9c103c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142331213 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142331213 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142331213 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142331220 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142331222 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142331222 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142331222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142331223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:23:32.484916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32612): Terminating (SIGTERM) 14:23:32.527524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32615): Terminating (SIGTERM) 14:23:32.570674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32618): Terminating (SIGTERM) 14:23:32.613326 --- ParallelTerminationStrategy: PID 32612 died... 14:23:32.633562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32612): Terminated: ok {rc=0} 14:23:32.680582 --- ParallelTerminationStrategy: PID 32615 died... 14:23:32.700691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32615): Terminated: ok {rc=0} 14:23:32.747111 --- ParallelTerminationStrategy: PID 32618 died... 14:23:32.766829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32618): Terminated: ok {rc=0} 14:23:32.854599 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 14:23:34.057487 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:34.064655 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 14:23:34.086161 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 14:23:34.115119 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 14:23:34.171000 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 14:23:34.192144 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 14:23:34.219315 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 14:23:34.767470 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 14:23:34.820079 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:34.831309 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:23:34.889576 tst mo_mt_call.py: using LAC 41505 14:23:35.022916 tst mo_mt_call.py: using RAC 195 14:23:35.153358 tst mo_mt_call.py: using CellId 41505 14:23:35.276800 tst mo_mt_call.py: using BVCI 41506 14:23:35.390077 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:35.401436 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:35.412205 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:35.423226 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:35.434652 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:35.445882 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:23:35.567166 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:23:35.687740 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:36.202430 run create_hlr_db(pid=32624): Launched 14:23:36.336138 bus /sierra_2: Setting Powered False 14:23:37.401475 run create_hlr_db(pid=32624): Terminated: ok {rc=0} 14:23:37.845435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32626): Launched 14:23:38.156302 run osmo-hlr_10.42.42.2(pid=32627): Launched 14:23:38.273504 run osmo-stp_10.42.42.5: Starting osmo-stp 14:23:38.810574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32629): Launched 14:23:39.121598 run osmo-stp_10.42.42.5(pid=32630): Launched 14:23:39.238702 run osmo-msc_10.42.42.6: Starting osmo-msc 14:23:39.795363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32632): Launched 14:23:40.105969 run osmo-msc_10.42.42.6(pid=32633): Launched 14:23:40.278153 run osmo-stp_10.42.42.5(pid=32630): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32630)] 14:23:40.409219 run osmo-stp_10.42.42.5(pid=32630): stdout: | (launched: 2022-12-14_14:23:39.063131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:40.539808 run osmo-stp_10.42.42.5(pid=32630): stderr: | 20221214142339237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142339237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142339237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142339238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142339238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142339238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142339238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:40.668830 run osmo-stp_10.42.42.5(pid=32630): stdout: | (launched: 2022-12-14_14:23:39.063131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:40.791072 run osmo-stp_10.42.42.5(pid=32630): stderr: | 20221214142339237 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142339237 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142339237 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142339238 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142339238 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142339238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142339238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:40.938030 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32630): Process ended prematurely: osmo-stp_10.42.42.5(pid=32630) [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32630)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 14:23:40.946962 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 14:23:40.973645 run osmo-hlr_10.42.42.2(pid=32627): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32627)] 14:23:41.022389 run osmo-hlr_10.42.42.2(pid=32627): stdout: | (launched: 2022-12-14_14:23:38.097559) 14:23:41.072691 run osmo-hlr_10.42.42.2(pid=32627): stderr: | 20221214142338276 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142338276 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142338277 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142338277 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142338277 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142338277 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142338289 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142338298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142338298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142338298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:23:41.143013 run osmo-msc_10.42.42.6(pid=32633): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32633)] 14:23:41.191089 run osmo-msc_10.42.42.6(pid=32633): stdout: | (launched: 2022-12-14_14:23:40.047488) 14:23:41.241549 run osmo-msc_10.42.42.6(pid=32633): stderr: | 20221214142340322 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142340322 DLGLOBAL DEBUG validating counter group 0x7f159fa6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142340322 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142340322 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142340323 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142340323 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142340326 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142340327 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142340327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142340327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:23:41.292068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32626): Terminating (SIGTERM) 14:23:41.332324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32629): Terminating (SIGTERM) 14:23:41.372788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32632): Terminating (SIGTERM) 14:23:41.413553 --- ParallelTerminationStrategy: PID 32626 died... 14:23:41.433319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32626): Terminated: ok {rc=0} 14:23:41.477853 --- ParallelTerminationStrategy: PID 32629 died... 14:23:41.496809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32629): Terminated: ok {rc=0} 14:23:41.541183 --- ParallelTerminationStrategy: PID 32632 died... 14:23:41.560132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32632): Terminated: ok {rc=0} 14:23:41.644517 bus /sierra_3: Setting Powered False 14:23:42.741256 bus /sierra_3: Setting Powered False 14:23:43.857034 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 14:23:45.005401 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:45.017306 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:23:45.073795 tst mo_mt_call_osmux.py: using LAC 41506 14:23:45.195590 tst mo_mt_call_osmux.py: using RAC 196 14:23:45.317537 tst mo_mt_call_osmux.py: using CellId 41506 14:23:45.438352 tst mo_mt_call_osmux.py: using BVCI 41507 14:23:45.552098 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:45.563112 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:45.573955 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:45.584739 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:45.595960 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:23:45.607107 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:23:45.728598 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:23:45.849762 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:46.404511 run create_hlr_db(pid=32635): Launched 14:23:46.573498 bus /sierra_2: Setting Powered False 14:23:47.638232 run create_hlr_db(pid=32635): Terminated: ok {rc=0} 14:23:48.084163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32637): Launched 14:23:48.395890 run osmo-hlr_10.42.42.2(pid=32638): Launched 14:23:48.514239 run osmo-stp_10.42.42.5: Starting osmo-stp 14:23:49.065402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32640): Launched 14:23:49.375902 run osmo-stp_10.42.42.5(pid=32641): Launched 14:23:49.493416 run osmo-msc_10.42.42.6: Starting osmo-msc 14:23:50.051379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32643): Launched 14:23:50.362811 run osmo-msc_10.42.42.6(pid=32644): Launched 14:23:50.534890 run osmo-stp_10.42.42.5(pid=32641): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32641)] 14:23:50.666134 run osmo-stp_10.42.42.5(pid=32641): stdout: | (launched: 2022-12-14_14:23:49.317755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:50.797425 run osmo-stp_10.42.42.5(pid=32641): stderr: | 20221214142349490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142349490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142349491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142349491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142349491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142349491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142349492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:50.926283 run osmo-stp_10.42.42.5(pid=32641): stdout: | (launched: 2022-12-14_14:23:49.317755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:23:51.049695 run osmo-stp_10.42.42.5(pid=32641): stderr: | 20221214142349490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142349490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142349491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142349491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142349491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142349491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142349492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:23:51.197161 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32641): Process ended prematurely: osmo-stp_10.42.42.5(pid=32641) [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32641)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 14:23:51.206233 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:23:51.232693 run osmo-hlr_10.42.42.2(pid=32638): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32638)] 14:23:51.281688 run osmo-hlr_10.42.42.2(pid=32638): stdout: | (launched: 2022-12-14_14:23:48.337330) 14:23:51.331953 run osmo-hlr_10.42.42.2(pid=32638): stderr: | 20221214142348518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142348518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142348518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142348518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142348518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142348518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142348533 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142348541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142348541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142348541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:23:51.402027 run osmo-msc_10.42.42.6(pid=32644): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32644)] 14:23:51.450151 run osmo-msc_10.42.42.6(pid=32644): stdout: | (launched: 2022-12-14_14:23:50.303912) 14:23:51.500238 run osmo-msc_10.42.42.6(pid=32644): stderr: | 20221214142350580 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142350580 DLGLOBAL DEBUG validating counter group 0x7ffa1aeb6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142350580 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142350581 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142350581 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142350581 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142350583 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142350583 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142350583 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142350583 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:23:51.550555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32637): Terminating (SIGTERM) 14:23:51.590837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32640): Terminating (SIGTERM) 14:23:51.631089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32643): Terminating (SIGTERM) 14:23:51.671891 --- ParallelTerminationStrategy: PID 32637 died... 14:23:51.691755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32637): Terminated: ok {rc=0} 14:23:51.736379 --- ParallelTerminationStrategy: PID 32640 died... 14:23:51.755863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32640): Terminated: ok {rc=0} 14:23:51.800318 --- ParallelTerminationStrategy: PID 32643 died... 14:23:51.819518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32643): Terminated: ok {rc=0} 14:23:51.903410 bus /sierra_3: Setting Powered False 14:23:53.002037 bus /sierra_3: Setting Powered False 14:23:54.120069 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 14:23:55.352362 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:23:55.358856 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 14:23:55.379537 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 14:23:55.407828 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 14:23:55.460489 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 14:23:55.482105 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 14:23:55.509290 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 14:23:56.061516 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 14:23:56.111438 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:23:56.122650 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:23:56.178757 tst mo_mt_call.py: using LAC 41507 14:23:56.299076 tst mo_mt_call.py: using RAC 197 14:23:56.425243 tst mo_mt_call.py: using CellId 41507 14:23:56.545628 tst mo_mt_call.py: using BVCI 41508 14:23:56.667585 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:23:56.679411 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:23:56.690995 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:23:56.702859 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:23:56.714960 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:23:56.727148 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:23:56.846241 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:23:56.966705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:23:57.482502 run create_hlr_db(pid=32649): Launched 14:23:57.616384 bus /sierra_2: Setting Powered False 14:23:58.682116 run create_hlr_db(pid=32649): Terminated: ok {rc=0} 14:23:59.143914 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32651): Launched 14:23:59.475640 run osmo-hlr_10.42.42.2(pid=32652): Launched 14:23:59.606033 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:00.176308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32654): Launched 14:24:00.508183 run osmo-stp_10.42.42.5(pid=32655): Launched 14:24:00.634764 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:01.242945 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32657): Launched 14:24:01.592133 run osmo-msc_10.42.42.6(pid=32658): Launched 14:24:01.865606 run osmo-stp_10.42.42.5(pid=32655): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32655)] 14:24:02.174116 run osmo-stp_10.42.42.5(pid=32655): stdout: | (launched: 2022-12-14_14:24:00.446366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:02.424807 run osmo-stp_10.42.42.5(pid=32655): stderr: | 20221214142400642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142400642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142400642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142400642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142400645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142400645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142400645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:02.607941 run osmo-stp_10.42.42.5(pid=32655): stdout: | (launched: 2022-12-14_14:24:00.446366) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:02.756434 run osmo-stp_10.42.42.5(pid=32655): stderr: | 20221214142400642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142400642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142400642 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142400642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142400645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142400645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142400645 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:02.953819 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32655): Process ended prematurely: osmo-stp_10.42.42.5(pid=32655) [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32655)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 14:24:02.966073 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 14:24:02.999173 run osmo-hlr_10.42.42.2(pid=32652): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32652)] 14:24:03.062087 run osmo-hlr_10.42.42.2(pid=32652): stdout: | (launched: 2022-12-14_14:23:59.413922) 14:24:03.123412 run osmo-hlr_10.42.42.2(pid=32652): stderr: | 20221214142359616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142359616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142359616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142359616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142359616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142359616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142359629 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142359638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142359638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142359638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:03.203066 run osmo-msc_10.42.42.6(pid=32658): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32658)] 14:24:03.254196 run osmo-msc_10.42.42.6(pid=32658): stdout: | (launched: 2022-12-14_14:24:01.527960) 14:24:03.314138 run osmo-msc_10.42.42.6(pid=32658): stderr: | 20221214142402087 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142402088 DLGLOBAL DEBUG validating counter group 0x7fc8c78e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142402088 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142402088 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142402088 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142402088 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142402098 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142402099 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142402099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142402099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:03.371908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32651): Terminating (SIGTERM) 14:24:03.419457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32654): Terminating (SIGTERM) 14:24:03.475646 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32657): Terminating (SIGTERM) 14:24:03.525155 --- ParallelTerminationStrategy: PID 32651 died... 14:24:03.555503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32651): Terminated: ok {rc=0} 14:24:03.616504 --- ParallelTerminationStrategy: PID 32654 died... 14:24:03.642101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32654): Terminated: ok {rc=0} 14:24:03.700328 --- ParallelTerminationStrategy: PID 32657 died... 14:24:03.725633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32657): Terminated: ok {rc=0} 14:24:03.841376 bus /sierra_3: Setting Powered False 14:24:04.972838 bus /sierra_3: Setting Powered False 14:24:06.091872 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 14:24:07.242158 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:24:07.255837 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:24:07.315422 tst mo_mt_call_osmux.py: using LAC 41508 14:24:07.440728 tst mo_mt_call_osmux.py: using RAC 198 14:24:07.567311 tst mo_mt_call_osmux.py: using CellId 41508 14:24:07.701264 tst mo_mt_call_osmux.py: using BVCI 41509 14:24:07.818015 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:24:07.830387 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:24:07.842366 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:24:07.855421 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:24:07.868633 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:24:07.883019 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:24:08.003762 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:24:08.124904 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:08.622132 run create_hlr_db(pid=476): Launched 14:24:08.785617 bus /sierra_2: Setting Powered False 14:24:09.847335 run create_hlr_db(pid=476): Terminated: ok {rc=0} 14:24:10.296892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=478): Launched 14:24:10.638847 run osmo-hlr_10.42.42.2(pid=479): Launched 14:24:10.891770 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:11.578497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=481): Launched 14:24:11.950792 run osmo-stp_10.42.42.5(pid=482): Launched 14:24:12.091963 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:12.775611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=484): Launched 14:24:13.113347 run osmo-msc_10.42.42.6(pid=485): Launched 14:24:13.468723 run osmo-stp_10.42.42.5(pid=482): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=482)] 14:24:13.754934 run osmo-stp_10.42.42.5(pid=482): stdout: | (launched: 2022-12-14_14:24:11.865915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:14.041539 run osmo-stp_10.42.42.5(pid=482): stderr: | 20221214142412235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142412235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142412235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142412236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142412236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142412236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142412236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:14.213940 run osmo-stp_10.42.42.5(pid=482): stdout: | (launched: 2022-12-14_14:24:11.865915) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:14.345224 run osmo-stp_10.42.42.5(pid=482): stderr: | 20221214142412235 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142412235 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142412235 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142412236 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142412236 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142412236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142412236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:14.499507 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=482): Process ended prematurely: osmo-stp_10.42.42.5(pid=482) [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=482)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 14:24:14.509606 tst mo_mt_call_osmux.py:8: Test FAILED (7.3 sec) 14:24:14.537642 run osmo-hlr_10.42.42.2(pid=479): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=479)] 14:24:14.590760 run osmo-hlr_10.42.42.2(pid=479): stdout: | (launched: 2022-12-14_14:24:10.572637) 14:24:14.643144 run osmo-hlr_10.42.42.2(pid=479): stderr: | 20221214142410887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142410887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142410887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142410888 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142410888 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142410888 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142410904 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142410912 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142410912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142410912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:14.718406 run osmo-msc_10.42.42.6(pid=485): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=485)] 14:24:14.768628 run osmo-msc_10.42.42.6(pid=485): stdout: | (launched: 2022-12-14_14:24:13.047757) 14:24:14.821555 run osmo-msc_10.42.42.6(pid=485): stderr: | 20221214142413650 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142413650 DLGLOBAL DEBUG validating counter group 0x7ff2868a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142413650 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142413650 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142413650 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142413651 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142413664 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142413664 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142413665 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142413665 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:14.876611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=478): Terminating (SIGTERM) 14:24:14.920328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=481): Terminating (SIGTERM) 14:24:14.965955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=484): Terminating (SIGTERM) 14:24:15.011686 --- ParallelTerminationStrategy: PID 478 died... 14:24:15.033391 run pcap-recorder_any(filters='host 10.42.42.2')(pid=478): Terminated: ok {rc=0} 14:24:15.083257 --- ParallelTerminationStrategy: PID 481 died... 14:24:15.104164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=481): Terminated: ok {rc=0} 14:24:15.151363 --- ParallelTerminationStrategy: PID 484 died... 14:24:15.172556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=484): Terminated: ok {rc=0} 14:24:15.264444 bus /sierra_3: Setting Powered False 14:24:16.390636 bus /sierra_3: Setting Powered False 14:24:17.524672 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 14:24:18.765072 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:24:18.772036 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 14:24:18.793946 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 14:24:18.824530 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 14:24:18.879702 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 14:24:18.901393 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 14:24:18.930289 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 14:24:19.478475 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 14:24:19.533829 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:19.546523 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:24:19.606276 tst mo_mt_call.py: using LAC 41509 14:24:19.735725 tst mo_mt_call.py: using RAC 199 14:24:19.861779 tst mo_mt_call.py: using CellId 41509 14:24:19.989195 tst mo_mt_call.py: using BVCI 41510 14:24:20.111871 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:20.124591 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:20.136664 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:20.148635 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:20.162017 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:20.175405 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:24:20.302196 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:24:20.425679 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:20.931916 run create_hlr_db(pid=490): Launched 14:24:21.097793 bus /sierra_2: Setting Powered False 14:24:22.160374 run create_hlr_db(pid=490): Terminated: ok {rc=0} 14:24:22.617117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=492): Launched 14:24:22.958146 run osmo-hlr_10.42.42.2(pid=493): Launched 14:24:23.207601 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:23.961391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=495): Launched 14:24:24.293371 run osmo-stp_10.42.42.5(pid=496): Launched 14:24:24.415300 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:24.977621 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=498): Launched 14:24:25.290074 run osmo-msc_10.42.42.6(pid=499): Launched 14:24:25.463211 run osmo-stp_10.42.42.5(pid=496): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=496)] 14:24:25.594826 run osmo-stp_10.42.42.5(pid=496): stdout: | (launched: 2022-12-14_14:24:24.234206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:25.725482 run osmo-stp_10.42.42.5(pid=496): stderr: | 20221214142424406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142424406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142424406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142424407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142424407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142424407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142424407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:25.855034 run osmo-stp_10.42.42.5(pid=496): stdout: | (launched: 2022-12-14_14:24:24.234206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:25.977870 run osmo-stp_10.42.42.5(pid=496): stderr: | 20221214142424406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142424406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142424406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142424407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142424407 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142424407 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142424407 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:26.125891 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=496): Process ended prematurely: osmo-stp_10.42.42.5(pid=496) [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=496)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 14:24:26.134817 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 14:24:26.161321 run osmo-hlr_10.42.42.2(pid=493): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=493)] 14:24:26.210380 run osmo-hlr_10.42.42.2(pid=493): stdout: | (launched: 2022-12-14_14:24:22.894749) 14:24:26.260595 run osmo-hlr_10.42.42.2(pid=493): stderr: | 20221214142423253 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142423253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142423253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142423253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142423254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142423254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142423274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142423282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142423282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142423282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:26.330682 run osmo-msc_10.42.42.6(pid=499): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=499)] 14:24:26.378895 run osmo-msc_10.42.42.6(pid=499): stdout: | (launched: 2022-12-14_14:24:25.231221) 14:24:26.429081 run osmo-msc_10.42.42.6(pid=499): stderr: | 20221214142425506 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142425507 DLGLOBAL DEBUG validating counter group 0x7ff3173b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142425507 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142425507 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142425507 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142425507 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142425509 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142425509 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142425509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142425509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:26.479352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=492): Terminating (SIGTERM) 14:24:26.519596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=495): Terminating (SIGTERM) 14:24:26.559850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=498): Terminating (SIGTERM) 14:24:26.600443 --- ParallelTerminationStrategy: PID 492 died... 14:24:26.619485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=492): Terminated: ok {rc=0} 14:24:26.663855 --- ParallelTerminationStrategy: PID 495 died... 14:24:26.682840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=495): Terminated: ok {rc=0} 14:24:26.726912 --- ParallelTerminationStrategy: PID 498 died... 14:24:26.745947 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=498): Terminated: ok {rc=0} 14:24:26.832775 bus /sierra_3: Setting Powered False 14:24:27.931572 bus /sierra_3: Setting Powered False 14:24:29.048900 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 14:24:30.201354 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:30.213657 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:24:30.271777 tst mo_mt_call_osmux.py: using LAC 41510 14:24:30.400058 tst mo_mt_call_osmux.py: using RAC 200 14:24:30.521363 tst mo_mt_call_osmux.py: using CellId 41510 14:24:30.642399 tst mo_mt_call_osmux.py: using BVCI 41511 14:24:30.755771 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:30.766981 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:30.778036 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:30.788839 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:30.800015 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:24:30.811827 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:24:30.949253 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:24:31.066349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:31.597851 run create_hlr_db(pid=501): Launched 14:24:31.755525 bus /sierra_2: Setting Powered False 14:24:32.821528 run create_hlr_db(pid=501): Terminated: ok {rc=0} 14:24:33.265983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=503): Launched 14:24:33.577390 run osmo-hlr_10.42.42.2(pid=504): Launched 14:24:33.695790 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:34.232089 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=506): Launched 14:24:34.543360 run osmo-stp_10.42.42.5(pid=507): Launched 14:24:34.660692 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:35.219840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=509): Launched 14:24:35.531377 run osmo-msc_10.42.42.6(pid=510): Launched 14:24:35.704163 run osmo-stp_10.42.42.5(pid=507): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=507)] 14:24:35.834446 run osmo-stp_10.42.42.5(pid=507): stdout: | (launched: 2022-12-14_14:24:34.484832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:35.965307 run osmo-stp_10.42.42.5(pid=507): stderr: | 20221214142434659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142434660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142434660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142434660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142434661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142434661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142434661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:36.094706 run osmo-stp_10.42.42.5(pid=507): stdout: | (launched: 2022-12-14_14:24:34.484832) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:36.218241 run osmo-stp_10.42.42.5(pid=507): stderr: | 20221214142434659 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142434660 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142434660 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142434660 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142434661 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142434661 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142434661 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:36.365398 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=507): Process ended prematurely: osmo-stp_10.42.42.5(pid=507) [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=507)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 14:24:36.374462 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:24:36.400860 run osmo-hlr_10.42.42.2(pid=504): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=504)] 14:24:36.449741 run osmo-hlr_10.42.42.2(pid=504): stdout: | (launched: 2022-12-14_14:24:33.518750) 14:24:36.499967 run osmo-hlr_10.42.42.2(pid=504): stderr: | 20221214142433697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142433697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142433697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142433697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142433697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142433697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142433710 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142433719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142433719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142433719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:36.569869 run osmo-msc_10.42.42.6(pid=510): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=510)] 14:24:36.617886 run osmo-msc_10.42.42.6(pid=510): stdout: | (launched: 2022-12-14_14:24:35.472830) 14:24:36.667665 run osmo-msc_10.42.42.6(pid=510): stderr: | 20221214142435747 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142435747 DLGLOBAL DEBUG validating counter group 0x7f4aca7b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142435747 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142435747 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142435748 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142435748 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142435750 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142435750 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142435750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142435750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:36.718155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=503): Terminating (SIGTERM) 14:24:36.758488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=506): Terminating (SIGTERM) 14:24:36.798791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=509): Terminating (SIGTERM) 14:24:36.839992 --- ParallelTerminationStrategy: PID 503 died... 14:24:36.859596 run pcap-recorder_any(filters='host 10.42.42.2')(pid=503): Terminated: ok {rc=0} 14:24:36.904133 --- ParallelTerminationStrategy: PID 506 died... 14:24:36.923285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=506): Terminated: ok {rc=0} 14:24:36.967583 --- ParallelTerminationStrategy: PID 509 died... 14:24:36.986692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=509): Terminated: ok {rc=0} 14:24:37.073046 bus /sierra_3: Setting Powered False 14:24:38.171252 bus /sierra_3: Setting Powered False 14:24:39.285802 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 14:24:40.519524 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:24:40.526052 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 14:24:40.546540 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 14:24:40.574414 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 14:24:40.627481 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 14:24:40.649052 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 14:24:40.675683 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 14:24:41.223778 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 14:24:41.274098 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:41.285217 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:24:41.341416 tst mo_mt_call.py: using LAC 41511 14:24:41.465231 tst mo_mt_call.py: using RAC 201 14:24:41.604414 tst mo_mt_call.py: using CellId 41511 14:24:41.734268 tst mo_mt_call.py: using BVCI 41512 14:24:41.855364 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:41.866886 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:41.878139 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:41.889467 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:41.900693 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:41.912076 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:24:42.030232 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:24:42.150359 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:42.665368 run create_hlr_db(pid=515): Launched 14:24:42.799596 bus /sierra_2: Setting Powered False 14:24:43.864593 run create_hlr_db(pid=515): Terminated: ok {rc=0} 14:24:44.308202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=517): Launched 14:24:44.620295 run osmo-hlr_10.42.42.2(pid=518): Launched 14:24:44.737655 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:45.291269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=520): Launched 14:24:45.602880 run osmo-stp_10.42.42.5(pid=521): Launched 14:24:45.720525 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:46.352218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=523): Launched 14:24:46.708149 run osmo-msc_10.42.42.6(pid=524): Launched 14:24:46.951346 run osmo-stp_10.42.42.5(pid=521): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=521)] 14:24:47.267237 run osmo-stp_10.42.42.5(pid=521): stdout: | (launched: 2022-12-14_14:24:45.543878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:47.443473 run osmo-stp_10.42.42.5(pid=521): stderr: | 20221214142445719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142445720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142445720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142445720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142445723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142445723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142445723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:47.586822 run osmo-stp_10.42.42.5(pid=521): stdout: | (launched: 2022-12-14_14:24:45.543878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:47.719216 run osmo-stp_10.42.42.5(pid=521): stderr: | 20221214142445719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142445720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142445720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142445720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142445723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142445723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142445723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:47.877124 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=521): Process ended prematurely: osmo-stp_10.42.42.5(pid=521) [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=521)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 14:24:47.886753 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 14:24:47.914476 run osmo-hlr_10.42.42.2(pid=518): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=518)] 14:24:47.965844 run osmo-hlr_10.42.42.2(pid=518): stdout: | (launched: 2022-12-14_14:24:44.561639) 14:24:48.018651 run osmo-hlr_10.42.42.2(pid=518): stderr: | 20221214142444743 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142444743 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142444743 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142444743 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142444743 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142444743 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142444756 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142444767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142444767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142444767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:48.092183 run osmo-msc_10.42.42.6(pid=524): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=524)] 14:24:48.142529 run osmo-msc_10.42.42.6(pid=524): stdout: | (launched: 2022-12-14_14:24:46.642444) 14:24:48.194932 run osmo-msc_10.42.42.6(pid=524): stderr: | 20221214142447256 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142447260 DLGLOBAL DEBUG validating counter group 0x7fca59e5ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142447260 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142447260 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142447260 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142447261 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142447262 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142447263 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142447263 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142447263 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:48.247732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=517): Terminating (SIGTERM) 14:24:48.290335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=520): Terminating (SIGTERM) 14:24:48.332751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=523): Terminating (SIGTERM) 14:24:48.375941 --- ParallelTerminationStrategy: PID 517 died... 14:24:48.396595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=517): Terminated: ok {rc=0} 14:24:48.443493 --- ParallelTerminationStrategy: PID 520 died... 14:24:48.463637 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=520): Terminated: ok {rc=0} 14:24:48.510516 --- ParallelTerminationStrategy: PID 523 died... 14:24:48.530667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=523): Terminated: ok {rc=0} 14:24:48.619791 bus /sierra_3: Setting Powered False 14:24:49.716640 bus /sierra_3: Setting Powered False 14:24:50.834687 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 14:24:51.984498 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:51.996743 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:24:52.057945 tst mo_mt_call_osmux.py: using LAC 41512 14:24:52.187261 tst mo_mt_call_osmux.py: using RAC 202 14:24:52.315596 tst mo_mt_call_osmux.py: using CellId 41512 14:24:52.442970 tst mo_mt_call_osmux.py: using BVCI 41513 14:24:52.563254 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:52.574903 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:52.586312 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:52.597654 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:52.609057 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:24:52.620445 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:24:52.738674 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:24:52.858825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:24:53.374729 run create_hlr_db(pid=526): Launched 14:24:53.508228 bus /sierra_2: Setting Powered False 14:24:54.574043 run create_hlr_db(pid=526): Terminated: ok {rc=0} 14:24:55.018093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=528): Launched 14:24:55.329383 run osmo-hlr_10.42.42.2(pid=529): Launched 14:24:55.447334 run osmo-stp_10.42.42.5: Starting osmo-stp 14:24:56.003934 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=531): Launched 14:24:56.315645 run osmo-stp_10.42.42.5(pid=532): Launched 14:24:56.433806 run osmo-msc_10.42.42.6: Starting osmo-msc 14:24:56.995342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=534): Launched 14:24:57.307225 run osmo-msc_10.42.42.6(pid=535): Launched 14:24:57.480586 run osmo-stp_10.42.42.5(pid=532): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=532)] 14:24:57.612426 run osmo-stp_10.42.42.5(pid=532): stdout: | (launched: 2022-12-14_14:24:56.256596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:57.744073 run osmo-stp_10.42.42.5(pid=532): stderr: | 20221214142456431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142456431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142456431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142456431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142456434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142456434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142456434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:57.873309 run osmo-stp_10.42.42.5(pid=532): stdout: | (launched: 2022-12-14_14:24:56.256596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:24:57.995777 run osmo-stp_10.42.42.5(pid=532): stderr: | 20221214142456431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142456431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142456431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142456431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142456434 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142456434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142456434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:24:58.142414 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=532): Process ended prematurely: osmo-stp_10.42.42.5(pid=532) [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=532)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 14:24:58.151410 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:24:58.177717 run osmo-hlr_10.42.42.2(pid=529): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=529)] 14:24:58.226475 run osmo-hlr_10.42.42.2(pid=529): stdout: | (launched: 2022-12-14_14:24:55.270571) 14:24:58.276466 run osmo-hlr_10.42.42.2(pid=529): stderr: | 20221214142455449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142455450 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142455450 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142455450 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142455450 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142455450 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142455463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142455473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142455473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142455474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:24:58.346360 run osmo-msc_10.42.42.6(pid=535): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=535)] 14:24:58.394444 run osmo-msc_10.42.42.6(pid=535): stdout: | (launched: 2022-12-14_14:24:57.248601) 14:24:58.444481 run osmo-msc_10.42.42.6(pid=535): stderr: | 20221214142457525 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142457525 DLGLOBAL DEBUG validating counter group 0x7fa63bd82c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142457526 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142457526 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142457526 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142457526 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142457528 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142457528 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142457528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142457528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:24:58.494871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=528): Terminating (SIGTERM) 14:24:58.535381 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=531): Terminating (SIGTERM) 14:24:58.575808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=534): Terminating (SIGTERM) 14:24:58.616372 --- ParallelTerminationStrategy: PID 528 died... 14:24:58.635814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=528): Terminated: ok {rc=0} 14:24:58.680314 --- ParallelTerminationStrategy: PID 531 died... 14:24:58.699259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=531): Terminated: ok {rc=0} 14:24:58.743769 --- ParallelTerminationStrategy: PID 534 died... 14:24:58.762735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=534): Terminated: ok {rc=0} 14:24:58.850273 bus /sierra_3: Setting Powered False 14:24:59.948994 bus /sierra_3: Setting Powered False 14:25:01.078867 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 14:25:02.338203 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:25:02.345087 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 14:25:02.366575 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 14:25:02.394062 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 14:25:02.446487 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 14:25:02.468029 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 14:25:02.495382 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 14:25:03.043924 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 14:25:03.094570 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:03.105822 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:25:03.161352 tst mo_mt_call.py: using LAC 41513 14:25:03.285369 tst mo_mt_call.py: using RAC 203 14:25:03.408795 tst mo_mt_call.py: using CellId 41513 14:25:03.533191 tst mo_mt_call.py: using BVCI 41514 14:25:03.647433 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:03.658656 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:03.669505 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:03.680166 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:03.691494 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:03.702832 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:25:03.819269 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:25:03.942787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:04.426320 run create_hlr_db(pid=544): Launched 14:25:04.544704 bus /sierra_2: Setting Powered False 14:25:05.606219 run create_hlr_db(pid=544): Terminated: ok {rc=0} 14:25:06.061241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=546): Launched 14:25:06.396824 run osmo-hlr_10.42.42.2(pid=547): Launched 14:25:06.523462 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:07.097055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=549): Launched 14:25:07.431014 run osmo-stp_10.42.42.5(pid=550): Launched 14:25:07.558676 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:08.161848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=553): Launched 14:25:08.495363 run osmo-msc_10.42.42.6(pid=554): Launched 14:25:08.680293 run osmo-stp_10.42.42.5(pid=550): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=550)] 14:25:08.820576 run osmo-stp_10.42.42.5(pid=550): stdout: | (launched: 2022-12-14_14:25:07.368359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:08.961353 run osmo-stp_10.42.42.5(pid=550): stderr: | 20221214142507564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142507564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142507564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142507565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142507567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142507567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142507567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:09.100412 run osmo-stp_10.42.42.5(pid=550): stdout: | (launched: 2022-12-14_14:25:07.368359) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:09.231927 run osmo-stp_10.42.42.5(pid=550): stderr: | 20221214142507564 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142507564 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142507564 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142507565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142507567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142507567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142507567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:09.389607 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=550): Process ended prematurely: osmo-stp_10.42.42.5(pid=550) [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=550)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 14:25:09.399169 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:25:09.426956 run osmo-hlr_10.42.42.2(pid=547): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=547)] 14:25:09.477467 run osmo-hlr_10.42.42.2(pid=547): stdout: | (launched: 2022-12-14_14:25:06.334527) 14:25:09.529675 run osmo-hlr_10.42.42.2(pid=547): stderr: | 20221214142506536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142506537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142506537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142506537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142506537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142506537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142506549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142506558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142506558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142506558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:09.602325 run osmo-msc_10.42.42.6(pid=554): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=554)] 14:25:09.652892 run osmo-msc_10.42.42.6(pid=554): stdout: | (launched: 2022-12-14_14:25:08.432614) 14:25:09.705830 run osmo-msc_10.42.42.6(pid=554): stderr: | 20221214142508759 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142508759 DLGLOBAL DEBUG validating counter group 0x7fde47a78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142508759 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142508759 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142508760 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142508760 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142508761 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142508762 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142508762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142508762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:09.758438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=546): Terminating (SIGTERM) 14:25:09.800704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=549): Terminating (SIGTERM) 14:25:09.843385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=553): Terminating (SIGTERM) 14:25:09.885967 --- ParallelTerminationStrategy: PID 546 died... 14:25:09.906154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=546): Terminated: ok {rc=0} 14:25:09.952497 --- ParallelTerminationStrategy: PID 549 died... 14:25:09.972172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=549): Terminated: ok {rc=0} 14:25:10.018468 --- ParallelTerminationStrategy: PID 553 died... 14:25:10.038147 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=553): Terminated: ok {rc=0} 14:25:10.127039 bus /sierra_3: Setting Powered False 14:25:11.227255 bus /sierra_3: Setting Powered False 14:25:12.347401 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 14:25:13.496161 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:13.508047 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:25:13.567647 tst mo_mt_call_osmux.py: using LAC 41514 14:25:13.697130 tst mo_mt_call_osmux.py: using RAC 204 14:25:13.825076 tst mo_mt_call_osmux.py: using CellId 41514 14:25:13.952795 tst mo_mt_call_osmux.py: using BVCI 41515 14:25:14.072695 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:14.084335 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:14.095813 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:14.107163 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:14.118601 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:25:14.130048 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:25:14.251286 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:25:14.373466 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:14.854151 run create_hlr_db(pid=556): Launched 14:25:14.973314 bus /sierra_2: Setting Powered False 14:25:16.069426 run create_hlr_db(pid=556): Terminated: ok {rc=0} 14:25:16.549664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=558): Launched 14:25:16.909658 run osmo-hlr_10.42.42.2(pid=559): Launched 14:25:17.146287 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:17.716739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=561): Launched 14:25:18.046645 run osmo-stp_10.42.42.5(pid=562): Launched 14:25:18.171167 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:18.770474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=564): Launched 14:25:19.099964 run osmo-msc_10.42.42.6(pid=565): Launched 14:25:19.282846 run osmo-stp_10.42.42.5(pid=562): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=562)] 14:25:19.421151 run osmo-stp_10.42.42.5(pid=562): stdout: | (launched: 2022-12-14_14:25:17.985275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:19.560175 run osmo-stp_10.42.42.5(pid=562): stderr: | 20221214142518183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142518183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142518183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142518184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142518184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142518184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142518185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:19.698826 run osmo-stp_10.42.42.5(pid=562): stdout: | (launched: 2022-12-14_14:25:17.985275) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:19.829434 run osmo-stp_10.42.42.5(pid=562): stderr: | 20221214142518183 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142518183 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142518183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142518184 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142518184 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142518184 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142518185 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:19.985128 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=562): Process ended prematurely: osmo-stp_10.42.42.5(pid=562) [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=562)] [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 14:25:19.994644 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 14:25:20.022260 run osmo-hlr_10.42.42.2(pid=559): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=559)] 14:25:20.072498 run osmo-hlr_10.42.42.2(pid=559): stdout: | (launched: 2022-12-14_14:25:16.834471) 14:25:20.124250 run osmo-hlr_10.42.42.2(pid=559): stderr: | 20221214142517065 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142517065 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142517065 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142517065 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142517065 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142517065 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142517088 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142517100 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142517100 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142517101 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:20.196018 run osmo-msc_10.42.42.6(pid=565): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=565)] 14:25:20.246397 run osmo-msc_10.42.42.6(pid=565): stdout: | (launched: 2022-12-14_14:25:19.038420) 14:25:20.298268 run osmo-msc_10.42.42.6(pid=565): stderr: | 20221214142519363 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142519363 DLGLOBAL DEBUG validating counter group 0x7fa1eaeebc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142519363 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142519364 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142519364 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142519364 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142519366 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142519366 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142519366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142519366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:20.350214 run pcap-recorder_any(filters='host 10.42.42.2')(pid=558): Terminating (SIGTERM) 14:25:20.391870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=561): Terminating (SIGTERM) 14:25:20.433467 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=564): Terminating (SIGTERM) 14:25:20.475321 --- ParallelTerminationStrategy: PID 558 died... 14:25:20.495225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=558): Terminated: ok {rc=0} 14:25:20.541302 --- ParallelTerminationStrategy: PID 561 died... 14:25:20.560784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=561): Terminated: ok {rc=0} 14:25:20.606691 --- ParallelTerminationStrategy: PID 564 died... 14:25:20.626162 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=564): Terminated: ok {rc=0} 14:25:20.714222 bus /sierra_3: Setting Powered False 14:25:21.813189 bus /sierra_3: Setting Powered False 14:25:22.930180 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:25:24.168378 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:25:24.175371 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:25:24.196645 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 14:25:24.224481 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:25:24.277322 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:25:24.298766 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 14:25:24.325756 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:25:24.877843 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 14:25:24.930591 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:24.942415 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:25:25.000417 tst mo_mt_call.py: using LAC 41515 14:25:25.130589 tst mo_mt_call.py: using RAC 205 14:25:25.260541 tst mo_mt_call.py: using CellId 41515 14:25:25.389059 tst mo_mt_call.py: using BVCI 41516 14:25:25.507959 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:25.519623 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:25.530964 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:25.542341 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:25.553909 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:25.565722 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:25:25.686262 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:25:25.803669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:26.280870 run create_hlr_db(pid=570): Launched 14:25:26.403476 bus /sierra_2: Setting Powered False 14:25:27.463281 run create_hlr_db(pid=570): Terminated: ok {rc=0} 14:25:27.910817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=572): Launched 14:25:28.237437 run osmo-hlr_10.42.42.2(pid=573): Launched 14:25:28.361640 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:28.926452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=575): Launched 14:25:29.253109 run osmo-stp_10.42.42.5(pid=576): Launched 14:25:29.377010 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:29.966517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=578): Launched 14:25:30.292728 run osmo-msc_10.42.42.6(pid=579): Launched 14:25:30.473776 run osmo-stp_10.42.42.5(pid=576): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=576)] 14:25:30.610606 run osmo-stp_10.42.42.5(pid=576): stdout: | (launched: 2022-12-14_14:25:29.192157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:30.749257 run osmo-stp_10.42.42.5(pid=576): stderr: | 20221214142529390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142529390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142529390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142529391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142529391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142529391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142529391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:30.892140 run osmo-stp_10.42.42.5(pid=576): stdout: | (launched: 2022-12-14_14:25:29.192157) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:31.023753 run osmo-stp_10.42.42.5(pid=576): stderr: | 20221214142529390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142529390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142529390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142529391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142529391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142529391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142529391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:31.180359 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=576): Process ended prematurely: osmo-stp_10.42.42.5(pid=576) [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=576)] [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 14:25:31.190661 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:25:31.219185 run osmo-hlr_10.42.42.2(pid=573): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=573)] 14:25:31.269605 run osmo-hlr_10.42.42.2(pid=573): stdout: | (launched: 2022-12-14_14:25:28.176716) 14:25:31.321780 run osmo-hlr_10.42.42.2(pid=573): stderr: | 20221214142528378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142528378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142528378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142528379 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142528379 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142528379 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142528391 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142528399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142528399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142528400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:31.394888 run osmo-msc_10.42.42.6(pid=579): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=579)] 14:25:31.445410 run osmo-msc_10.42.42.6(pid=579): stdout: | (launched: 2022-12-14_14:25:30.231789) 14:25:31.497622 run osmo-msc_10.42.42.6(pid=579): stderr: | 20221214142530559 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142530559 DLGLOBAL DEBUG validating counter group 0x7f0ed0555c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142530559 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142530559 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142530559 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142530559 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142530561 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142530562 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142530562 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142530562 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:31.550303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=572): Terminating (SIGTERM) 14:25:31.593427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=575): Terminating (SIGTERM) 14:25:31.637216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=578): Terminating (SIGTERM) 14:25:31.680035 --- ParallelTerminationStrategy: PID 572 died... 14:25:31.702277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=572): Terminated: ok {rc=0} 14:25:31.749267 --- ParallelTerminationStrategy: PID 575 died... 14:25:31.769392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=575): Terminated: ok {rc=0} 14:25:31.817368 --- ParallelTerminationStrategy: PID 578 died... 14:25:31.838108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=578): Terminated: ok {rc=0} 14:25:31.932933 bus /sierra_3: Setting Powered False 14:25:33.045862 bus /sierra_3: Setting Powered False 14:25:34.162288 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 14:25:35.312301 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:35.324725 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:25:35.384712 tst mo_mt_call_osmux.py: using LAC 41516 14:25:35.504721 tst mo_mt_call_osmux.py: using RAC 206 14:25:35.629380 tst mo_mt_call_osmux.py: using CellId 41516 14:25:35.757442 tst mo_mt_call_osmux.py: using BVCI 41517 14:25:35.878775 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:35.890441 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:35.901945 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:35.913380 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:35.924778 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:25:35.936155 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:25:36.054858 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:25:36.170212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:36.643943 run create_hlr_db(pid=581): Launched 14:25:36.759838 bus /sierra_2: Setting Powered False 14:25:37.819645 run create_hlr_db(pid=581): Terminated: ok {rc=0} 14:25:38.267411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=583): Launched 14:25:38.596707 run osmo-hlr_10.42.42.2(pid=584): Launched 14:25:38.721383 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:39.280131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=586): Launched 14:25:39.609047 run osmo-stp_10.42.42.5(pid=587): Launched 14:25:39.733368 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:40.322241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=589): Launched 14:25:40.649120 run osmo-msc_10.42.42.6(pid=590): Launched 14:25:40.830820 run osmo-stp_10.42.42.5(pid=587): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=587)] 14:25:40.967990 run osmo-stp_10.42.42.5(pid=587): stdout: | (launched: 2022-12-14_14:25:39.548240) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:41.106190 run osmo-stp_10.42.42.5(pid=587): stderr: | 20221214142539742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142539742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142539742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142539743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142539743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142539743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142539743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:41.243021 run osmo-stp_10.42.42.5(pid=587): stdout: | (launched: 2022-12-14_14:25:39.548240) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:41.372673 run osmo-stp_10.42.42.5(pid=587): stderr: | 20221214142539742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142539742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142539742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142539743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142539743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142539743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142539743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:41.527642 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=587): Process ended prematurely: osmo-stp_10.42.42.5(pid=587) [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=587)] [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 14:25:41.537338 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:25:41.565248 run osmo-hlr_10.42.42.2(pid=584): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=584)] 14:25:41.616037 run osmo-hlr_10.42.42.2(pid=584): stdout: | (launched: 2022-12-14_14:25:38.535705) 14:25:41.668270 run osmo-hlr_10.42.42.2(pid=584): stderr: | 20221214142538735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142538735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142538735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142538735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142538735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142538735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142538748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142538756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142538756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142538756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:41.741644 run osmo-msc_10.42.42.6(pid=590): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=590)] 14:25:41.791804 run osmo-msc_10.42.42.6(pid=590): stdout: | (launched: 2022-12-14_14:25:40.588107) 14:25:41.843410 run osmo-msc_10.42.42.6(pid=590): stderr: | 20221214142540916 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142540916 DLGLOBAL DEBUG validating counter group 0x7fa1e7d11c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142540916 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142540916 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142540916 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142540916 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142540918 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142540918 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142540919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142540919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:41.895289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=583): Terminating (SIGTERM) 14:25:41.937193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=586): Terminating (SIGTERM) 14:25:41.978845 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=589): Terminating (SIGTERM) 14:25:42.020526 --- ParallelTerminationStrategy: PID 583 died... 14:25:42.040686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=583): Terminated: ok {rc=0} 14:25:42.086687 --- ParallelTerminationStrategy: PID 586 died... 14:25:42.106433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=586): Terminated: ok {rc=0} 14:25:42.152203 --- ParallelTerminationStrategy: PID 589 died... 14:25:42.171881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=589): Terminated: ok {rc=0} 14:25:42.259176 bus /sierra_3: Setting Powered False 14:25:43.355650 bus /sierra_3: Setting Powered False 14:25:44.470344 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:25:45.704078 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:25:45.710090 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:25:45.731238 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 14:25:45.758373 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 14:25:45.810700 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:25:45.840416 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 14:25:45.874036 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 14:25:46.426130 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 14:25:46.497308 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:46.512350 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:25:46.572561 tst mo_mt_call.py: using LAC 41517 14:25:46.702427 tst mo_mt_call.py: using RAC 207 14:25:46.834545 tst mo_mt_call.py: using CellId 41517 14:25:46.988735 tst mo_mt_call.py: using BVCI 41518 14:25:47.143845 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:47.160529 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:47.176673 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:47.189647 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:47.203052 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:47.218518 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:25:47.343422 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:25:47.462098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:47.931856 run create_hlr_db(pid=595): Launched 14:25:48.046988 bus /sierra_2: Setting Powered False 14:25:49.107332 run create_hlr_db(pid=595): Terminated: ok {rc=0} 14:25:49.552368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=597): Launched 14:25:49.878981 run osmo-hlr_10.42.42.2(pid=598): Launched 14:25:50.002415 run osmo-stp_10.42.42.5: Starting osmo-stp 14:25:50.562932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=600): Launched 14:25:50.891301 run osmo-stp_10.42.42.5(pid=601): Launched 14:25:51.013852 run osmo-msc_10.42.42.6: Starting osmo-msc 14:25:51.603999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=603): Launched 14:25:51.931823 run osmo-msc_10.42.42.6(pid=604): Launched 14:25:52.116531 run osmo-stp_10.42.42.5(pid=601): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=601)] 14:25:52.257884 run osmo-stp_10.42.42.5(pid=601): stdout: | (launched: 2022-12-14_14:25:50.826921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:52.394414 run osmo-stp_10.42.42.5(pid=601): stderr: | 20221214142551023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142551023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142551024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142551024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142551025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142551025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142551025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:52.529184 run osmo-stp_10.42.42.5(pid=601): stdout: | (launched: 2022-12-14_14:25:50.826921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:25:52.656794 run osmo-stp_10.42.42.5(pid=601): stderr: | 20221214142551023 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142551023 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142551024 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142551024 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142551025 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142551025 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142551025 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:25:52.810643 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=601): Process ended prematurely: osmo-stp_10.42.42.5(pid=601) [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=601)] [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 14:25:52.820182 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 14:25:52.847736 run osmo-hlr_10.42.42.2(pid=598): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=598)] 14:25:52.897579 run osmo-hlr_10.42.42.2(pid=598): stdout: | (launched: 2022-12-14_14:25:49.814900) 14:25:52.948765 run osmo-hlr_10.42.42.2(pid=598): stderr: | 20221214142550017 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142550017 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142550017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142550017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142550017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142550017 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142550029 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142550038 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142550038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142550038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:25:53.020479 run osmo-msc_10.42.42.6(pid=604): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=604)] 14:25:53.070144 run osmo-msc_10.42.42.6(pid=604): stdout: | (launched: 2022-12-14_14:25:51.867043) 14:25:53.122029 run osmo-msc_10.42.42.6(pid=604): stderr: | 20221214142552202 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142552202 DLGLOBAL DEBUG validating counter group 0x7f59a987bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142552202 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142552202 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142552202 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142552202 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142552206 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142552206 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142552206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142552207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:25:53.173708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=597): Terminating (SIGTERM) 14:25:53.215187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=600): Terminating (SIGTERM) 14:25:53.256748 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=603): Terminating (SIGTERM) 14:25:53.299212 --- ParallelTerminationStrategy: PID 597 died... 14:25:53.319227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=597): Terminated: ok {rc=0} 14:25:53.365217 --- ParallelTerminationStrategy: PID 600 died... 14:25:53.384682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=600): Terminated: ok {rc=0} 14:25:53.430682 --- ParallelTerminationStrategy: PID 603 died... 14:25:53.450168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=603): Terminated: ok {rc=0} 14:25:53.538496 bus /sierra_3: Setting Powered False 14:25:54.637731 bus /sierra_3: Setting Powered False 14:25:55.753876 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 14:25:56.903062 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:56.914997 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:25:56.973588 tst mo_mt_call_osmux.py: using LAC 41518 14:25:57.112806 tst mo_mt_call_osmux.py: using RAC 208 14:25:57.229070 tst mo_mt_call_osmux.py: using CellId 41518 14:25:57.345529 tst mo_mt_call_osmux.py: using BVCI 41519 14:25:57.454923 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:57.465984 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:57.476622 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:57.487138 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:57.498200 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:25:57.509309 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:25:57.627729 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:25:57.743200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:25:58.204799 run create_hlr_db(pid=606): Launched 14:25:58.317532 bus /sierra_2: Setting Powered False 14:25:59.377116 run create_hlr_db(pid=606): Terminated: ok {rc=0} 14:25:59.815784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=608): Launched 14:26:00.140707 run osmo-hlr_10.42.42.2(pid=609): Launched 14:26:00.262310 run osmo-stp_10.42.42.5: Starting osmo-stp 14:26:00.815858 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=611): Launched 14:26:01.165686 run osmo-stp_10.42.42.5(pid=612): Launched 14:26:01.369278 run osmo-msc_10.42.42.6: Starting osmo-msc 14:26:02.055232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=614): Launched 14:26:02.387379 run osmo-msc_10.42.42.6(pid=615): Launched 14:26:02.565867 run osmo-stp_10.42.42.5(pid=612): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=612)] 14:26:02.699499 run osmo-stp_10.42.42.5(pid=612): stdout: | (launched: 2022-12-14_14:26:01.091035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:02.834707 run osmo-stp_10.42.42.5(pid=612): stderr: | 20221214142601398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142601398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142601398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142601399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142601399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142601399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142601399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:02.968315 run osmo-stp_10.42.42.5(pid=612): stdout: | (launched: 2022-12-14_14:26:01.091035) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:03.094571 run osmo-stp_10.42.42.5(pid=612): stderr: | 20221214142601398 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142601398 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142601398 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142601399 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142601399 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142601399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142601399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:03.245445 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=612): Process ended prematurely: osmo-stp_10.42.42.5(pid=612) [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=612)] [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 14:26:03.254893 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 14:26:03.281900 run osmo-hlr_10.42.42.2(pid=609): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=609)] 14:26:03.331182 run osmo-hlr_10.42.42.2(pid=609): stdout: | (launched: 2022-12-14_14:26:00.077812) 14:26:03.382430 run osmo-hlr_10.42.42.2(pid=609): stderr: | 20221214142600280 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142600280 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142600280 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142600280 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142600280 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142600280 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142600293 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142600302 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142600303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142600303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:26:03.453810 run osmo-msc_10.42.42.6(pid=615): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=615)] 14:26:03.503101 run osmo-msc_10.42.42.6(pid=615): stdout: | (launched: 2022-12-14_14:26:02.324252) 14:26:03.553939 run osmo-msc_10.42.42.6(pid=615): stderr: | 20221214142602651 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142602651 DLGLOBAL DEBUG validating counter group 0x7f3e789f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142602651 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142602651 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142602651 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142602652 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142602653 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142602654 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142602654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142602654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:26:03.605215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=608): Terminating (SIGTERM) 14:26:03.646225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=611): Terminating (SIGTERM) 14:26:03.687611 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=614): Terminating (SIGTERM) 14:26:03.729317 --- ParallelTerminationStrategy: PID 608 died... 14:26:03.748719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=608): Terminated: ok {rc=0} 14:26:03.794158 --- ParallelTerminationStrategy: PID 611 died... 14:26:03.813319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=611): Terminated: ok {rc=0} 14:26:03.858424 --- ParallelTerminationStrategy: PID 614 died... 14:26:03.877541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=614): Terminated: ok {rc=0} 14:26:03.963373 bus /sierra_3: Setting Powered False 14:26:05.060929 bus /sierra_3: Setting Powered False 14:26:06.173941 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 emergency:sysmo --------------------------------------------------------------------- 14:26:07.401887 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:26:07.407104 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 14:26:07.428450 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 14:26:07.455359 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 14:26:07.542283 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 14:26:07.563717 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 14:26:07.590615 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 14:26:08.176272 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2406 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 14:26:08.182313 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:08.193788 tst emergency:sysmo: Using 1 x bts (candidates: 1) 14:26:08.229427 tst emergency_mo_mt_call.py: using LAC 41519 14:26:08.355693 tst emergency_mo_mt_call.py: using RAC 209 14:26:08.478617 tst emergency_mo_mt_call.py: using CellId 41519 14:26:08.601084 tst emergency_mo_mt_call.py: using BVCI 41520 14:26:08.715201 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:08.726331 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:08.737243 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:08.747992 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:08.758832 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:08.769724 tst emergency:sysmo: Using 1 x modem (candidates: 4) 14:26:08.885778 tst emergency:sysmo: Using 1 x modem (candidates: 4) 14:26:08.999003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:26:09.454163 run create_hlr_db(pid=621): Launched 14:26:09.567877 bus /sierra_2: Setting Powered False 14:26:10.630215 run create_hlr_db(pid=621): Terminated: ok {rc=0} 14:26:11.052560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=623): Launched 14:26:11.347630 run osmo-hlr_10.42.42.2(pid=624): Launched 14:26:11.461856 run osmo-stp_10.42.42.5: Starting osmo-stp 14:26:11.983049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=626): Launched 14:26:12.278166 run osmo-stp_10.42.42.5(pid=627): Launched 14:26:12.404349 tst emergency_mo_mt_call.py: using MSISDN 8735 14:26:12.553834 run osmo-msc_10.42.42.6: Starting osmo-msc 14:26:13.083232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=629): Launched 14:26:13.377444 run osmo-msc_10.42.42.6(pid=630): Launched 14:26:13.542698 run osmo-stp_10.42.42.5(pid=627): ERR: Terminated: ERROR {rc=1} [trial-2406↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=627)] 14:26:13.667499 run osmo-stp_10.42.42.5(pid=627): stdout: | (launched: 2022-12-14_14:26:12.224421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:13.792861 run osmo-stp_10.42.42.5(pid=627): stderr: | 20221214142612392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142612392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142612393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142612393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142612395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142612395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142612395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:13.916526 run osmo-stp_10.42.42.5(pid=627): stdout: | (launched: 2022-12-14_14:26:12.224421) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:14.034279 run osmo-stp_10.42.42.5(pid=627): stderr: | 20221214142612392 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142612392 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142612393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142612393 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142612395 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142612395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142612395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:14.175450 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=627): Process ended prematurely: osmo-stp_10.42.42.5(pid=627) [trial-2406↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=627)] [trial-2406↪emergency:sysmo↪emergency_mo_mt_call.py:19] 14:26:14.183798 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 14:26:14.209820 run osmo-hlr_10.42.42.2(pid=624): ERR: Terminated: ERROR {rc=237} [trial-2406↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=624)] 14:26:14.258556 run osmo-hlr_10.42.42.2(pid=624): stdout: | (launched: 2022-12-14_14:26:11.293728) 14:26:14.307931 run osmo-hlr_10.42.42.2(pid=624): stderr: | 20221214142611466 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142611466 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142611466 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142611466 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142611466 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142611466 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142611479 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142611487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142611487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142611487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:26:14.376862 run osmo-msc_10.42.42.6(pid=630): ERR: Terminated: ERROR {rc=2} [trial-2406↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=630)] 14:26:14.424030 run osmo-msc_10.42.42.6(pid=630): stdout: | (launched: 2022-12-14_14:26:13.323703) 14:26:14.473487 run osmo-msc_10.42.42.6(pid=630): stderr: | 20221214142613593 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142613594 DLGLOBAL DEBUG validating counter group 0x7f336c766c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142613594 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142613594 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142613594 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142613594 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142613596 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142613596 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142613596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142613597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:26:14.522831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=623): Terminating (SIGTERM) 14:26:14.562593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=626): Terminating (SIGTERM) 14:26:14.602599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=629): Terminating (SIGTERM) 14:26:14.642622 --- ParallelTerminationStrategy: PID 623 died... 14:26:14.662277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=623): Terminated: ok {rc=0} 14:26:14.706742 --- ParallelTerminationStrategy: PID 626 died... 14:26:14.725742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=626): Terminated: ok {rc=0} 14:26:14.769858 --- ParallelTerminationStrategy: PID 629 died... 14:26:14.788826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=629): Terminated: ok {rc=0} 14:26:14.874784 bus /sierra_3: Setting Powered False 14:26:15.981281 bus /sierra_3: Setting Powered False 14:26:17.111783 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 14:26:18.207798 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:18.219129 tst emergency:sysmo: Using 1 x bts (candidates: 1) 14:26:18.255561 tst emergency_preemptive_call.py: using LAC 41520 14:26:18.373416 tst emergency_preemptive_call.py: using RAC 210 14:26:18.490024 tst emergency_preemptive_call.py: using CellId 41520 14:26:18.605217 tst emergency_preemptive_call.py: using BVCI 41521 14:26:18.712233 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:18.722740 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:18.733251 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:18.743556 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:18.753904 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 14:26:18.764307 tst emergency:sysmo: Using 1 x modem (candidates: 4) 14:26:18.877699 tst emergency:sysmo: Using 1 x modem (candidates: 4) 14:26:18.995730 tst emergency:sysmo: Using 1 x modem (candidates: 4) 14:26:19.110503 tst emergency:sysmo: Using 1 x modem (candidates: 4) 14:26:19.226168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:26:19.682984 run create_hlr_db(pid=632): Launched 14:26:19.795155 bus /sierra_2: Setting Powered False 14:26:20.854182 run create_hlr_db(pid=632): Terminated: ok {rc=0} 14:26:21.287476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=634): Launched 14:26:21.604458 run osmo-hlr_10.42.42.2(pid=635): Launched 14:26:21.725763 run osmo-stp_10.42.42.5: Starting osmo-stp 14:26:22.299910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=637): Launched 14:26:22.614778 run osmo-stp_10.42.42.5(pid=638): Launched 14:26:22.746812 tst emergency_preemptive_call.py: using MSISDN 8736 14:26:22.908413 run osmo-msc_10.42.42.6: Starting osmo-msc 14:26:23.437173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=640): Launched 14:26:23.733670 run osmo-msc_10.42.42.6(pid=641): Launched 14:26:23.906465 run osmo-stp_10.42.42.5(pid=638): ERR: Terminated: ERROR {rc=1} [trial-2406↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=638)] 14:26:24.032605 run osmo-stp_10.42.42.5(pid=638): stdout: | (launched: 2022-12-14_14:26:22.557667) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:24.158439 run osmo-stp_10.42.42.5(pid=638): stderr: | 20221214142622748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142622748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142622749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142622749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142622751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142622752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142622752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:24.282521 run osmo-stp_10.42.42.5(pid=638): stdout: | (launched: 2022-12-14_14:26:22.557667) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:24.400131 run osmo-stp_10.42.42.5(pid=638): stderr: | 20221214142622748 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142622748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142622749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142622749 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142622751 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142622752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142622752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:24.540470 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=638): Process ended prematurely: osmo-stp_10.42.42.5(pid=638) [trial-2406↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=638)] [trial-2406↪emergency:sysmo↪emergency_preemptive_call.py:32] 14:26:24.548573 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 14:26:24.574560 run osmo-hlr_10.42.42.2(pid=635): ERR: Terminated: ERROR {rc=237} [trial-2406↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=635)] 14:26:24.622887 run osmo-hlr_10.42.42.2(pid=635): stdout: | (launched: 2022-12-14_14:26:21.547161) 14:26:24.672393 run osmo-hlr_10.42.42.2(pid=635): stderr: | 20221214142621745 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142621745 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142621745 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142621745 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142621745 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142621745 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142621758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142621767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142621767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142621767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:26:24.741412 run osmo-msc_10.42.42.6(pid=641): ERR: Terminated: ERROR {rc=2} [trial-2406↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=641)] 14:26:24.788468 run osmo-msc_10.42.42.6(pid=641): stdout: | (launched: 2022-12-14_14:26:23.679446) 14:26:24.837741 run osmo-msc_10.42.42.6(pid=641): stderr: | 20221214142623948 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214142623948 DLGLOBAL DEBUG validating counter group 0x7f838a267c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214142623948 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214142623948 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214142623949 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214142623949 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214142623952 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214142623953 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214142623953 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214142623953 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:26:24.887496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=634): Terminating (SIGTERM) 14:26:24.927024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=637): Terminating (SIGTERM) 14:26:24.966523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=640): Terminating (SIGTERM) 14:26:25.006518 --- ParallelTerminationStrategy: PID 634 died... 14:26:25.025770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=634): Terminated: ok {rc=0} 14:26:25.069609 --- ParallelTerminationStrategy: PID 637 died... 14:26:25.088329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=637): Terminated: ok {rc=0} 14:26:25.132848 --- ParallelTerminationStrategy: PID 640 died... 14:26:25.152431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=640): Terminated: ok {rc=0} 14:26:25.239173 bus /sierra_9: Setting Powered False 14:26:26.337669 bus /sierra_9: Setting Powered False 14:26:27.452073 bus /sierra_8: Setting Powered False 14:26:28.549356 bus /sierra_8: Setting Powered False 14:26:29.664294 bus /sierra_3: Setting Powered False 14:26:30.761180 bus /sierra_3: Setting Powered False 14:26:31.881629 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:sysmo --------------------------------------------------------------------- 14:26:33.143223 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:26:33.147421 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 14:26:33.167674 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 14:26:33.206203 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 14:26:33.292089 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 14:26:33.313309 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 14:26:33.352429 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 14:26:33.938799 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 14:26:33.989248 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:33.999636 tst gprs:sysmo: Using 1 x bts (candidates: 1) 14:26:34.034612 tst cs_paging_gprs_active.py: using LAC 41521 14:26:34.156066 tst cs_paging_gprs_active.py: using RAC 211 14:26:34.275718 tst cs_paging_gprs_active.py: using CellId 41521 14:26:34.395210 tst cs_paging_gprs_active.py: using BVCI 41522 14:26:34.503365 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:34.513788 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:34.524023 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:34.534218 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:34.544260 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:34.554864 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:34.565650 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:34.576139 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:34.587411 tst gprs:sysmo: Using 1 x modem (candidates: 4) 14:26:34.705175 tst gprs:sysmo: Using 1 x modem (candidates: 4) 14:26:34.821199 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:26:35.037843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:26:35.359456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=646): Launched 14:26:35.642187 run iperf3-srv_10.42.42.10(pid=647): Launched 14:26:35.763410 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:26:35.979546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:26:36.301274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=648): Launched 14:26:36.581669 run iperf3-srv_10.42.42.10(pid=649): Launched 14:26:36.702772 tst cs_paging_gprs_active.py:38: start network... 14:26:36.920357 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:26:37.419601 run create_hlr_db(pid=650): Launched 14:26:37.551394 bus /sierra_2: Setting Powered False 14:26:38.614599 run create_hlr_db(pid=650): Terminated: ok {rc=0} 14:26:39.043159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=652): Launched 14:26:39.345166 run osmo-hlr_10.42.42.2(pid=653): Launched 14:26:39.462391 run osmo-stp_10.42.42.5: Starting osmo-stp 14:26:39.993297 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=655): Launched 14:26:40.293455 run osmo-stp_10.42.42.5(pid=656): Launched 14:26:40.410054 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:26:41.898960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=658): Launched 14:26:42.015328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:26:42.272391 run patchelf(pid=659): Launched 14:26:42.443237 run osmo-stp_10.42.42.5(pid=656): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=656)] 14:26:42.571281 run osmo-stp_10.42.42.5(pid=656): stdout: | (launched: 2022-12-14_14:26:40.238698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:42.700397 run osmo-stp_10.42.42.5(pid=656): stderr: | 20221214142640406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142640407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142640407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142640407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142640408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142640408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142640408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:42.830117 run osmo-stp_10.42.42.5(pid=656): stdout: | (launched: 2022-12-14_14:26:40.238698) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:42.953875 run osmo-stp_10.42.42.5(pid=656): stderr: | 20221214142640406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142640407 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142640407 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142640407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142640408 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142640408 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142640408 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:43.101109 run patchelf(pid=659): Terminating (SIGINT) 14:26:43.270886 run patchelf(pid=659): Terminated: ok {rc=0} 14:26:43.393073 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=656): Process ended prematurely: osmo-stp_10.42.42.5(pid=656) [trial-2406↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=656)] [trial-2406↪gprs:sysmo↪cs_paging_gprs_active.py:38] 14:26:43.402494 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 14:26:43.429641 run osmo-hlr_10.42.42.2(pid=653): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=653)] 14:26:43.478183 run osmo-hlr_10.42.42.2(pid=653): stdout: | (launched: 2022-12-14_14:26:39.290265) 14:26:43.527644 run osmo-hlr_10.42.42.2(pid=653): stderr: | 20221214142639464 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142639464 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142639464 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142639465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142639465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142639465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142639478 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142639488 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142639488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142639488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:26:43.577574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=646): Terminating (SIGTERM) 14:26:43.617702 run iperf3-srv_10.42.42.10(pid=647): Terminating (SIGTERM) 14:26:43.658085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=648): Terminating (SIGTERM) 14:26:43.698278 run iperf3-srv_10.42.42.10(pid=649): Terminating (SIGTERM) 14:26:43.738473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=652): Terminating (SIGTERM) 14:26:43.778484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=655): Terminating (SIGTERM) 14:26:43.818640 run pcap-recorder_any(filters='host 10.42.42.6')(pid=658): Terminating (SIGTERM) 14:26:43.859016 --- ParallelTerminationStrategy: PID 646 died... 14:26:43.878756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=646): Terminated: ok {rc=0} 14:26:43.923341 --- ParallelTerminationStrategy: PID 647 died... 14:26:43.942487 run iperf3-srv_10.42.42.10(pid=647): Terminated {rc=256} 14:26:43.986630 --- ParallelTerminationStrategy: PID 648 died... 14:26:44.005671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=648): Terminated: ok {rc=0} 14:26:44.049859 --- ParallelTerminationStrategy: PID 649 died... 14:26:44.068922 run iperf3-srv_10.42.42.10(pid=649): Terminated {rc=256} 14:26:44.113214 --- ParallelTerminationStrategy: PID 652 died... 14:26:44.132233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=652): Terminated: ok {rc=0} 14:26:44.176539 --- ParallelTerminationStrategy: PID 655 died... 14:26:44.195721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=655): Terminated: ok {rc=0} 14:26:44.240156 --- ParallelTerminationStrategy: PID 658 died... 14:26:44.259471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=658): Terminated: ok {rc=0} 14:26:44.346834 bus /gobi_0: Setting Powered False 14:26:45.446975 bus /gobi_0: Setting Powered False 14:26:46.565181 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo iperf3.py ---------------------------------------------- 14:26:47.719256 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:47.730306 tst gprs:sysmo: Using 1 x bts (candidates: 1) 14:26:47.765636 tst iperf3.py: using LAC 41522 14:26:47.893404 tst iperf3.py: using RAC 212 14:26:48.020505 tst iperf3.py: using CellId 41522 14:26:48.147046 tst iperf3.py: using BVCI 41523 14:26:48.264376 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:48.275450 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:48.286469 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:48.297405 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:48.308794 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:48.320240 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:48.331664 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:48.342836 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:48.354523 tst gprs:sysmo: Using 1 x modem (candidates: 4) 14:26:48.474336 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:26:48.692594 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:26:49.013781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=660): Launched 14:26:49.294188 run iperf3-srv_10.42.42.10(pid=661): Launched 14:26:49.415494 tst iperf3.py:8: start network... 14:26:49.631289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:26:50.130863 run create_hlr_db(pid=662): Launched 14:26:50.262258 bus /gobi_6: Setting Powered False 14:26:51.326029 run create_hlr_db(pid=662): Terminated: ok {rc=0} 14:26:51.756165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=664): Launched 14:26:52.056798 run osmo-hlr_10.42.42.2(pid=665): Launched 14:26:52.172024 run osmo-stp_10.42.42.5: Starting osmo-stp 14:26:52.701676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=667): Launched 14:26:53.000773 run osmo-stp_10.42.42.5(pid=668): Launched 14:26:53.115632 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:26:53.633607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=670): Launched 14:26:53.749614 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:26:54.002229 run patchelf(pid=671): Launched 14:26:54.170129 run osmo-stp_10.42.42.5(pid=668): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=668)] 14:26:54.297986 run osmo-stp_10.42.42.5(pid=668): stdout: | (launched: 2022-12-14_14:26:52.946379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:54.426705 run osmo-stp_10.42.42.5(pid=668): stderr: | 20221214142653117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142653117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142653118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142653118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142653118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142653119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142653119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:54.555905 run osmo-stp_10.42.42.5(pid=668): stdout: | (launched: 2022-12-14_14:26:52.946379) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:26:54.678862 run osmo-stp_10.42.42.5(pid=668): stderr: | 20221214142653117 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142653117 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142653118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142653118 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142653118 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142653119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142653119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:26:54.825403 run patchelf(pid=671): Terminating (SIGINT) 14:26:54.994469 run patchelf(pid=671): Terminated: ok {rc=0} 14:26:55.117090 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=668): Process ended prematurely: osmo-stp_10.42.42.5(pid=668) [trial-2406↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=668)] [trial-2406↪gprs:sysmo↪iperf3.py:8] 14:26:55.126387 tst iperf3.py:8: Test FAILED (7.4 sec) 14:26:55.153614 run osmo-hlr_10.42.42.2(pid=665): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=665)] 14:26:55.202747 run osmo-hlr_10.42.42.2(pid=665): stdout: | (launched: 2022-12-14_14:26:52.002174) 14:26:55.252803 run osmo-hlr_10.42.42.2(pid=665): stderr: | 20221214142652177 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142652177 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142652177 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142652177 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142652177 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142652177 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142652189 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142652198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142652198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142652198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:26:55.303482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=660): Terminating (SIGTERM) 14:26:55.344154 run iperf3-srv_10.42.42.10(pid=661): Terminating (SIGTERM) 14:26:55.384413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=664): Terminating (SIGTERM) 14:26:55.424717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=667): Terminating (SIGTERM) 14:26:55.465025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=670): Terminating (SIGTERM) 14:26:55.505532 --- ParallelTerminationStrategy: PID 660 died... 14:26:55.525122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=660): Terminated: ok {rc=0} 14:26:55.569933 --- ParallelTerminationStrategy: PID 661 died... 14:26:55.588943 run iperf3-srv_10.42.42.10(pid=661): Terminated {rc=256} 14:26:55.633618 --- ParallelTerminationStrategy: PID 664 died... 14:26:55.652683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=664): Terminated: ok {rc=0} 14:26:55.697180 --- ParallelTerminationStrategy: PID 667 died... 14:26:55.715898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=667): Terminated: ok {rc=0} 14:26:55.760842 --- ParallelTerminationStrategy: PID 670 died... 14:26:55.780327 run pcap-recorder_any(filters='host 10.42.42.6')(pid=670): Terminated: ok {rc=0} 14:26:55.867449 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo iperf3m4.py ---------------------------------------------- 14:26:57.015883 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:57.027229 tst gprs:sysmo: Using 1 x bts (candidates: 1) 14:26:57.062536 tst iperf3m4.py: using LAC 41523 14:26:57.182637 tst iperf3m4.py: using RAC 213 14:26:57.304878 tst iperf3m4.py: using CellId 41523 14:26:57.422534 tst iperf3m4.py: using BVCI 41524 14:26:57.533248 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:57.543597 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:57.553986 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:57.564177 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:57.574330 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:57.584809 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:57.595257 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:57.605665 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:26:57.616441 tst gprs:sysmo: Using 1 x modem (candidates: 4) 14:26:57.738221 tst gprs:sysmo: Using 1 x modem (candidates: 4) 14:26:57.856059 tst gprs:sysmo: Using 1 x modem (candidates: 4) 14:26:57.975928 tst gprs:sysmo: Using 1 x modem (candidates: 4) 14:26:58.094503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:26:58.311888 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:26:58.635822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=672): Launched 14:26:58.918348 run iperf3-srv_10.42.42.10(pid=673): Launched 14:26:59.040395 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:26:59.258118 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:26:59.581534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=674): Launched 14:26:59.862613 run iperf3-srv_10.42.42.10(pid=675): Launched 14:26:59.983539 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:27:00.200134 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:27:00.523377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=676): Launched 14:27:00.805587 run iperf3-srv_10.42.42.10(pid=677): Launched 14:27:00.945664 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:27:01.202894 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:27:01.547786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=678): Launched 14:27:01.861709 run iperf3-srv_10.42.42.10(pid=679): Launched 14:27:02.034454 tst iperf3m4.py:8: start network... 14:27:02.287383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:27:02.756158 run create_hlr_db(pid=680): Launched 14:27:02.871610 bus /gobi_6: Setting Powered False 14:27:03.932173 run create_hlr_db(pid=680): Terminated: ok {rc=0} 14:27:04.351946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=682): Launched 14:27:04.652844 run osmo-hlr_10.42.42.2(pid=683): Launched 14:27:04.768212 run osmo-stp_10.42.42.5: Starting osmo-stp 14:27:05.299020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=685): Launched 14:27:05.599398 run osmo-stp_10.42.42.5(pid=686): Launched 14:27:05.714663 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:27:06.231414 run pcap-recorder_any(filters='host 10.42.42.6')(pid=688): Launched 14:27:06.347628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:27:06.601037 run patchelf(pid=689): Launched 14:27:06.770145 run osmo-stp_10.42.42.5(pid=686): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=686)] 14:27:06.898369 run osmo-stp_10.42.42.5(pid=686): stdout: | (launched: 2022-12-14_14:27:05.544339) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:07.027155 run osmo-stp_10.42.42.5(pid=686): stderr: | 20221214142705713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142705713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142705713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142705714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142705716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142705716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142705716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:07.156350 run osmo-stp_10.42.42.5(pid=686): stdout: | (launched: 2022-12-14_14:27:05.544339) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:07.279485 run osmo-stp_10.42.42.5(pid=686): stderr: | 20221214142705713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142705713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142705713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142705714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142705716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142705716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142705716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:07.425868 run patchelf(pid=689): Terminating (SIGINT) 14:27:07.595754 run patchelf(pid=689): Terminated: ok {rc=0} 14:27:07.717980 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=686): Process ended prematurely: osmo-stp_10.42.42.5(pid=686) [trial-2406↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=686)] [trial-2406↪gprs:sysmo↪iperf3m4.py:8] 14:27:07.727327 tst iperf3m4.py:8: Test FAILED (10.7 sec) 14:27:07.754871 run osmo-hlr_10.42.42.2(pid=683): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=683)] 14:27:07.803816 run osmo-hlr_10.42.42.2(pid=683): stdout: | (launched: 2022-12-14_14:27:04.598247) 14:27:07.854319 run osmo-hlr_10.42.42.2(pid=683): stderr: | 20221214142704775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142704775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142704775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142704775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142704775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142704775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142704787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142704796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142704796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142704796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:27:07.904922 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=672): Terminating (SIGTERM) 14:27:07.945736 run iperf3-srv_10.42.42.10(pid=673): Terminating (SIGTERM) 14:27:07.986236 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=674): Terminating (SIGTERM) 14:27:08.026632 run iperf3-srv_10.42.42.10(pid=675): Terminating (SIGTERM) 14:27:08.067110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=676): Terminating (SIGTERM) 14:27:08.107662 run iperf3-srv_10.42.42.10(pid=677): Terminating (SIGTERM) 14:27:08.147931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=678): Terminating (SIGTERM) 14:27:08.188493 run iperf3-srv_10.42.42.10(pid=679): Terminating (SIGTERM) 14:27:08.229209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=682): Terminating (SIGTERM) 14:27:08.270104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=685): Terminating (SIGTERM) 14:27:08.310638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=688): Terminating (SIGTERM) 14:27:08.351374 --- ParallelTerminationStrategy: PID 672 died... 14:27:08.370897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=672): Terminated: ok {rc=0} 14:27:08.415146 --- ParallelTerminationStrategy: PID 673 died... 14:27:08.434004 run iperf3-srv_10.42.42.10(pid=673): Terminated {rc=256} 14:27:08.478200 --- ParallelTerminationStrategy: PID 674 died... 14:27:08.497119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=674): Terminated: ok {rc=0} 14:27:08.541299 --- ParallelTerminationStrategy: PID 675 died... 14:27:08.560092 run iperf3-srv_10.42.42.10(pid=675): Terminated {rc=256} 14:27:08.604434 --- ParallelTerminationStrategy: PID 676 died... 14:27:08.623443 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=676): Terminated: ok {rc=0} 14:27:08.667592 --- ParallelTerminationStrategy: PID 677 died... 14:27:08.686628 run iperf3-srv_10.42.42.10(pid=677): Terminated {rc=256} 14:27:08.731058 --- ParallelTerminationStrategy: PID 678 died... 14:27:08.749973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=678): Terminated: ok {rc=0} 14:27:08.794242 --- ParallelTerminationStrategy: PID 679 died... 14:27:08.813183 run iperf3-srv_10.42.42.10(pid=679): Terminated {rc=256} 14:27:08.857233 --- ParallelTerminationStrategy: PID 682 died... 14:27:08.876138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=682): Terminated: ok {rc=0} 14:27:08.920425 --- ParallelTerminationStrategy: PID 685 died... 14:27:08.939316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=685): Terminated: ok {rc=0} 14:27:08.983913 --- ParallelTerminationStrategy: PID 688 died... 14:27:09.002803 run pcap-recorder_any(filters='host 10.42.42.6')(pid=688): Terminated: ok {rc=0} 14:27:09.087214 bus /gobi_4: Setting Powered False 14:27:10.182921 bus /gobi_4: Setting Powered False 14:27:11.295911 bus /gobi_1: Setting Powered False 14:27:12.394339 bus /gobi_1: Setting Powered False 14:27:13.511693 bus /gobi_0: Setting Powered False 14:27:14.610036 bus /gobi_0: Setting Powered False 14:27:15.728528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo ping.py ---------------------------------------------- 14:27:16.834709 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:16.846888 tst gprs:sysmo: Using 1 x bts (candidates: 1) 14:27:16.884291 tst ping.py: using LAC 41524 14:27:17.012503 tst ping.py: using RAC 214 14:27:17.168495 tst ping.py: using CellId 41524 14:27:17.296228 tst ping.py: using BVCI 41525 14:27:17.412471 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:17.423442 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:17.434240 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:17.444891 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:17.455698 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:17.466977 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:17.477890 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:17.488599 tst gprs:sysmo: Using 1 x modem (candidates: 4) 14:27:17.605925 tst ping.py:19: start network... 14:27:17.819960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:27:18.309532 run create_hlr_db(pid=690): Launched 14:27:18.438266 bus /gobi_6: Setting Powered False 14:27:19.501103 run create_hlr_db(pid=690): Terminated: ok {rc=0} 14:27:19.942831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=692): Launched 14:27:20.259456 run osmo-hlr_10.42.42.2(pid=693): Launched 14:27:20.380312 run osmo-stp_10.42.42.5: Starting osmo-stp 14:27:20.923979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=695): Launched 14:27:21.238640 run osmo-stp_10.42.42.5(pid=696): Launched 14:27:21.359441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:27:21.904727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=698): Launched 14:27:22.026305 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:27:22.292326 run patchelf(pid=699): Launched 14:27:22.468855 run osmo-stp_10.42.42.5(pid=696): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=696)] 14:27:22.603516 run osmo-stp_10.42.42.5(pid=696): stdout: | (launched: 2022-12-14_14:27:21.181831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:22.739587 run osmo-stp_10.42.42.5(pid=696): stderr: | 20221214142721372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142721372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142721372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142721373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142721373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142721373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142721373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:22.875839 run osmo-stp_10.42.42.5(pid=696): stdout: | (launched: 2022-12-14_14:27:21.181831) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:23.005540 run osmo-stp_10.42.42.5(pid=696): stderr: | 20221214142721372 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142721372 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142721372 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142721373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142721373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142721373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142721373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:23.159171 run patchelf(pid=699): Terminating (SIGINT) 14:27:23.336849 run patchelf(pid=699): Terminated: ok {rc=0} 14:27:23.464727 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=696): Process ended prematurely: osmo-stp_10.42.42.5(pid=696) [trial-2406↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=696)] [trial-2406↪gprs:sysmo↪ping.py:22] 14:27:23.474115 tst ping.py:22: Test FAILED (6.6 sec) 14:27:23.501941 run osmo-hlr_10.42.42.2(pid=693): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=693)] 14:27:23.551827 run osmo-hlr_10.42.42.2(pid=693): stdout: | (launched: 2022-12-14_14:27:20.201981) 14:27:23.603920 run osmo-hlr_10.42.42.2(pid=693): stderr: | 20221214142720400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142720400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142720400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142720400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142720400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142720400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142720413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142720421 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142720421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142720421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:27:23.655962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=692): Terminating (SIGTERM) 14:27:23.697959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=695): Terminating (SIGTERM) 14:27:23.739943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=698): Terminating (SIGTERM) 14:27:23.782312 --- ParallelTerminationStrategy: PID 692 died... 14:27:23.802050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=692): Terminated: ok {rc=0} 14:27:23.848275 --- ParallelTerminationStrategy: PID 695 died... 14:27:23.867823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=695): Terminated: ok {rc=0} 14:27:23.913757 --- ParallelTerminationStrategy: PID 698 died... 14:27:23.933331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=698): Terminated: ok {rc=0} 14:27:24.021785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 14:27:25.109353 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:25.120756 tst gprs:sysmo: Using 1 x bts (candidates: 1) 14:27:25.161944 tst ping_idle_ping.py: using LAC 41525 14:27:25.285623 tst ping_idle_ping.py: using RAC 215 14:27:25.407787 tst ping_idle_ping.py: using CellId 41525 14:27:25.530552 tst ping_idle_ping.py: using BVCI 41526 14:27:25.645215 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:25.656111 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:25.666982 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:25.677792 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:25.688513 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:25.699222 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:25.710099 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 14:27:25.720906 tst gprs:sysmo: Using 1 x modem (candidates: 4) 14:27:25.843141 tst ping_idle_ping.py:24: start network... 14:27:26.042098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:27:26.498546 run create_hlr_db(pid=700): Launched 14:27:26.612406 bus /gobi_6: Setting Powered False 14:27:27.671883 run create_hlr_db(pid=700): Terminated: ok {rc=0} 14:27:28.106904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=702): Launched 14:27:28.423825 run osmo-hlr_10.42.42.2(pid=703): Launched 14:27:28.546134 run osmo-stp_10.42.42.5: Starting osmo-stp 14:27:29.093841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=705): Launched 14:27:29.411098 run osmo-stp_10.42.42.5(pid=706): Launched 14:27:29.534293 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:27:30.083534 run pcap-recorder_any(filters='host 10.42.42.6')(pid=708): Launched 14:27:30.207078 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:27:30.474843 run patchelf(pid=709): Launched 14:27:30.651491 run osmo-stp_10.42.42.5(pid=706): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=706)] 14:27:30.787276 run osmo-stp_10.42.42.5(pid=706): stdout: | (launched: 2022-12-14_14:27:29.353955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:30.947849 run osmo-stp_10.42.42.5(pid=706): stderr: | 20221214142729546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142729546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142729547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142729547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142729547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142729547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142729547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:31.086716 run osmo-stp_10.42.42.5(pid=706): stdout: | (launched: 2022-12-14_14:27:29.353955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:31.219200 run osmo-stp_10.42.42.5(pid=706): stderr: | 20221214142729546 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142729546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142729547 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142729547 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142729547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142729547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142729547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:31.376307 run patchelf(pid=709): Terminating (SIGINT) 14:27:31.557561 run patchelf(pid=709): Terminated: ok {rc=0} 14:27:31.688653 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=706): Process ended prematurely: osmo-stp_10.42.42.5(pid=706) [trial-2406↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=706)] [trial-2406↪gprs:sysmo↪ping_idle_ping.py:27] 14:27:31.698782 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 14:27:31.727344 run osmo-hlr_10.42.42.2(pid=703): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=703)] 14:27:31.778580 run osmo-hlr_10.42.42.2(pid=703): stdout: | (launched: 2022-12-14_14:27:28.367098) 14:27:31.831042 run osmo-hlr_10.42.42.2(pid=703): stderr: | 20221214142728566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142728566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142728566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142728566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142728566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142728566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142728579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142728587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142728587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142728587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:27:31.883626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=702): Terminating (SIGTERM) 14:27:31.926526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=705): Terminating (SIGTERM) 14:27:31.971063 run pcap-recorder_any(filters='host 10.42.42.6')(pid=708): Terminating (SIGTERM) 14:27:32.015793 --- ParallelTerminationStrategy: PID 702 died... 14:27:32.037487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=702): Terminated: ok {rc=0} 14:27:32.085589 --- ParallelTerminationStrategy: PID 705 died... 14:27:32.105900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=705): Terminated: ok {rc=0} 14:27:32.152526 --- ParallelTerminationStrategy: PID 708 died... 14:27:32.172503 run pcap-recorder_any(filters='host 10.42.42.6')(pid=708): Terminated: ok {rc=0} 14:27:32.259571 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 14:27:33.537973 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:27:33.543001 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 14:27:33.563342 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 14:27:33.602671 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 14:27:33.688744 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 14:27:33.709060 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 14:27:33.746631 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 14:27:34.337146 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 14:27:34.385991 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:34.396434 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:27:34.432765 tst cs_paging_gprs_active.py: using LAC 41526 14:27:34.550396 tst cs_paging_gprs_active.py: using RAC 216 14:27:34.671027 tst cs_paging_gprs_active.py: using CellId 41526 14:27:34.789394 tst cs_paging_gprs_active.py: using BVCI 41527 14:27:34.899064 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:34.909853 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:34.920296 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:34.930776 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:34.941168 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:34.952365 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:34.963818 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:34.974518 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:34.985418 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:27:35.100854 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:27:35.220417 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:27:35.439342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:27:35.762848 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=714): Launched 14:27:36.045237 run iperf3-srv_10.42.42.10(pid=715): Launched 14:27:36.167088 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:27:36.385459 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:27:36.710031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=716): Launched 14:27:36.993084 run iperf3-srv_10.42.42.10(pid=717): Launched 14:27:37.114948 tst cs_paging_gprs_active.py:38: start network... 14:27:37.333007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:27:37.833823 run create_hlr_db(pid=718): Launched 14:27:37.965918 bus /gobi_6: Setting Powered False 14:27:39.029227 run create_hlr_db(pid=718): Terminated: ok {rc=0} 14:27:39.460007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=720): Launched 14:27:39.762270 run osmo-hlr_10.42.42.2(pid=721): Launched 14:27:39.878153 run osmo-stp_10.42.42.5: Starting osmo-stp 14:27:40.411986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=723): Launched 14:27:40.713854 run osmo-stp_10.42.42.5(pid=724): Launched 14:27:40.829823 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:27:41.348787 run pcap-recorder_any(filters='host 10.42.42.6')(pid=726): Launched 14:27:41.464845 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:27:41.718759 run patchelf(pid=727): Launched 14:27:41.888290 run osmo-stp_10.42.42.5(pid=724): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=724)] 14:27:42.016079 run osmo-stp_10.42.42.5(pid=724): stdout: | (launched: 2022-12-14_14:27:40.658918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:42.145300 run osmo-stp_10.42.42.5(pid=724): stderr: | 20221214142740829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142740829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142740829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142740829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142740830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142740830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142740830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:42.274275 run osmo-stp_10.42.42.5(pid=724): stdout: | (launched: 2022-12-14_14:27:40.658918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:42.398016 run osmo-stp_10.42.42.5(pid=724): stderr: | 20221214142740829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142740829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142740829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142740829 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142740830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142740830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142740830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:42.544443 run patchelf(pid=727): Terminating (SIGINT) 14:27:42.714196 run patchelf(pid=727): Terminated: ok {rc=0} 14:27:42.836265 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=724): Process ended prematurely: osmo-stp_10.42.42.5(pid=724) [trial-2406↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=724)] [trial-2406↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 14:27:42.845697 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 14:27:42.873148 run osmo-hlr_10.42.42.2(pid=721): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=721)] 14:27:42.921611 run osmo-hlr_10.42.42.2(pid=721): stdout: | (launched: 2022-12-14_14:27:39.707521) 14:27:42.971391 run osmo-hlr_10.42.42.2(pid=721): stderr: | 20221214142739881 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142739881 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142739881 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142739881 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142739881 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142739882 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142739894 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142739902 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142739902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142739902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:27:43.021529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=714): Terminating (SIGTERM) 14:27:43.061589 run iperf3-srv_10.42.42.10(pid=715): Terminating (SIGTERM) 14:27:43.101675 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=716): Terminating (SIGTERM) 14:27:43.141810 run iperf3-srv_10.42.42.10(pid=717): Terminating (SIGTERM) 14:27:43.181742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=720): Terminating (SIGTERM) 14:27:43.221968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=723): Terminating (SIGTERM) 14:27:43.262120 run pcap-recorder_any(filters='host 10.42.42.6')(pid=726): Terminating (SIGTERM) 14:27:43.302477 --- ParallelTerminationStrategy: PID 714 died... 14:27:43.321883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=714): Terminated: ok {rc=0} 14:27:43.366009 --- ParallelTerminationStrategy: PID 715 died... 14:27:43.384750 run iperf3-srv_10.42.42.10(pid=715): Terminated {rc=256} 14:27:43.429300 --- ParallelTerminationStrategy: PID 716 died... 14:27:43.448161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=716): Terminated: ok {rc=0} 14:27:43.491937 --- ParallelTerminationStrategy: PID 717 died... 14:27:43.510716 run iperf3-srv_10.42.42.10(pid=717): Terminated {rc=256} 14:27:43.554619 --- ParallelTerminationStrategy: PID 720 died... 14:27:43.573450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=720): Terminated: ok {rc=0} 14:27:43.617325 --- ParallelTerminationStrategy: PID 723 died... 14:27:43.636036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=723): Terminated: ok {rc=0} 14:27:43.680054 --- ParallelTerminationStrategy: PID 726 died... 14:27:43.698959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=726): Terminated: ok {rc=0} 14:27:43.784503 bus /gobi_0: Setting Powered False 14:27:44.884127 bus /gobi_0: Setting Powered False 14:27:46.003396 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 14:27:47.167598 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:47.183250 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:27:47.221829 tst iperf3.py: using LAC 41527 14:27:47.339951 tst iperf3.py: using RAC 217 14:27:47.457609 tst iperf3.py: using CellId 41527 14:27:47.585402 tst iperf3.py: using BVCI 41528 14:27:47.702646 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:47.713795 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:47.725067 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:47.736162 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:47.747232 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:47.758188 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:47.769743 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:47.780827 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:47.792475 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:27:47.911096 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:27:48.112438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:27:48.412683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=728): Launched 14:27:48.674628 run iperf3-srv_10.42.42.10(pid=729): Launched 14:27:48.787927 tst iperf3.py:8: start network... 14:27:48.988229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:27:49.451641 run create_hlr_db(pid=730): Launched 14:27:49.566504 bus /gobi_6: Setting Powered False 14:27:50.625985 run create_hlr_db(pid=730): Terminated: ok {rc=0} 14:27:51.067288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=732): Launched 14:27:51.390033 run osmo-hlr_10.42.42.2(pid=733): Launched 14:27:51.514975 run osmo-stp_10.42.42.5: Starting osmo-stp 14:27:52.072449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=735): Launched 14:27:52.394398 run osmo-stp_10.42.42.5(pid=736): Launched 14:27:52.518223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:27:53.076626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=738): Launched 14:27:53.200207 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:27:53.473382 run patchelf(pid=739): Launched 14:27:53.653706 run osmo-stp_10.42.42.5(pid=736): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=736)] 14:27:53.791181 run osmo-stp_10.42.42.5(pid=736): stdout: | (launched: 2022-12-14_14:27:52.335893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:53.928905 run osmo-stp_10.42.42.5(pid=736): stderr: | 20221214142752528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142752528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142752528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142752528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142752529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142752529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142752529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:54.066339 run osmo-stp_10.42.42.5(pid=736): stdout: | (launched: 2022-12-14_14:27:52.335893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:27:54.198142 run osmo-stp_10.42.42.5(pid=736): stderr: | 20221214142752528 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142752528 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142752528 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142752528 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142752529 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142752529 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142752529 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:27:54.354582 run patchelf(pid=739): Terminating (SIGINT) 14:27:54.535334 run patchelf(pid=739): Terminated: ok {rc=0} 14:27:54.665834 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=736): Process ended prematurely: osmo-stp_10.42.42.5(pid=736) [trial-2406↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=736)] [trial-2406↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 14:27:54.675740 tst iperf3.py:8: Test FAILED (7.6 sec) 14:27:54.704109 run osmo-hlr_10.42.42.2(pid=733): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=733)] 14:27:54.753944 run osmo-hlr_10.42.42.2(pid=733): stdout: | (launched: 2022-12-14_14:27:51.331959) 14:27:54.805990 run osmo-hlr_10.42.42.2(pid=733): stderr: | 20221214142751531 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142751531 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142751531 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142751531 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142751531 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142751531 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142751543 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142751551 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142751551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142751551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:27:54.857936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=728): Terminating (SIGTERM) 14:27:54.899732 run iperf3-srv_10.42.42.10(pid=729): Terminating (SIGTERM) 14:27:54.941389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=732): Terminating (SIGTERM) 14:27:54.983477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=735): Terminating (SIGTERM) 14:27:55.025107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=738): Terminating (SIGTERM) 14:27:55.067469 --- ParallelTerminationStrategy: PID 728 died... 14:27:55.087501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=728): Terminated: ok {rc=0} 14:27:55.133311 --- ParallelTerminationStrategy: PID 729 died... 14:27:55.152488 run iperf3-srv_10.42.42.10(pid=729): Terminated {rc=256} 14:27:55.198199 --- ParallelTerminationStrategy: PID 732 died... 14:27:55.217609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=732): Terminated: ok {rc=0} 14:27:55.263441 --- ParallelTerminationStrategy: PID 735 died... 14:27:55.283343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=735): Terminated: ok {rc=0} 14:27:55.329320 --- ParallelTerminationStrategy: PID 738 died... 14:27:55.348755 run pcap-recorder_any(filters='host 10.42.42.6')(pid=738): Terminated: ok {rc=0} 14:27:55.435808 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 14:27:56.585312 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:56.597079 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:27:56.632638 tst iperf3m4.py: using LAC 41528 14:27:56.759852 tst iperf3m4.py: using RAC 218 14:27:56.886160 tst iperf3m4.py: using CellId 41528 14:27:57.014555 tst iperf3m4.py: using BVCI 41529 14:27:57.131547 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:57.142768 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:57.154103 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:57.165257 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:57.176235 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:57.187420 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:57.198790 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:57.209851 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:27:57.221158 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:27:57.338985 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:27:57.460305 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:27:57.576449 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:27:57.694692 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:27:57.913793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:27:58.238656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=740): Launched 14:27:58.520336 run iperf3-srv_10.42.42.10(pid=741): Launched 14:27:58.642365 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:27:58.859582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:27:59.183537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=742): Launched 14:27:59.465501 run iperf3-srv_10.42.42.10(pid=743): Launched 14:27:59.586946 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:27:59.805451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:28:00.129288 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=744): Launched 14:28:00.412465 run iperf3-srv_10.42.42.10(pid=745): Launched 14:28:00.533933 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:28:00.750446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:28:01.111513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=746): Launched 14:28:01.411522 run iperf3-srv_10.42.42.10(pid=747): Launched 14:28:01.547228 tst iperf3m4.py:8: start network... 14:28:01.768729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:28:02.274523 run create_hlr_db(pid=748): Launched 14:28:02.406417 bus /gobi_6: Setting Powered False 14:28:03.470395 run create_hlr_db(pid=748): Terminated: ok {rc=0} 14:28:03.919419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=750): Launched 14:28:04.241553 run osmo-hlr_10.42.42.2(pid=751): Launched 14:28:04.364253 run osmo-stp_10.42.42.5: Starting osmo-stp 14:28:04.918068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=753): Launched 14:28:05.240188 run osmo-stp_10.42.42.5(pid=754): Launched 14:28:05.363691 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:28:05.920574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=756): Launched 14:28:06.043971 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:28:06.314841 run patchelf(pid=757): Launched 14:28:06.494770 run osmo-stp_10.42.42.5(pid=754): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=754)] 14:28:06.631368 run osmo-stp_10.42.42.5(pid=754): stdout: | (launched: 2022-12-14_14:28:05.181878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:06.768060 run osmo-stp_10.42.42.5(pid=754): stderr: | 20221214142805376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142805376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142805377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142805377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142805377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142805378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142805378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:06.905541 run osmo-stp_10.42.42.5(pid=754): stdout: | (launched: 2022-12-14_14:28:05.181878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:07.037200 run osmo-stp_10.42.42.5(pid=754): stderr: | 20221214142805376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142805376 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142805377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142805377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142805377 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142805378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142805378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:07.193827 run patchelf(pid=757): Terminating (SIGINT) 14:28:07.374302 run patchelf(pid=757): Terminated: ok {rc=0} 14:28:07.504456 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=754): Process ended prematurely: osmo-stp_10.42.42.5(pid=754) [trial-2406↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=754)] [trial-2406↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 14:28:07.514533 tst iperf3m4.py:8: Test FAILED (11.0 sec) 14:28:07.542911 run osmo-hlr_10.42.42.2(pid=751): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=751)] 14:28:07.592749 run osmo-hlr_10.42.42.2(pid=751): stdout: | (launched: 2022-12-14_14:28:04.182869) 14:28:07.644575 run osmo-hlr_10.42.42.2(pid=751): stderr: | 20221214142804382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142804382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142804382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142804383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142804383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142804383 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142804396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142804404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142804405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142804405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:28:07.697050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=740): Terminating (SIGTERM) 14:28:07.738724 run iperf3-srv_10.42.42.10(pid=741): Terminating (SIGTERM) 14:28:07.780781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=742): Terminating (SIGTERM) 14:28:07.822744 run iperf3-srv_10.42.42.10(pid=743): Terminating (SIGTERM) 14:28:07.864314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=744): Terminating (SIGTERM) 14:28:07.906439 run iperf3-srv_10.42.42.10(pid=745): Terminating (SIGTERM) 14:28:07.947990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=746): Terminating (SIGTERM) 14:28:07.989749 run iperf3-srv_10.42.42.10(pid=747): Terminating (SIGTERM) 14:28:08.031371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=750): Terminating (SIGTERM) 14:28:08.073154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=753): Terminating (SIGTERM) 14:28:08.114883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=756): Terminating (SIGTERM) 14:28:08.157198 --- ParallelTerminationStrategy: PID 740 died... 14:28:08.177207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=740): Terminated: ok {rc=0} 14:28:08.223250 --- ParallelTerminationStrategy: PID 741 died... 14:28:08.242719 run iperf3-srv_10.42.42.10(pid=741): Terminated {rc=256} 14:28:08.288548 --- ParallelTerminationStrategy: PID 742 died... 14:28:08.308128 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=742): Terminated: ok {rc=0} 14:28:08.354077 --- ParallelTerminationStrategy: PID 743 died... 14:28:08.373535 run iperf3-srv_10.42.42.10(pid=743): Terminated {rc=256} 14:28:08.419146 --- ParallelTerminationStrategy: PID 744 died... 14:28:08.438598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=744): Terminated: ok {rc=0} 14:28:08.484928 --- ParallelTerminationStrategy: PID 745 died... 14:28:08.504868 run iperf3-srv_10.42.42.10(pid=745): Terminated {rc=256} 14:28:08.550708 --- ParallelTerminationStrategy: PID 746 died... 14:28:08.570244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=746): Terminated: ok {rc=0} 14:28:08.615987 --- ParallelTerminationStrategy: PID 747 died... 14:28:08.635406 run iperf3-srv_10.42.42.10(pid=747): Terminated {rc=256} 14:28:08.681150 --- ParallelTerminationStrategy: PID 750 died... 14:28:08.700553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=750): Terminated: ok {rc=0} 14:28:08.746334 --- ParallelTerminationStrategy: PID 753 died... 14:28:08.765812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=753): Terminated: ok {rc=0} 14:28:08.811893 --- ParallelTerminationStrategy: PID 756 died... 14:28:08.831490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=756): Terminated: ok {rc=0} 14:28:08.917995 bus /gobi_4: Setting Powered False 14:28:10.016272 bus /gobi_4: Setting Powered False 14:28:11.133601 bus /gobi_1: Setting Powered False 14:28:12.231445 bus /gobi_1: Setting Powered False 14:28:13.346749 bus /gobi_0: Setting Powered False 14:28:14.443138 bus /gobi_0: Setting Powered False 14:28:15.559114 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 14:28:16.662696 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:16.676469 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:28:16.723099 tst ping.py: using LAC 41529 14:28:16.885587 tst ping.py: using RAC 219 14:28:17.004520 tst ping.py: using CellId 41529 14:28:17.153917 tst ping.py: using BVCI 41530 14:28:17.266600 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:17.278405 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:17.290282 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:17.301512 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:17.313416 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:17.325124 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:17.336651 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:17.348288 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:28:17.470535 tst ping.py:19: start network... 14:28:17.684729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:28:18.174921 run create_hlr_db(pid=758): Launched 14:28:18.303938 bus /gobi_6: Setting Powered False 14:28:19.363966 run create_hlr_db(pid=758): Terminated: ok {rc=0} 14:28:19.786930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=760): Launched 14:28:20.081259 run osmo-hlr_10.42.42.2(pid=761): Launched 14:28:20.193603 run osmo-stp_10.42.42.5: Starting osmo-stp 14:28:20.714435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=763): Launched 14:28:21.008449 run osmo-stp_10.42.42.5(pid=764): Launched 14:28:21.120776 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:28:21.644448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=766): Launched 14:28:21.758854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:28:22.007965 run patchelf(pid=767): Launched 14:28:22.173229 run osmo-stp_10.42.42.5(pid=764): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=764)] 14:28:22.298943 run osmo-stp_10.42.42.5(pid=764): stdout: | (launched: 2022-12-14_14:28:20.954928) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:22.425531 run osmo-stp_10.42.42.5(pid=764): stderr: | 20221214142821124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142821124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142821124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142821124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142821125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142821125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142821125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:22.552327 run osmo-stp_10.42.42.5(pid=764): stdout: | (launched: 2022-12-14_14:28:20.954928) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:22.673304 run osmo-stp_10.42.42.5(pid=764): stderr: | 20221214142821124 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142821124 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142821124 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142821124 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142821125 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142821125 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142821125 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:22.817192 run patchelf(pid=767): Terminating (SIGINT) 14:28:22.983292 run patchelf(pid=767): Terminated: ok {rc=0} 14:28:23.103346 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=764): Process ended prematurely: osmo-stp_10.42.42.5(pid=764) [trial-2406↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=764)] [trial-2406↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 14:28:23.112153 tst ping.py:22: Test FAILED (6.4 sec) 14:28:23.139134 run osmo-hlr_10.42.42.2(pid=761): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=761)] 14:28:23.187777 run osmo-hlr_10.42.42.2(pid=761): stdout: | (launched: 2022-12-14_14:28:20.027468) 14:28:23.237885 run osmo-hlr_10.42.42.2(pid=761): stderr: | 20221214142820200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142820200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142820200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142820200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142820201 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142820201 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142820217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142820226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142820227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142820227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:28:23.288194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=760): Terminating (SIGTERM) 14:28:23.328713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=763): Terminating (SIGTERM) 14:28:23.369266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=766): Terminating (SIGTERM) 14:28:23.410069 --- ParallelTerminationStrategy: PID 760 died... 14:28:23.429731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=760): Terminated: ok {rc=0} 14:28:23.474312 --- ParallelTerminationStrategy: PID 763 died... 14:28:23.493450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=763): Terminated: ok {rc=0} 14:28:23.537918 --- ParallelTerminationStrategy: PID 766 died... 14:28:23.557082 run pcap-recorder_any(filters='host 10.42.42.6')(pid=766): Terminated: ok {rc=0} 14:28:23.641159 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 14:28:24.728094 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:24.740415 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:28:24.779704 tst ping_idle_ping.py: using LAC 41530 14:28:24.906752 tst ping_idle_ping.py: using RAC 220 14:28:25.031792 tst ping_idle_ping.py: using CellId 41530 14:28:25.157921 tst ping_idle_ping.py: using BVCI 41531 14:28:25.275910 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:25.287161 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:25.298311 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:25.309338 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:25.320797 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:25.332304 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:25.343924 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:28:25.355624 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:28:25.482267 tst ping_idle_ping.py:24: start network... 14:28:25.682531 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:28:26.138073 run create_hlr_db(pid=768): Launched 14:28:26.252328 bus /gobi_6: Setting Powered False 14:28:27.311817 run create_hlr_db(pid=768): Terminated: ok {rc=0} 14:28:27.747174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=770): Launched 14:28:28.065837 run osmo-hlr_10.42.42.2(pid=771): Launched 14:28:28.187802 run osmo-stp_10.42.42.5: Starting osmo-stp 14:28:28.734687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=773): Launched 14:28:29.052697 run osmo-stp_10.42.42.5(pid=774): Launched 14:28:29.175046 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:28:29.725786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=776): Launched 14:28:29.848482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:28:30.116274 run patchelf(pid=777): Launched 14:28:30.293483 run osmo-stp_10.42.42.5(pid=774): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=774)] 14:28:30.428072 run osmo-stp_10.42.42.5(pid=774): stdout: | (launched: 2022-12-14_14:28:28.995187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:30.563930 run osmo-stp_10.42.42.5(pid=774): stderr: | 20221214142829187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142829187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142829187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142829187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142829188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142829188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142829188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:30.700225 run osmo-stp_10.42.42.5(pid=774): stdout: | (launched: 2022-12-14_14:28:28.995187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:30.834365 run osmo-stp_10.42.42.5(pid=774): stderr: | 20221214142829187 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142829187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142829187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142829187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142829188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142829188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142829188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:31.015298 run patchelf(pid=777): Terminating (SIGINT) 14:28:31.198886 run patchelf(pid=777): Terminated: ok {rc=0} 14:28:31.331595 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=774): Process ended prematurely: osmo-stp_10.42.42.5(pid=774) [trial-2406↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=774)] [trial-2406↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 14:28:31.342300 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 14:28:31.371690 run osmo-hlr_10.42.42.2(pid=771): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=771)] 14:28:31.422664 run osmo-hlr_10.42.42.2(pid=771): stdout: | (launched: 2022-12-14_14:28:28.008511) 14:28:31.476005 run osmo-hlr_10.42.42.2(pid=771): stderr: | 20221214142828204 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142828204 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142828204 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142828204 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142828204 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142828204 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142828216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142828224 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142828225 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142828225 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:28:31.529905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=770): Terminating (SIGTERM) 14:28:31.573107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=773): Terminating (SIGTERM) 14:28:31.617434 run pcap-recorder_any(filters='host 10.42.42.6')(pid=776): Terminating (SIGTERM) 14:28:31.663537 --- ParallelTerminationStrategy: PID 770 died... 14:28:31.684284 run pcap-recorder_any(filters='host 10.42.42.2')(pid=770): Terminated: ok {rc=0} 14:28:31.731768 --- ParallelTerminationStrategy: PID 773 died... 14:28:31.752130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=773): Terminated: ok {rc=0} 14:28:31.799295 --- ParallelTerminationStrategy: PID 776 died... 14:28:31.819435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=776): Terminated: ok {rc=0} 14:28:31.926507 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 14:28:33.232420 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:28:33.238924 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 14:28:33.260198 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 14:28:33.299673 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 14:28:33.390788 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 14:28:33.412280 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 14:28:33.451266 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 14:28:34.042030 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 14:28:34.093733 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:34.104884 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:28:34.162871 tst cs_paging_gprs_active.py: using LAC 41531 14:28:34.290535 tst cs_paging_gprs_active.py: using RAC 221 14:28:34.418363 tst cs_paging_gprs_active.py: using CellId 41531 14:28:34.545998 tst cs_paging_gprs_active.py: using BVCI 41532 14:28:34.664577 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:34.675910 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:34.686968 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:34.698087 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:34.709085 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:34.720071 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:34.731265 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:34.742261 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:34.753512 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:28:34.869334 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:28:34.984492 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:28:35.186588 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:28:35.489275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=781): Launched 14:28:35.752002 run iperf3-srv_10.42.42.10(pid=782): Launched 14:28:35.866640 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:28:36.068017 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:28:36.369811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=783): Launched 14:28:36.632875 run iperf3-srv_10.42.42.10(pid=784): Launched 14:28:36.747046 tst cs_paging_gprs_active.py:38: start network... 14:28:36.947916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:28:37.415509 run create_hlr_db(pid=785): Launched 14:28:37.533884 bus /gobi_6: Setting Powered False 14:28:38.595023 run create_hlr_db(pid=785): Terminated: ok {rc=0} 14:28:39.037356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=787): Launched 14:28:39.362274 run osmo-hlr_10.42.42.2(pid=788): Launched 14:28:39.487013 run osmo-stp_10.42.42.5: Starting osmo-stp 14:28:40.045760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=790): Launched 14:28:40.369346 run osmo-stp_10.42.42.5(pid=791): Launched 14:28:40.493243 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:28:41.052501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=793): Launched 14:28:41.177058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:28:41.450588 run patchelf(pid=794): Launched 14:28:41.631877 run osmo-stp_10.42.42.5(pid=791): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=791)] 14:28:41.768417 run osmo-stp_10.42.42.5(pid=791): stdout: | (launched: 2022-12-14_14:28:40.310669) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:41.907215 run osmo-stp_10.42.42.5(pid=791): stderr: | 20221214142840505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142840505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142840505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142840506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142840506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142840506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142840506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:42.045723 run osmo-stp_10.42.42.5(pid=791): stdout: | (launched: 2022-12-14_14:28:40.310669) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:42.178284 run osmo-stp_10.42.42.5(pid=791): stderr: | 20221214142840505 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142840505 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142840505 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142840506 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142840506 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142840506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142840506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:42.335428 run patchelf(pid=794): Terminating (SIGINT) 14:28:42.517252 run patchelf(pid=794): Terminated: ok {rc=0} 14:28:42.647886 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=791): Process ended prematurely: osmo-stp_10.42.42.5(pid=791) [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=791)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 14:28:42.657917 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 14:28:42.686631 run osmo-hlr_10.42.42.2(pid=788): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=788)] 14:28:42.736753 run osmo-hlr_10.42.42.2(pid=788): stdout: | (launched: 2022-12-14_14:28:39.303051) 14:28:42.788888 run osmo-hlr_10.42.42.2(pid=788): stderr: | 20221214142839501 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142839501 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142839501 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142839501 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142839501 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142839501 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142839514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142839522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142839522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142839522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:28:42.841417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=781): Terminating (SIGTERM) 14:28:42.883469 run iperf3-srv_10.42.42.10(pid=782): Terminating (SIGTERM) 14:28:42.925364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=783): Terminating (SIGTERM) 14:28:42.967209 run iperf3-srv_10.42.42.10(pid=784): Terminating (SIGTERM) 14:28:43.009052 run pcap-recorder_any(filters='host 10.42.42.2')(pid=787): Terminating (SIGTERM) 14:28:43.051071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=790): Terminating (SIGTERM) 14:28:43.092873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=793): Terminating (SIGTERM) 14:28:43.134660 --- ParallelTerminationStrategy: PID 781 died... 14:28:43.154448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=781): Terminated: ok {rc=0} 14:28:43.200046 --- ParallelTerminationStrategy: PID 782 died... 14:28:43.219293 run iperf3-srv_10.42.42.10(pid=782): Terminated {rc=256} 14:28:43.264520 --- ParallelTerminationStrategy: PID 783 died... 14:28:43.283936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=783): Terminated: ok {rc=0} 14:28:43.329323 --- ParallelTerminationStrategy: PID 784 died... 14:28:43.348640 run iperf3-srv_10.42.42.10(pid=784): Terminated {rc=256} 14:28:43.394217 --- ParallelTerminationStrategy: PID 787 died... 14:28:43.413523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=787): Terminated: ok {rc=0} 14:28:43.459037 --- ParallelTerminationStrategy: PID 790 died... 14:28:43.478375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=790): Terminated: ok {rc=0} 14:28:43.523840 --- ParallelTerminationStrategy: PID 793 died... 14:28:43.543137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=793): Terminated: ok {rc=0} 14:28:43.630024 bus /gobi_0: Setting Powered False 14:28:44.730499 bus /gobi_0: Setting Powered False 14:28:45.854665 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 14:28:47.011543 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:47.024787 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:28:47.087274 tst iperf3.py: using LAC 41532 14:28:47.214961 tst iperf3.py: using RAC 222 14:28:47.341913 tst iperf3.py: using CellId 41532 14:28:47.469528 tst iperf3.py: using BVCI 41533 14:28:47.588617 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:47.599990 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:47.611001 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:47.622076 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:47.633195 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:47.644172 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:47.655364 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:47.667364 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:47.678643 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:28:47.795308 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:28:48.013802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:28:48.335670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=795): Launched 14:28:48.616916 run iperf3-srv_10.42.42.10(pid=796): Launched 14:28:48.738312 tst iperf3.py:8: start network... 14:28:48.956468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:28:49.455703 run create_hlr_db(pid=797): Launched 14:28:49.587276 bus /gobi_6: Setting Powered False 14:28:50.650663 run create_hlr_db(pid=797): Terminated: ok {rc=0} 14:28:51.079541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=799): Launched 14:28:51.381494 run osmo-hlr_10.42.42.2(pid=800): Launched 14:28:51.497846 run osmo-stp_10.42.42.5: Starting osmo-stp 14:28:52.031115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=802): Launched 14:28:52.331011 run osmo-stp_10.42.42.5(pid=803): Launched 14:28:52.446307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:28:52.963649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=805): Launched 14:28:53.080075 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:28:53.333464 run patchelf(pid=806): Launched 14:28:53.502132 run osmo-stp_10.42.42.5(pid=803): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=803)] 14:28:53.629933 run osmo-stp_10.42.42.5(pid=803): stdout: | (launched: 2022-12-14_14:28:52.276398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:53.758626 run osmo-stp_10.42.42.5(pid=803): stderr: | 20221214142852446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142852446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142852447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142852447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142852447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142852447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142852447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:53.888178 run osmo-stp_10.42.42.5(pid=803): stdout: | (launched: 2022-12-14_14:28:52.276398) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:28:54.011541 run osmo-stp_10.42.42.5(pid=803): stderr: | 20221214142852446 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142852446 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142852447 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142852447 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142852447 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142852447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142852447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:28:54.158297 run patchelf(pid=806): Terminating (SIGINT) 14:28:54.327595 run patchelf(pid=806): Terminated: ok {rc=0} 14:28:54.450179 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=803): Process ended prematurely: osmo-stp_10.42.42.5(pid=803) [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=803)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 14:28:54.459400 tst iperf3.py:8: Test FAILED (7.5 sec) 14:28:54.486378 run osmo-hlr_10.42.42.2(pid=800): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=800)] 14:28:54.534655 run osmo-hlr_10.42.42.2(pid=800): stdout: | (launched: 2022-12-14_14:28:51.326670) 14:28:54.584287 run osmo-hlr_10.42.42.2(pid=800): stderr: | 20221214142851502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142851502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142851502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142851502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142851502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142851502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142851514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142851523 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142851523 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142851523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:28:54.634259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=795): Terminating (SIGTERM) 14:28:54.674606 run iperf3-srv_10.42.42.10(pid=796): Terminating (SIGTERM) 14:28:54.714519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=799): Terminating (SIGTERM) 14:28:54.754761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=802): Terminating (SIGTERM) 14:28:54.794926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=805): Terminating (SIGTERM) 14:28:54.835589 --- ParallelTerminationStrategy: PID 795 died... 14:28:54.855331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=795): Terminated: ok {rc=0} 14:28:54.899930 --- ParallelTerminationStrategy: PID 796 died... 14:28:54.919256 run iperf3-srv_10.42.42.10(pid=796): Terminated {rc=256} 14:28:54.963599 --- ParallelTerminationStrategy: PID 799 died... 14:28:54.982718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=799): Terminated: ok {rc=0} 14:28:55.026774 --- ParallelTerminationStrategy: PID 802 died... 14:28:55.045728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=802): Terminated: ok {rc=0} 14:28:55.089596 --- ParallelTerminationStrategy: PID 805 died... 14:28:55.108631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=805): Terminated: ok {rc=0} 14:28:55.194320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 14:28:56.339862 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:56.351359 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:28:56.412306 tst iperf3m4.py: using LAC 41533 14:28:56.533131 tst iperf3m4.py: using RAC 223 14:28:56.651315 tst iperf3m4.py: using CellId 41533 14:28:56.767539 tst iperf3m4.py: using BVCI 41534 14:28:56.876829 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:56.887830 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:56.898563 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:56.909345 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:56.920548 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:56.931675 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:56.942944 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:56.954050 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:28:56.965409 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:28:57.085246 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:28:57.202376 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:28:57.321300 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:28:57.439636 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:28:57.659318 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:28:57.983661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=807): Launched 14:28:58.265399 run iperf3-srv_10.42.42.10(pid=808): Launched 14:28:58.387148 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:28:58.605282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:28:58.929416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=809): Launched 14:28:59.210483 run iperf3-srv_10.42.42.10(pid=810): Launched 14:28:59.331843 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:28:59.549975 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:28:59.874818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=811): Launched 14:29:00.156262 run iperf3-srv_10.42.42.10(pid=812): Launched 14:29:00.277832 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:29:00.494944 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:29:00.819012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=813): Launched 14:29:01.113728 run iperf3-srv_10.42.42.10(pid=814): Launched 14:29:01.243592 tst iperf3m4.py:8: start network... 14:29:01.464883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:29:01.978987 run create_hlr_db(pid=815): Launched 14:29:02.130585 bus /gobi_6: Setting Powered False 14:29:03.190474 run create_hlr_db(pid=815): Terminated: ok {rc=0} 14:29:03.631369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=817): Launched 14:29:03.954465 run osmo-hlr_10.42.42.2(pid=818): Launched 14:29:04.076669 run osmo-stp_10.42.42.5: Starting osmo-stp 14:29:04.629833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=821): Launched 14:29:04.951109 run osmo-stp_10.42.42.5(pid=822): Launched 14:29:05.073811 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:29:05.628831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=825): Launched 14:29:05.752459 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:29:06.023954 run patchelf(pid=826): Launched 14:29:06.203428 run osmo-stp_10.42.42.5(pid=822): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=822)] 14:29:06.340439 run osmo-stp_10.42.42.5(pid=822): stdout: | (launched: 2022-12-14_14:29:04.892702) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:06.477817 run osmo-stp_10.42.42.5(pid=822): stderr: | 20221214142905086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142905086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142905086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142905086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142905087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142905087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142905087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:06.615249 run osmo-stp_10.42.42.5(pid=822): stdout: | (launched: 2022-12-14_14:29:04.892702) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:06.747038 run osmo-stp_10.42.42.5(pid=822): stderr: | 20221214142905086 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142905086 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142905086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142905086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142905087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142905087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142905087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:06.903346 run patchelf(pid=826): Terminating (SIGINT) 14:29:07.083739 run patchelf(pid=826): Terminated: ok {rc=0} 14:29:07.213956 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=822): Process ended prematurely: osmo-stp_10.42.42.5(pid=822) [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=822)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 14:29:07.223905 tst iperf3m4.py:8: Test FAILED (10.9 sec) 14:29:07.252406 run osmo-hlr_10.42.42.2(pid=818): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=818)] 14:29:07.301892 run osmo-hlr_10.42.42.2(pid=818): stdout: | (launched: 2022-12-14_14:29:03.895937) 14:29:07.353434 run osmo-hlr_10.42.42.2(pid=818): stderr: | 20221214142904093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142904093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142904093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142904093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142904093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142904093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142904105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142904113 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142904113 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142904113 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:29:07.405292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=807): Terminating (SIGTERM) 14:29:07.446605 run iperf3-srv_10.42.42.10(pid=808): Terminating (SIGTERM) 14:29:07.487811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=809): Terminating (SIGTERM) 14:29:07.528996 run iperf3-srv_10.42.42.10(pid=810): Terminating (SIGTERM) 14:29:07.570735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=811): Terminating (SIGTERM) 14:29:07.612350 run iperf3-srv_10.42.42.10(pid=812): Terminating (SIGTERM) 14:29:07.653360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=813): Terminating (SIGTERM) 14:29:07.694375 run iperf3-srv_10.42.42.10(pid=814): Terminating (SIGTERM) 14:29:07.735225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=817): Terminating (SIGTERM) 14:29:07.776389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=821): Terminating (SIGTERM) 14:29:07.817770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=825): Terminating (SIGTERM) 14:29:07.859166 --- ParallelTerminationStrategy: PID 807 died... 14:29:07.879028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=807): Terminated: ok {rc=0} 14:29:07.924698 --- ParallelTerminationStrategy: PID 808 died... 14:29:07.943987 run iperf3-srv_10.42.42.10(pid=808): Terminated {rc=256} 14:29:07.989517 --- ParallelTerminationStrategy: PID 809 died... 14:29:08.008839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=809): Terminated: ok {rc=0} 14:29:08.054564 --- ParallelTerminationStrategy: PID 810 died... 14:29:08.074037 run iperf3-srv_10.42.42.10(pid=810): Terminated {rc=256} 14:29:08.119555 --- ParallelTerminationStrategy: PID 811 died... 14:29:08.138867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=811): Terminated: ok {rc=0} 14:29:08.184552 --- ParallelTerminationStrategy: PID 812 died... 14:29:08.203996 run iperf3-srv_10.42.42.10(pid=812): Terminated {rc=256} 14:29:08.249839 --- ParallelTerminationStrategy: PID 813 died... 14:29:08.269216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=813): Terminated: ok {rc=0} 14:29:08.315099 --- ParallelTerminationStrategy: PID 814 died... 14:29:08.334622 run iperf3-srv_10.42.42.10(pid=814): Terminated {rc=256} 14:29:08.380199 --- ParallelTerminationStrategy: PID 817 died... 14:29:08.399628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=817): Terminated: ok {rc=0} 14:29:08.445274 --- ParallelTerminationStrategy: PID 821 died... 14:29:08.464446 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=821): Terminated: ok {rc=0} 14:29:08.510332 --- ParallelTerminationStrategy: PID 825 died... 14:29:08.529706 run pcap-recorder_any(filters='host 10.42.42.6')(pid=825): Terminated: ok {rc=0} 14:29:08.616636 bus /gobi_4: Setting Powered False 14:29:09.715154 bus /gobi_4: Setting Powered False 14:29:10.830539 bus /gobi_1: Setting Powered False 14:29:11.928097 bus /gobi_1: Setting Powered False 14:29:13.045590 bus /gobi_0: Setting Powered False 14:29:14.145572 bus /gobi_0: Setting Powered False 14:29:15.263438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 14:29:16.374107 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:16.391384 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:29:16.461533 tst ping.py: using LAC 41534 14:29:16.587570 tst ping.py: using RAC 224 14:29:16.709136 tst ping.py: using CellId 41534 14:29:16.827972 tst ping.py: using BVCI 41535 14:29:16.947753 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:16.960044 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:16.972185 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:16.984698 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:16.996811 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:17.008496 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:17.020872 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:17.033366 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:29:17.153366 tst ping.py:19: start network... 14:29:17.369234 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:29:17.860559 run create_hlr_db(pid=827): Launched 14:29:17.989634 bus /gobi_6: Setting Powered False 14:29:19.052860 run create_hlr_db(pid=827): Terminated: ok {rc=0} 14:29:19.494295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=831): Launched 14:29:19.811717 run osmo-hlr_10.42.42.2(pid=833): Launched 14:29:19.932591 run osmo-stp_10.42.42.5: Starting osmo-stp 14:29:20.490154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=835): Launched 14:29:20.806284 run osmo-stp_10.42.42.5(pid=836): Launched 14:29:20.927240 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:29:21.472564 run pcap-recorder_any(filters='host 10.42.42.6')(pid=838): Launched 14:29:21.593512 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:29:21.860328 run patchelf(pid=839): Launched 14:29:22.037050 run osmo-stp_10.42.42.5(pid=836): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=836)] 14:29:22.172150 run osmo-stp_10.42.42.5(pid=836): stdout: | (launched: 2022-12-14_14:29:20.749299) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:22.307945 run osmo-stp_10.42.42.5(pid=836): stderr: | 20221214142920939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142920939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142920939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142920940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142920940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142920940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142920940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:22.443917 run osmo-stp_10.42.42.5(pid=836): stdout: | (launched: 2022-12-14_14:29:20.749299) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:22.574057 run osmo-stp_10.42.42.5(pid=836): stderr: | 20221214142920939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142920939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142920939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142920940 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142920940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142920940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142920940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:22.727849 run patchelf(pid=839): Terminating (SIGINT) 14:29:22.906255 run patchelf(pid=839): Terminated: ok {rc=0} 14:29:23.034116 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=836): Process ended prematurely: osmo-stp_10.42.42.5(pid=836) [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=836)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 14:29:23.043336 tst ping.py:22: Test FAILED (6.7 sec) 14:29:23.071257 run osmo-hlr_10.42.42.2(pid=833): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=833)] 14:29:23.121128 run osmo-hlr_10.42.42.2(pid=833): stdout: | (launched: 2022-12-14_14:29:19.754427) 14:29:23.172333 run osmo-hlr_10.42.42.2(pid=833): stderr: | 20221214142919951 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142919951 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142919951 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142919951 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142919951 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142919951 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142919963 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142919971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142919971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142919971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:29:23.223835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=831): Terminating (SIGTERM) 14:29:23.265299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=835): Terminating (SIGTERM) 14:29:23.306780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=838): Terminating (SIGTERM) 14:29:23.348266 --- ParallelTerminationStrategy: PID 831 died... 14:29:23.368187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=831): Terminated: ok {rc=0} 14:29:23.413868 --- ParallelTerminationStrategy: PID 835 died... 14:29:23.433105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=835): Terminated: ok {rc=0} 14:29:23.478367 --- ParallelTerminationStrategy: PID 838 died... 14:29:23.497588 run pcap-recorder_any(filters='host 10.42.42.6')(pid=838): Terminated: ok {rc=0} 14:29:23.583373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 14:29:24.670535 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:24.682478 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:29:24.739914 tst ping_idle_ping.py: using LAC 41535 14:29:24.857361 tst ping_idle_ping.py: using RAC 225 14:29:24.973817 tst ping_idle_ping.py: using CellId 41535 14:29:25.091241 tst ping_idle_ping.py: using BVCI 41536 14:29:25.198909 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:25.209792 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:25.220216 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:25.230776 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:25.241174 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:25.252108 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:25.262775 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:29:25.273832 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:29:25.393330 tst ping_idle_ping.py:24: start network... 14:29:25.591369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:29:26.050617 run create_hlr_db(pid=841): Launched 14:29:26.164134 bus /gobi_6: Setting Powered False 14:29:27.223458 run create_hlr_db(pid=841): Terminated: ok {rc=0} 14:29:27.659901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=844): Launched 14:29:27.979925 run osmo-hlr_10.42.42.2(pid=845): Launched 14:29:28.102148 run osmo-stp_10.42.42.5: Starting osmo-stp 14:29:28.653471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=847): Launched 14:29:28.971496 run osmo-stp_10.42.42.5(pid=848): Launched 14:29:29.093370 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:29:29.641792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=850): Launched 14:29:29.764386 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:29:30.032882 run patchelf(pid=851): Launched 14:29:30.210325 run osmo-stp_10.42.42.5(pid=848): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=848)] 14:29:30.345640 run osmo-stp_10.42.42.5(pid=848): stdout: | (launched: 2022-12-14_14:29:28.914098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:30.481807 run osmo-stp_10.42.42.5(pid=848): stderr: | 20221214142929105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142929105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142929105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142929105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142929108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142929108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142929108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:30.618103 run osmo-stp_10.42.42.5(pid=848): stdout: | (launched: 2022-12-14_14:29:28.914098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:30.748579 run osmo-stp_10.42.42.5(pid=848): stderr: | 20221214142929105 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142929105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142929105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142929105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142929108 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142929108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142929108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:30.907686 run patchelf(pid=851): Terminating (SIGINT) 14:29:31.089158 run patchelf(pid=851): Terminated: ok {rc=0} 14:29:31.219604 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=848): Process ended prematurely: osmo-stp_10.42.42.5(pid=848) [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=848)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 14:29:31.230087 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 14:29:31.259189 run osmo-hlr_10.42.42.2(pid=845): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=845)] 14:29:31.310567 run osmo-hlr_10.42.42.2(pid=845): stdout: | (launched: 2022-12-14_14:29:27.922308) 14:29:31.362632 run osmo-hlr_10.42.42.2(pid=845): stderr: | 20221214142928121 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142928121 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142928121 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142928121 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142928121 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142928121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142928134 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142928142 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142928142 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142928142 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:29:31.415864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=844): Terminating (SIGTERM) 14:29:31.458247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=847): Terminating (SIGTERM) 14:29:31.500638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=850): Terminating (SIGTERM) 14:29:31.543125 --- ParallelTerminationStrategy: PID 844 died... 14:29:31.563496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=844): Terminated: ok {rc=0} 14:29:31.610471 --- ParallelTerminationStrategy: PID 847 died... 14:29:31.630417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=847): Terminated: ok {rc=0} 14:29:31.678491 --- ParallelTerminationStrategy: PID 850 died... 14:29:31.700000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=850): Terminated: ok {rc=0} 14:29:31.793623 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:29:33.079326 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:29:33.085616 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:29:33.106796 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 14:29:33.146077 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 14:29:33.232506 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:29:33.253845 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 14:29:33.293091 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 14:29:33.889797 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 14:29:33.941676 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:33.952363 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:29:34.007915 tst cs_paging_gprs_active.py: using LAC 41536 14:29:34.127814 tst cs_paging_gprs_active.py: using RAC 226 14:29:34.245376 tst cs_paging_gprs_active.py: using CellId 41536 14:29:34.364672 tst cs_paging_gprs_active.py: using BVCI 41537 14:29:34.475076 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:34.485821 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:34.496167 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:34.506683 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:34.517109 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:34.527806 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:34.539754 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:34.550491 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:34.561674 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:29:34.682376 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:29:34.797766 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:29:34.999306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:29:35.300594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=856): Launched 14:29:35.563009 run iperf3-srv_10.42.42.10(pid=857): Launched 14:29:35.676326 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:29:35.877657 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:29:36.178508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=858): Launched 14:29:36.440193 run iperf3-srv_10.42.42.10(pid=859): Launched 14:29:36.553806 tst cs_paging_gprs_active.py:38: start network... 14:29:36.754227 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:29:37.220120 run create_hlr_db(pid=860): Launched 14:29:37.336060 bus /gobi_6: Setting Powered False 14:29:38.396927 run create_hlr_db(pid=860): Terminated: ok {rc=0} 14:29:38.838352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=862): Launched 14:29:39.162917 run osmo-hlr_10.42.42.2(pid=863): Launched 14:29:39.287007 run osmo-stp_10.42.42.5: Starting osmo-stp 14:29:39.842493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=865): Launched 14:29:40.165418 run osmo-stp_10.42.42.5(pid=866): Launched 14:29:40.289297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:29:40.846035 run pcap-recorder_any(filters='host 10.42.42.6')(pid=868): Launched 14:29:40.970772 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:29:41.243671 run patchelf(pid=869): Launched 14:29:41.424768 run osmo-stp_10.42.42.5(pid=866): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=866)] 14:29:41.561547 run osmo-stp_10.42.42.5(pid=866): stdout: | (launched: 2022-12-14_14:29:40.106883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:41.699693 run osmo-stp_10.42.42.5(pid=866): stderr: | 20221214142940299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142940299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142940299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142940299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142940302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142940302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142940302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:41.838241 run osmo-stp_10.42.42.5(pid=866): stdout: | (launched: 2022-12-14_14:29:40.106883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:41.971421 run osmo-stp_10.42.42.5(pid=866): stderr: | 20221214142940299 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142940299 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142940299 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142940299 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142940302 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142940302 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142940302 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:42.128030 run patchelf(pid=869): Terminating (SIGINT) 14:29:42.309521 run patchelf(pid=869): Terminated: ok {rc=0} 14:29:42.439733 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=866): Process ended prematurely: osmo-stp_10.42.42.5(pid=866) [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=866)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 14:29:42.449783 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 14:29:42.477988 run osmo-hlr_10.42.42.2(pid=863): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=863)] 14:29:42.528000 run osmo-hlr_10.42.42.2(pid=863): stdout: | (launched: 2022-12-14_14:29:39.104328) 14:29:42.579727 run osmo-hlr_10.42.42.2(pid=863): stderr: | 20221214142939301 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142939301 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142939301 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142939301 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142939301 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142939301 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142939339 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142939348 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142939348 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142939348 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:29:42.631680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=856): Terminating (SIGTERM) 14:29:42.673233 run iperf3-srv_10.42.42.10(pid=857): Terminating (SIGTERM) 14:29:42.714556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=858): Terminating (SIGTERM) 14:29:42.756122 run iperf3-srv_10.42.42.10(pid=859): Terminating (SIGTERM) 14:29:42.797534 run pcap-recorder_any(filters='host 10.42.42.2')(pid=862): Terminating (SIGTERM) 14:29:42.839168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=865): Terminating (SIGTERM) 14:29:42.880764 run pcap-recorder_any(filters='host 10.42.42.6')(pid=868): Terminating (SIGTERM) 14:29:42.922846 --- ParallelTerminationStrategy: PID 856 died... 14:29:42.942570 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=856): Terminated: ok {rc=0} 14:29:42.988455 --- ParallelTerminationStrategy: PID 857 died... 14:29:43.007908 run iperf3-srv_10.42.42.10(pid=857): Terminated {rc=256} 14:29:43.053647 --- ParallelTerminationStrategy: PID 858 died... 14:29:43.073126 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=858): Terminated: ok {rc=0} 14:29:43.118780 --- ParallelTerminationStrategy: PID 859 died... 14:29:43.137999 run iperf3-srv_10.42.42.10(pid=859): Terminated {rc=256} 14:29:43.183678 --- ParallelTerminationStrategy: PID 862 died... 14:29:43.203112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=862): Terminated: ok {rc=0} 14:29:43.248725 --- ParallelTerminationStrategy: PID 865 died... 14:29:43.268086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=865): Terminated: ok {rc=0} 14:29:43.313751 --- ParallelTerminationStrategy: PID 868 died... 14:29:43.333186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=868): Terminated: ok {rc=0} 14:29:43.419875 bus /gobi_0: Setting Powered False 14:29:44.518375 bus /gobi_0: Setting Powered False 14:29:45.634171 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 14:29:46.779279 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:46.791741 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:29:46.854586 tst iperf3.py: using LAC 41537 14:29:46.984422 tst iperf3.py: using RAC 227 14:29:47.106036 tst iperf3.py: using CellId 41537 14:29:47.227956 tst iperf3.py: using BVCI 41538 14:29:47.345717 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:47.356888 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:47.368026 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:47.379180 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:47.390179 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:47.401275 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:47.412299 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:47.423269 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:47.434540 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:29:47.551188 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:29:47.770910 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:29:48.096834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=870): Launched 14:29:48.378814 run iperf3-srv_10.42.42.10(pid=871): Launched 14:29:48.500833 tst iperf3.py:8: start network... 14:29:48.718183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:29:49.217683 run create_hlr_db(pid=882): Launched 14:29:49.339989 bus /gobi_6: Setting Powered False 14:29:50.399399 run create_hlr_db(pid=882): Terminated: ok {rc=0} 14:29:50.841075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=888): Launched 14:29:51.164426 run osmo-hlr_10.42.42.2(pid=889): Launched 14:29:51.288905 run osmo-stp_10.42.42.5: Starting osmo-stp 14:29:51.848065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=891): Launched 14:29:52.172412 run osmo-stp_10.42.42.5(pid=892): Launched 14:29:52.295506 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:29:52.858376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=894): Launched 14:29:52.983360 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:29:53.256511 run patchelf(pid=895): Launched 14:29:53.437130 run osmo-stp_10.42.42.5(pid=892): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=892)] 14:29:53.574190 run osmo-stp_10.42.42.5(pid=892): stdout: | (launched: 2022-12-14_14:29:52.113857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:53.712152 run osmo-stp_10.42.42.5(pid=892): stderr: | 20221214142952307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142952307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142952307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142952308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142952308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142952308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142952308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:53.851261 run osmo-stp_10.42.42.5(pid=892): stdout: | (launched: 2022-12-14_14:29:52.113857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:29:53.984010 run osmo-stp_10.42.42.5(pid=892): stderr: | 20221214142952307 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214142952307 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214142952307 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214142952308 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214142952308 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214142952308 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214142952308 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:29:54.140495 run patchelf(pid=895): Terminating (SIGINT) 14:29:54.322147 run patchelf(pid=895): Terminated: ok {rc=0} 14:29:54.453459 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=892): Process ended prematurely: osmo-stp_10.42.42.5(pid=892) [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=892)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 14:29:54.463657 tst iperf3.py:8: Test FAILED (7.7 sec) 14:29:54.492080 run osmo-hlr_10.42.42.2(pid=889): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=889)] 14:29:54.541938 run osmo-hlr_10.42.42.2(pid=889): stdout: | (launched: 2022-12-14_14:29:51.106176) 14:29:54.593568 run osmo-hlr_10.42.42.2(pid=889): stderr: | 20221214142951304 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214142951304 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214142951304 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214142951304 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214142951304 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214142951304 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214142951360 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214142951369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214142951369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214142951369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:29:54.645732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=870): Terminating (SIGTERM) 14:29:54.687733 run iperf3-srv_10.42.42.10(pid=871): Terminating (SIGTERM) 14:29:54.730008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=888): Terminating (SIGTERM) 14:29:54.771612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=891): Terminating (SIGTERM) 14:29:54.813661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=894): Terminating (SIGTERM) 14:29:54.855866 --- ParallelTerminationStrategy: PID 870 died... 14:29:54.876119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=870): Terminated: ok {rc=0} 14:29:54.922558 --- ParallelTerminationStrategy: PID 871 died... 14:29:54.942034 run iperf3-srv_10.42.42.10(pid=871): Terminated {rc=256} 14:29:54.987704 --- ParallelTerminationStrategy: PID 888 died... 14:29:55.007234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=888): Terminated: ok {rc=0} 14:29:55.053063 --- ParallelTerminationStrategy: PID 891 died... 14:29:55.072440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=891): Terminated: ok {rc=0} 14:29:55.118474 --- ParallelTerminationStrategy: PID 894 died... 14:29:55.138114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=894): Terminated: ok {rc=0} 14:29:55.226192 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 14:29:56.377938 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:56.389850 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:29:56.447717 tst iperf3m4.py: using LAC 41538 14:29:56.574403 tst iperf3m4.py: using RAC 228 14:29:56.700775 tst iperf3m4.py: using CellId 41538 14:29:56.827442 tst iperf3m4.py: using BVCI 41539 14:29:56.944477 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:56.955796 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:56.966848 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:56.978005 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:56.989067 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:57.000180 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:57.011326 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:57.022484 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:29:57.033773 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:29:57.150843 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:29:57.273131 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:29:57.388254 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:29:57.508230 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:29:57.727058 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:29:58.052459 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=896): Launched 14:29:58.333918 run iperf3-srv_10.42.42.10(pid=897): Launched 14:29:58.455953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:29:58.673731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:29:58.997674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=898): Launched 14:29:59.278965 run iperf3-srv_10.42.42.10(pid=899): Launched 14:29:59.400919 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:29:59.618544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:29:59.943279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=900): Launched 14:30:00.225279 run iperf3-srv_10.42.42.10(pid=901): Launched 14:30:00.347218 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:30:00.565100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:30:00.918838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=902): Launched 14:30:01.218698 run iperf3-srv_10.42.42.10(pid=903): Launched 14:30:01.361766 tst iperf3m4.py:8: start network... 14:30:01.582460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:30:02.101709 run create_hlr_db(pid=908): Launched 14:30:02.318230 bus /gobi_6: Setting Powered False 14:30:03.382121 run create_hlr_db(pid=908): Terminated: ok {rc=0} 14:30:03.812380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=916): Launched 14:30:04.114698 run osmo-hlr_10.42.42.2(pid=917): Launched 14:30:04.229986 run osmo-stp_10.42.42.5: Starting osmo-stp 14:30:04.756171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=919): Launched 14:30:05.057202 run osmo-stp_10.42.42.5(pid=920): Launched 14:30:05.172325 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:30:05.691235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=922): Launched 14:30:05.807542 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:30:06.063564 run patchelf(pid=923): Launched 14:30:06.231882 run osmo-stp_10.42.42.5(pid=920): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=920)] 14:30:06.360014 run osmo-stp_10.42.42.5(pid=920): stdout: | (launched: 2022-12-14_14:30:05.002414) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:06.489149 run osmo-stp_10.42.42.5(pid=920): stderr: | 20221214143005173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143005173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143005173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143005174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143005174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143005174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143005174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:06.618531 run osmo-stp_10.42.42.5(pid=920): stdout: | (launched: 2022-12-14_14:30:05.002414) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:06.742258 run osmo-stp_10.42.42.5(pid=920): stderr: | 20221214143005173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143005173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143005173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143005174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143005174 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143005174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143005174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:06.888930 run patchelf(pid=923): Terminating (SIGINT) 14:30:07.058995 run patchelf(pid=923): Terminated: ok {rc=0} 14:30:07.181500 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=920): Process ended prematurely: osmo-stp_10.42.42.5(pid=920) [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=920)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 14:30:07.190839 tst iperf3m4.py:8: Test FAILED (10.9 sec) 14:30:07.218171 run osmo-hlr_10.42.42.2(pid=917): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=917)] 14:30:07.266375 run osmo-hlr_10.42.42.2(pid=917): stdout: | (launched: 2022-12-14_14:30:04.059353) 14:30:07.316207 run osmo-hlr_10.42.42.2(pid=917): stderr: | 20221214143004233 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143004233 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143004233 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143004233 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143004234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143004234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143004249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143004259 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143004259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143004260 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:30:07.366076 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=896): Terminating (SIGTERM) 14:30:07.406388 run iperf3-srv_10.42.42.10(pid=897): Terminating (SIGTERM) 14:30:07.446612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=898): Terminating (SIGTERM) 14:30:07.487226 run iperf3-srv_10.42.42.10(pid=899): Terminating (SIGTERM) 14:30:07.527533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=900): Terminating (SIGTERM) 14:30:07.567493 run iperf3-srv_10.42.42.10(pid=901): Terminating (SIGTERM) 14:30:07.607754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=902): Terminating (SIGTERM) 14:30:07.648280 run iperf3-srv_10.42.42.10(pid=903): Terminating (SIGTERM) 14:30:07.688194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=916): Terminating (SIGTERM) 14:30:07.728075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=919): Terminating (SIGTERM) 14:30:07.767894 run pcap-recorder_any(filters='host 10.42.42.6')(pid=922): Terminating (SIGTERM) 14:30:07.808005 --- ParallelTerminationStrategy: PID 896 died... 14:30:07.827541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=896): Terminated: ok {rc=0} 14:30:07.871759 --- ParallelTerminationStrategy: PID 897 died... 14:30:07.890575 run iperf3-srv_10.42.42.10(pid=897): Terminated {rc=256} 14:30:07.934521 --- ParallelTerminationStrategy: PID 898 died... 14:30:07.953465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=898): Terminated: ok {rc=0} 14:30:07.997281 --- ParallelTerminationStrategy: PID 899 died... 14:30:08.016274 run iperf3-srv_10.42.42.10(pid=899): Terminated {rc=256} 14:30:08.060814 --- ParallelTerminationStrategy: PID 900 died... 14:30:08.080162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=900): Terminated: ok {rc=0} 14:30:08.124226 --- ParallelTerminationStrategy: PID 901 died... 14:30:08.143070 run iperf3-srv_10.42.42.10(pid=901): Terminated {rc=256} 14:30:08.187085 --- ParallelTerminationStrategy: PID 902 died... 14:30:08.205950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=902): Terminated: ok {rc=0} 14:30:08.249880 --- ParallelTerminationStrategy: PID 903 died... 14:30:08.268570 run iperf3-srv_10.42.42.10(pid=903): Terminated {rc=256} 14:30:08.312700 --- ParallelTerminationStrategy: PID 916 died... 14:30:08.331852 run pcap-recorder_any(filters='host 10.42.42.2')(pid=916): Terminated: ok {rc=0} 14:30:08.375832 --- ParallelTerminationStrategy: PID 919 died... 14:30:08.394664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=919): Terminated: ok {rc=0} 14:30:08.438530 --- ParallelTerminationStrategy: PID 922 died... 14:30:08.457450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=922): Terminated: ok {rc=0} 14:30:08.541467 bus /gobi_4: Setting Powered False 14:30:09.639486 bus /gobi_4: Setting Powered False 14:30:10.757069 bus /gobi_1: Setting Powered False 14:30:11.854438 bus /gobi_1: Setting Powered False 14:30:12.972496 bus /gobi_0: Setting Powered False 14:30:14.077898 bus /gobi_0: Setting Powered False 14:30:15.195365 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 14:30:16.296080 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:16.308877 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:30:16.371572 tst ping.py: using LAC 41539 14:30:16.489964 tst ping.py: using RAC 229 14:30:16.609161 tst ping.py: using CellId 41539 14:30:16.728279 tst ping.py: using BVCI 41540 14:30:16.837445 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:16.849149 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:16.860318 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:16.872615 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:16.884807 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:16.896039 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:16.907735 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:16.919002 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:30:17.058965 tst ping.py:19: start network... 14:30:17.285716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:30:17.778542 run create_hlr_db(pid=1299): Launched 14:30:17.909498 bus /gobi_6: Setting Powered False 14:30:18.972923 run create_hlr_db(pid=1299): Terminated: ok {rc=0} 14:30:19.398690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1301): Launched 14:30:19.694979 run osmo-hlr_10.42.42.2(pid=1302): Launched 14:30:19.807175 run osmo-stp_10.42.42.5: Starting osmo-stp 14:30:20.322660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1304): Launched 14:30:20.618091 run osmo-stp_10.42.42.5(pid=1305): Launched 14:30:20.730532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:30:21.240631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1307): Launched 14:30:21.354850 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:30:21.604730 run patchelf(pid=1308): Launched 14:30:21.770745 run osmo-stp_10.42.42.5(pid=1305): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1305)] 14:30:21.896432 run osmo-stp_10.42.42.5(pid=1305): stdout: | (launched: 2022-12-14_14:30:20.564288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:22.023731 run osmo-stp_10.42.42.5(pid=1305): stderr: | 20221214143020735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143020735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143020735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143020735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143020736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143020736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143020736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:22.151119 run osmo-stp_10.42.42.5(pid=1305): stdout: | (launched: 2022-12-14_14:30:20.564288) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:22.272747 run osmo-stp_10.42.42.5(pid=1305): stderr: | 20221214143020735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143020735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143020735 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143020735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143020736 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143020736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143020736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:22.416467 run patchelf(pid=1308): Terminating (SIGINT) 14:30:22.583378 run patchelf(pid=1308): Terminated: ok {rc=0} 14:30:22.703642 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1305): Process ended prematurely: osmo-stp_10.42.42.5(pid=1305) [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1305)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 14:30:22.712544 tst ping.py:22: Test FAILED (6.4 sec) 14:30:22.739554 run osmo-hlr_10.42.42.2(pid=1302): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1302)] 14:30:22.788300 run osmo-hlr_10.42.42.2(pid=1302): stdout: | (launched: 2022-12-14_14:30:19.640410) 14:30:22.838523 run osmo-hlr_10.42.42.2(pid=1302): stderr: | 20221214143019814 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143019814 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143019814 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143019814 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143019814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143019814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143019826 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143019835 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143019836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143019836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:30:22.889074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1301): Terminating (SIGTERM) 14:30:22.930028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1304): Terminating (SIGTERM) 14:30:22.970866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1307): Terminating (SIGTERM) 14:30:23.012500 --- ParallelTerminationStrategy: PID 1301 died... 14:30:23.032561 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1301): Terminated: ok {rc=0} 14:30:23.078087 --- ParallelTerminationStrategy: PID 1304 died... 14:30:23.097105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1304): Terminated: ok {rc=0} 14:30:23.141944 --- ParallelTerminationStrategy: PID 1307 died... 14:30:23.161969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1307): Terminated: ok {rc=0} 14:30:23.250379 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 14:30:24.338714 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:24.351544 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:30:24.414349 tst ping_idle_ping.py: using LAC 41540 14:30:24.537754 tst ping_idle_ping.py: using RAC 230 14:30:24.655448 tst ping_idle_ping.py: using CellId 41540 14:30:24.774346 tst ping_idle_ping.py: using BVCI 41541 14:30:24.886131 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:24.898038 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:24.909650 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:24.921403 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:24.934303 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:24.947037 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:24.959934 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:30:24.972606 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:30:25.092036 tst ping_idle_ping.py:24: start network... 14:30:25.295353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:30:25.778644 run create_hlr_db(pid=1484): Launched 14:30:25.934770 bus /gobi_6: Setting Powered False 14:30:26.994713 run create_hlr_db(pid=1484): Terminated: ok {rc=0} 14:30:27.431269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1486): Launched 14:30:27.753161 run osmo-hlr_10.42.42.2(pid=1487): Launched 14:30:27.988058 run osmo-stp_10.42.42.5: Starting osmo-stp 14:30:28.727715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1490): Launched 14:30:29.074284 run osmo-stp_10.42.42.5(pid=1491): Launched 14:30:29.199893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:30:29.761359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1493): Launched 14:30:29.887753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:30:30.162383 run patchelf(pid=1494): Launched 14:30:30.343778 run osmo-stp_10.42.42.5(pid=1491): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1491)] 14:30:30.481602 run osmo-stp_10.42.42.5(pid=1491): stdout: | (launched: 2022-12-14_14:30:29.014444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:30.620269 run osmo-stp_10.42.42.5(pid=1491): stderr: | 20221214143029208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143029208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143029208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143029208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143029209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143029209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143029209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:30.759196 run osmo-stp_10.42.42.5(pid=1491): stdout: | (launched: 2022-12-14_14:30:29.014444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:30.915857 run osmo-stp_10.42.42.5(pid=1491): stderr: | 20221214143029208 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143029208 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143029208 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143029208 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143029209 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143029209 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143029209 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:31.071214 run patchelf(pid=1494): Terminating (SIGINT) 14:30:31.246736 run patchelf(pid=1494): Terminated: ok {rc=0} 14:30:31.375187 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1491): Process ended prematurely: osmo-stp_10.42.42.5(pid=1491) [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1491)] [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 14:30:31.385034 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 14:30:31.413472 run osmo-hlr_10.42.42.2(pid=1487): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1487)] 14:30:31.463623 run osmo-hlr_10.42.42.2(pid=1487): stdout: | (launched: 2022-12-14_14:30:27.693495) 14:30:31.516741 run osmo-hlr_10.42.42.2(pid=1487): stderr: | 20221214143028037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143028037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143028038 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143028038 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143028038 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143028038 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143028052 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143028060 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143028060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143028060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:30:31.569887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1486): Terminating (SIGTERM) 14:30:31.614611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1490): Terminating (SIGTERM) 14:30:31.658616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1493): Terminating (SIGTERM) 14:30:31.704901 --- ParallelTerminationStrategy: PID 1486 died... 14:30:31.726105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1486): Terminated: ok {rc=0} 14:30:31.774555 --- ParallelTerminationStrategy: PID 1490 died... 14:30:31.795313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1490): Terminated: ok {rc=0} 14:30:31.842036 --- ParallelTerminationStrategy: PID 1493 died... 14:30:31.862788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1493): Terminated: ok {rc=0} 14:30:31.952384 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:30:33.278103 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:30:33.285720 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:30:33.307425 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 14:30:33.344598 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:30:33.406880 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:30:33.427883 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 14:30:33.463001 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:30:34.012078 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2406 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 14:30:34.017465 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:30:34.028746 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:30:34.084153 tst switch_tch_pdch.py: using LAC 41541 14:30:34.202573 tst switch_tch_pdch.py: using RAC 231 14:30:34.321730 tst switch_tch_pdch.py: using CellId 41541 14:30:34.439535 tst switch_tch_pdch.py: using BVCI 41542 14:30:34.548218 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:30:34.559644 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:30:34.570737 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:30:34.581810 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:30:34.593148 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:30:34.604340 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:30:34.615791 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:30:34.627209 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:30:34.748633 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:30:34.867102 tst switch_tch_pdch.py:51: start network... 14:30:35.067684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:30:35.531729 run create_hlr_db(pid=1500): Launched 14:30:35.645878 bus /gobi_6: Setting Powered False 14:30:36.706663 run create_hlr_db(pid=1500): Terminated: ok {rc=0} 14:30:37.150931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1502): Launched 14:30:37.476486 run osmo-hlr_10.42.42.2(pid=1503): Launched 14:30:37.603742 run osmo-stp_10.42.42.5: Starting osmo-stp 14:30:38.165608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1505): Launched 14:30:38.489793 run osmo-stp_10.42.42.5(pid=1506): Launched 14:30:38.616620 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:30:39.175528 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1508): Launched 14:30:39.300416 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:30:39.573424 run patchelf(pid=1509): Launched 14:30:39.755086 run osmo-stp_10.42.42.5(pid=1506): ERR: Terminated: ERROR {rc=1} [trial-2406↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1506)] 14:30:39.891989 run osmo-stp_10.42.42.5(pid=1506): stdout: | (launched: 2022-12-14_14:30:38.430541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:40.029769 run osmo-stp_10.42.42.5(pid=1506): stderr: | 20221214143038622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143038622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143038623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143038623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143038625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143038626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143038626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:40.167764 run osmo-stp_10.42.42.5(pid=1506): stdout: | (launched: 2022-12-14_14:30:38.430541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:40.299918 run osmo-stp_10.42.42.5(pid=1506): stderr: | 20221214143038622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143038622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143038623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143038623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143038625 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143038626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143038626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:40.455696 run patchelf(pid=1509): Terminating (SIGINT) 14:30:40.636726 run patchelf(pid=1509): Terminated: ok {rc=0} 14:30:40.766800 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1506): Process ended prematurely: osmo-stp_10.42.42.5(pid=1506) [trial-2406↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1506)] [trial-2406↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 14:30:40.776358 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 14:30:40.804656 run osmo-hlr_10.42.42.2(pid=1503): ERR: Terminated: ERROR {rc=237} [trial-2406↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1503)] 14:30:40.854887 run osmo-hlr_10.42.42.2(pid=1503): stdout: | (launched: 2022-12-14_14:30:37.417773) 14:30:40.906809 run osmo-hlr_10.42.42.2(pid=1503): stderr: | 20221214143037614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143037614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143037614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143037614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143037614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143037615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143037627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143037635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143037636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143037636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:30:40.958828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1502): Terminating (SIGTERM) 14:30:41.000776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1505): Terminating (SIGTERM) 14:30:41.042665 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1508): Terminating (SIGTERM) 14:30:41.085323 --- ParallelTerminationStrategy: PID 1502 died... 14:30:41.105541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1502): Terminated: ok {rc=0} 14:30:41.151835 --- ParallelTerminationStrategy: PID 1505 died... 14:30:41.171465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1505): Terminated: ok {rc=0} 14:30:41.217267 --- ParallelTerminationStrategy: PID 1508 died... 14:30:41.236622 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1508): Terminated: ok {rc=0} 14:30:41.324409 bus /gobi_0: Setting Powered False 14:30:42.420608 bus /gobi_0: Setting Powered False 14:30:43.533165 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 14:30:44.771723 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:30:44.778031 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 14:30:44.799655 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 14:30:44.835414 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 14:30:44.891617 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 14:30:44.913451 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 14:30:44.948441 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 14:30:45.503284 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2406 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 14:30:45.508498 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:30:45.519938 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 14:30:45.578706 tst switch_tch_pdch.py: using LAC 41542 14:30:45.706696 tst switch_tch_pdch.py: using RAC 232 14:30:45.837269 tst switch_tch_pdch.py: using CellId 41542 14:30:45.975497 tst switch_tch_pdch.py: using BVCI 41543 14:30:46.095221 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:30:46.107310 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:30:46.119227 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:30:46.131128 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:30:46.143323 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:30:46.155121 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:30:46.167129 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:30:46.179142 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:30:46.327618 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:30:46.443473 tst switch_tch_pdch.py:51: start network... 14:30:46.654971 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:30:47.110719 run create_hlr_db(pid=1513): Launched 14:30:47.268811 bus /gobi_6: Setting Powered False 14:30:48.329318 run create_hlr_db(pid=1513): Terminated: ok {rc=0} 14:30:48.725719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1515): Launched 14:30:49.027979 run osmo-hlr_10.42.42.2(pid=1516): Launched 14:30:49.144428 run osmo-stp_10.42.42.5: Starting osmo-stp 14:30:49.637064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1518): Launched 14:30:49.962509 run osmo-stp_10.42.42.5(pid=1519): Launched 14:30:50.087384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:30:50.618926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1521): Launched 14:30:50.743201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:30:51.017644 run patchelf(pid=1522): Launched 14:30:51.198044 run osmo-stp_10.42.42.5(pid=1519): ERR: Terminated: ERROR {rc=1} [trial-2406↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1519)] 14:30:51.335169 run osmo-stp_10.42.42.5(pid=1519): stdout: | (launched: 2022-12-14_14:30:49.903569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:51.474189 run osmo-stp_10.42.42.5(pid=1519): stderr: | 20221214143050096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143050096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143050096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143050096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143050099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143050099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143050099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:51.612694 run osmo-stp_10.42.42.5(pid=1519): stdout: | (launched: 2022-12-14_14:30:49.903569) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:30:51.745256 run osmo-stp_10.42.42.5(pid=1519): stderr: | 20221214143050096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143050096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143050096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143050096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143050099 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143050099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143050099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:30:51.902831 run patchelf(pid=1522): Terminating (SIGINT) 14:30:52.084925 run patchelf(pid=1522): Terminated: ok {rc=0} 14:30:52.215765 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1519): Process ended prematurely: osmo-stp_10.42.42.5(pid=1519) [trial-2406↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1519)] [trial-2406↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 14:30:52.225437 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 14:30:52.253623 run osmo-hlr_10.42.42.2(pid=1516): ERR: Terminated: ERROR {rc=237} [trial-2406↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1516)] 14:30:52.304045 run osmo-hlr_10.42.42.2(pid=1516): stdout: | (launched: 2022-12-14_14:30:48.972446) 14:30:52.356364 run osmo-hlr_10.42.42.2(pid=1516): stderr: | 20221214143049151 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143049151 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143049151 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143049151 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143049151 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143049151 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143049162 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143049171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143049171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143049171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:30:52.409676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1515): Terminating (SIGTERM) 14:30:52.452219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1518): Terminating (SIGTERM) 14:30:52.495101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1521): Terminating (SIGTERM) 14:30:52.537805 --- ParallelTerminationStrategy: PID 1515 died... 14:30:52.558075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1515): Terminated: ok {rc=0} 14:30:52.604717 --- ParallelTerminationStrategy: PID 1518 died... 14:30:52.624360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1518): Terminated: ok {rc=0} 14:30:52.671301 --- ParallelTerminationStrategy: PID 1521 died... 14:30:52.691072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1521): Terminated: ok {rc=0} 14:30:52.779099 bus /gobi_0: Setting Powered False 14:30:53.879537 bus /gobi_0: Setting Powered False 14:30:54.995363 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 nitb_sms:oc2g --------------------------------------------------------------------- 14:30:56.234236 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:30:56.237928 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 14:30:56.258377 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 14:30:56.264923 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 14:30:56.320093 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 14:30:56.343312 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 14:30:56.350436 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 14:30:56.884597 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 14:30:56.890051 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 14:30:56.901543 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 14:30:56.939257 tst mo_mt_sms.py: using LAC 41543 14:30:57.066223 tst mo_mt_sms.py: using RAC 233 14:30:57.190852 tst mo_mt_sms.py: using CellId 41543 14:30:57.317211 tst mo_mt_sms.py: using BVCI 41544 14:30:57.434285 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 14:30:57.553295 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 14:30:57.673739 tst mo_mt_sms.py:9: start nitb and bts... 14:30:57.877095 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:30:58.492223 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1528): Launched 14:30:58.795328 run osmo-nitb_10.42.42.2(pid=1529): Launched 14:30:58.963570 run osmo-nitb_10.42.42.2(pid=1529): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1529)] 14:30:59.099653 run osmo-nitb_10.42.42.2(pid=1529): stdout: | (launched: 2022-12-14_14:30:58.739722) 14:30:59.236777 run osmo-nitb_10.42.42.2(pid=1529): stderr: | (launched: 2022-12-14_14:30:58.784351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:30:59.374074 run osmo-nitb_10.42.42.2(pid=1529): stdout: | (launched: 2022-12-14_14:30:58.739722) 14:30:59.507236 run osmo-nitb_10.42.42.2(pid=1529): stderr: | (launched: 2022-12-14_14:30:58.784351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1529) [trial-2406↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1529)] 14:30:59.909919 tst osmo-nitb_10.42.42.2(pid=1529): stdout: | (launched: 2022-12-14_14:30:58.739722) 14:31:00.031307 tst osmo-nitb_10.42.42.2(pid=1529): stderr: | (launched: 2022-12-14_14:30:58.784351) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:31:00.174112 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1529): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1529) [trial-2406↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1529)] [trial-2406↪nitb_sms:oc2g↪mo_mt_sms.py:11] 14:31:00.182496 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 14:31:00.189170 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1528): Terminating (SIGTERM) 14:31:00.398607 --- ParallelTerminationStrategy: PID 1528 died... 14:31:00.419410 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1528): Terminated: ok {rc=0} 14:31:00.507519 bus /sierra_3: Setting Powered False 14:31:01.609290 bus /sierra_3: Setting Powered False 14:31:02.729929 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 sms:oc2g --------------------------------------------------------------------- 14:31:03.914971 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:31:03.919001 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 14:31:03.939324 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 14:31:03.967147 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 14:31:04.018554 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 14:31:04.039343 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 14:31:04.066211 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 14:31:04.610359 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 sms:oc2g mo_mt_sms.py ---------------------------------------------- 14:31:04.615292 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 14:31:04.625811 tst sms:oc2g: Using 1 x bts (candidates: 1) 14:31:04.659020 tst mo_mt_sms.py: using LAC 41544 14:31:04.776323 tst mo_mt_sms.py: using RAC 234 14:31:04.893092 tst mo_mt_sms.py: using CellId 41544 14:31:05.011816 tst mo_mt_sms.py: using BVCI 41545 14:31:05.122230 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 14:31:05.132798 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 14:31:05.143219 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 14:31:05.153569 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 14:31:05.163806 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 14:31:05.174215 tst sms:oc2g: Using 1 x modem (candidates: 2) 14:31:05.295401 tst sms:oc2g: Using 1 x modem (candidates: 2) 14:31:05.416079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:31:05.919342 run create_hlr_db(pid=1533): Launched 14:31:06.050989 bus /sierra_2: Setting Powered False 14:31:07.114590 run create_hlr_db(pid=1533): Terminated: ok {rc=0} 14:31:07.565827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1535): Launched 14:31:07.890534 run osmo-hlr_10.42.42.2(pid=1536): Launched 14:31:08.015028 run osmo-stp_10.42.42.5: Starting osmo-stp 14:31:08.571146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1538): Launched 14:31:08.895591 run osmo-stp_10.42.42.5(pid=1539): Launched 14:31:09.021088 run osmo-msc_10.42.42.6: Starting osmo-msc 14:31:09.606178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1541): Launched 14:31:09.930612 run osmo-msc_10.42.42.6(pid=1542): Launched 14:31:10.112766 run osmo-stp_10.42.42.5(pid=1539): ERR: Terminated: ERROR {rc=1} [trial-2406↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1539)] 14:31:10.248628 run osmo-stp_10.42.42.5(pid=1539): stdout: | (launched: 2022-12-14_14:31:08.835921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:10.385692 run osmo-stp_10.42.42.5(pid=1539): stderr: | 20221214143109028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143109028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143109028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143109028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143109029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143109029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143109029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:10.522079 run osmo-stp_10.42.42.5(pid=1539): stdout: | (launched: 2022-12-14_14:31:08.835921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:10.651012 run osmo-stp_10.42.42.5(pid=1539): stderr: | 20221214143109028 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143109028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143109028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143109028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143109029 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143109029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143109029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:10.805122 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1539): Process ended prematurely: osmo-stp_10.42.42.5(pid=1539) [trial-2406↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1539)] [trial-2406↪sms:oc2g↪mo_mt_sms.py:16] 14:31:10.814246 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 14:31:10.841826 run osmo-hlr_10.42.42.2(pid=1536): ERR: Terminated: ERROR {rc=237} [trial-2406↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1536)] 14:31:10.892276 run osmo-hlr_10.42.42.2(pid=1536): stdout: | (launched: 2022-12-14_14:31:07.830822) 14:31:10.944387 run osmo-hlr_10.42.42.2(pid=1536): stderr: | 20221214143108031 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143108032 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143108032 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143108032 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143108032 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143108032 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143108043 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143108051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143108052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143108052 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:31:11.016624 run osmo-msc_10.42.42.6(pid=1542): ERR: Terminated: ERROR {rc=2} [trial-2406↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1542)] 14:31:11.066734 run osmo-msc_10.42.42.6(pid=1542): stdout: | (launched: 2022-12-14_14:31:09.870976) 14:31:11.118447 run osmo-msc_10.42.42.6(pid=1542): stderr: | 20221214143110191 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143110192 DLGLOBAL DEBUG validating counter group 0x7f772080fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143110192 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143110192 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143110192 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143110192 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143110194 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143110194 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143110195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143110195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:31:11.170332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1535): Terminating (SIGTERM) 14:31:11.212040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1538): Terminating (SIGTERM) 14:31:11.254315 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1541): Terminating (SIGTERM) 14:31:11.296906 --- ParallelTerminationStrategy: PID 1535 died... 14:31:11.316893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1535): Terminated: ok {rc=0} 14:31:11.363126 --- ParallelTerminationStrategy: PID 1538 died... 14:31:11.382760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1538): Terminated: ok {rc=0} 14:31:11.428733 --- ParallelTerminationStrategy: PID 1541 died... 14:31:11.448237 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1541): Terminated: ok {rc=0} 14:31:11.535630 bus /sierra_3: Setting Powered False 14:31:12.632074 bus /sierra_3: Setting Powered False 14:31:13.747544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 nitb_ussd:oc2g --------------------------------------------------------------------- 14:31:14.964368 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:31:14.968288 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 14:31:14.989701 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 14:31:14.996724 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 14:31:15.031897 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 14:31:15.053161 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 14:31:15.060031 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 14:31:15.580916 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2406 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 14:31:15.586077 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 14:31:15.597173 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 14:31:15.631998 tst assert_extension.py: using LAC 41545 14:31:15.759356 tst assert_extension.py: using RAC 235 14:31:15.902547 tst assert_extension.py: using CellId 41545 14:31:16.023146 tst assert_extension.py: using BVCI 41546 14:31:16.166802 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 14:31:16.324939 tst assert_extension.py:10: start nitb and bts... 14:31:16.605843 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:31:17.283777 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1547): Launched 14:31:17.589064 run osmo-nitb_10.42.42.2(pid=1548): Launched 14:31:17.757334 run osmo-nitb_10.42.42.2(pid=1548): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1548)] 14:31:17.893900 run osmo-nitb_10.42.42.2(pid=1548): stdout: | (launched: 2022-12-14_14:31:17.533468) 14:31:18.031532 run osmo-nitb_10.42.42.2(pid=1548): stderr: | (launched: 2022-12-14_14:31:17.578145) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:31:18.169495 run osmo-nitb_10.42.42.2(pid=1548): stdout: | (launched: 2022-12-14_14:31:17.533468) 14:31:18.301531 run osmo-nitb_10.42.42.2(pid=1548): stderr: | (launched: 2022-12-14_14:31:17.578145) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1548): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1548) [trial-2406↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1548)] 14:31:18.703892 tst osmo-nitb_10.42.42.2(pid=1548): stdout: | (launched: 2022-12-14_14:31:17.533468) 14:31:18.825586 tst osmo-nitb_10.42.42.2(pid=1548): stderr: | (launched: 2022-12-14_14:31:17.578145) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:31:18.969382 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1548): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1548) [trial-2406↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1548)] [trial-2406↪nitb_ussd:oc2g↪assert_extension.py:12] 14:31:18.977854 tst assert_extension.py:12: Test FAILED (3.4 sec) 14:31:18.984631 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1547): Terminating (SIGTERM) 14:31:19.195171 --- ParallelTerminationStrategy: PID 1547 died... 14:31:19.215977 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1547): Terminated: ok {rc=0} 14:31:19.303837 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 ussd:oc2g --------------------------------------------------------------------- 14:31:20.469088 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:31:20.472748 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 14:31:20.493322 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 14:31:20.521462 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 14:31:20.560192 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 14:31:20.582971 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 14:31:20.610847 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 14:31:21.131836 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2406 ussd:oc2g assert_extension.py ---------------------------------------------- 14:31:21.137644 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 14:31:21.148419 tst ussd:oc2g: Using 1 x bts (candidates: 1) 14:31:21.182539 tst assert_extension.py: using LAC 41546 14:31:21.308867 tst assert_extension.py: using RAC 236 14:31:21.435055 tst assert_extension.py: using CellId 41546 14:31:21.560639 tst assert_extension.py: using BVCI 41547 14:31:21.677769 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 14:31:21.688817 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 14:31:21.699685 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 14:31:21.710532 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 14:31:21.721391 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 14:31:21.732215 tst ussd:oc2g: Using 1 x modem (candidates: 1) 14:31:21.846960 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:31:22.313732 run create_hlr_db(pid=1552): Launched 14:31:22.429726 bus /sierra_2: Setting Powered False 14:31:23.489892 run create_hlr_db(pid=1552): Terminated: ok {rc=0} 14:31:23.933749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1554): Launched 14:31:24.257624 run osmo-hlr_10.42.42.2(pid=1555): Launched 14:31:24.384160 run osmo-stp_10.42.42.5: Starting osmo-stp 14:31:24.949140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1557): Launched 14:31:25.274418 run osmo-stp_10.42.42.5(pid=1558): Launched 14:31:25.400285 run osmo-msc_10.42.42.6: Starting osmo-msc 14:31:25.986797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1560): Launched 14:31:26.311507 run osmo-msc_10.42.42.6(pid=1561): Launched 14:31:26.494146 run osmo-stp_10.42.42.5(pid=1558): ERR: Terminated: ERROR {rc=1} [trial-2406↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1558)] 14:31:26.630413 run osmo-stp_10.42.42.5(pid=1558): stdout: | (launched: 2022-12-14_14:31:25.214000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:26.767588 run osmo-stp_10.42.42.5(pid=1558): stderr: | 20221214143125408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143125408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143125409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143125409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143125409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143125410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143125410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:26.903942 run osmo-stp_10.42.42.5(pid=1558): stdout: | (launched: 2022-12-14_14:31:25.214000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:27.032799 run osmo-stp_10.42.42.5(pid=1558): stderr: | 20221214143125408 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143125408 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143125409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143125409 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143125409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143125410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143125410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:27.186718 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1558): Process ended prematurely: osmo-stp_10.42.42.5(pid=1558) [trial-2406↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1558)] [trial-2406↪ussd:oc2g↪assert_extension.py:17] 14:31:27.195627 tst assert_extension.py:17: Test FAILED (6.1 sec) 14:31:27.223050 run osmo-hlr_10.42.42.2(pid=1555): ERR: Terminated: ERROR {rc=237} [trial-2406↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1555)] 14:31:27.273600 run osmo-hlr_10.42.42.2(pid=1555): stdout: | (launched: 2022-12-14_14:31:24.198356) 14:31:27.325550 run osmo-hlr_10.42.42.2(pid=1555): stderr: | 20221214143124399 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143124399 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143124399 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143124399 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143124399 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143124399 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143124416 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143124426 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143124426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143124426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:31:27.397433 run osmo-msc_10.42.42.6(pid=1561): ERR: Terminated: ERROR {rc=2} [trial-2406↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1561)] 14:31:27.447257 run osmo-msc_10.42.42.6(pid=1561): stdout: | (launched: 2022-12-14_14:31:26.251983) 14:31:27.498984 run osmo-msc_10.42.42.6(pid=1561): stderr: | 20221214143126573 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143126573 DLGLOBAL DEBUG validating counter group 0x7ff3853c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143126574 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143126574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143126574 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143126574 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143126576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143126576 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143126576 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143126576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:31:27.550813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1554): Terminating (SIGTERM) 14:31:27.592312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1557): Terminating (SIGTERM) 14:31:27.633815 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1560): Terminating (SIGTERM) 14:31:27.675738 --- ParallelTerminationStrategy: PID 1554 died... 14:31:27.695723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1554): Terminated: ok {rc=0} 14:31:27.741659 --- ParallelTerminationStrategy: PID 1557 died... 14:31:27.761146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1557): Terminated: ok {rc=0} 14:31:27.807048 --- ParallelTerminationStrategy: PID 1560 died... 14:31:27.826430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1560): Terminated: ok {rc=0} 14:31:27.913448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 14:31:29.108878 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:31:29.115760 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 14:31:29.137086 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 14:31:29.165703 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 14:31:29.219405 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 14:31:29.240594 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 14:31:29.267805 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 14:31:29.818096 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 14:31:29.872210 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:29.883674 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:31:29.940776 tst mo_mt_call.py: using LAC 41547 14:31:30.070373 tst mo_mt_call.py: using RAC 237 14:31:30.203130 tst mo_mt_call.py: using CellId 41547 14:31:30.331935 tst mo_mt_call.py: using BVCI 41548 14:31:30.452188 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:30.463866 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:30.475178 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:30.486484 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:30.497872 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:30.509329 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:31:30.628195 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:31:30.749510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:31:31.273039 run create_hlr_db(pid=1566): Launched 14:31:31.441510 bus /sierra_2: Setting Powered False 14:31:32.506714 run create_hlr_db(pid=1566): Terminated: ok {rc=0} 14:31:32.946463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1568): Launched 14:31:33.255158 run osmo-hlr_10.42.42.2(pid=1569): Launched 14:31:33.373477 run osmo-stp_10.42.42.5: Starting osmo-stp 14:31:33.901417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1571): Launched 14:31:34.209948 run osmo-stp_10.42.42.5(pid=1572): Launched 14:31:34.328208 run osmo-msc_10.42.42.6: Starting osmo-msc 14:31:34.885143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1574): Launched 14:31:35.193444 run osmo-msc_10.42.42.6(pid=1575): Launched 14:31:35.366476 run osmo-stp_10.42.42.5(pid=1572): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1572)] 14:31:35.497915 run osmo-stp_10.42.42.5(pid=1572): stdout: | (launched: 2022-12-14_14:31:34.153072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:35.628448 run osmo-stp_10.42.42.5(pid=1572): stderr: | 20221214143134325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143134326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143134326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143134326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143134327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143134327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143134327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:35.756922 run osmo-stp_10.42.42.5(pid=1572): stdout: | (launched: 2022-12-14_14:31:34.153072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:35.878990 run osmo-stp_10.42.42.5(pid=1572): stderr: | 20221214143134325 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143134326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143134326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143134326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143134327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143134327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143134327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:36.025418 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1572): Process ended prematurely: osmo-stp_10.42.42.5(pid=1572) [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1572)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 14:31:36.034258 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 14:31:36.060825 run osmo-hlr_10.42.42.2(pid=1569): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1569)] 14:31:36.109549 run osmo-hlr_10.42.42.2(pid=1569): stdout: | (launched: 2022-12-14_14:31:33.198242) 14:31:36.159216 run osmo-hlr_10.42.42.2(pid=1569): stderr: | 20221214143133375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143133375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143133375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143133375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143133375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143133375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143133410 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143133420 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143133420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143133420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:31:36.228861 run osmo-msc_10.42.42.6(pid=1575): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1575)] 14:31:36.276600 run osmo-msc_10.42.42.6(pid=1575): stdout: | (launched: 2022-12-14_14:31:35.136572) 14:31:36.326466 run osmo-msc_10.42.42.6(pid=1575): stderr: | 20221214143135409 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143135409 DLGLOBAL DEBUG validating counter group 0x7f523aca2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143135409 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143135409 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143135410 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143135410 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143135413 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143135414 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143135414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143135414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:31:36.376710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1568): Terminating (SIGTERM) 14:31:36.417230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1571): Terminating (SIGTERM) 14:31:36.457771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1574): Terminating (SIGTERM) 14:31:36.498290 --- ParallelTerminationStrategy: PID 1568 died... 14:31:36.517885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1568): Terminated: ok {rc=0} 14:31:36.562625 --- ParallelTerminationStrategy: PID 1571 died... 14:31:36.581874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1571): Terminated: ok {rc=0} 14:31:36.626745 --- ParallelTerminationStrategy: PID 1574 died... 14:31:36.646006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1574): Terminated: ok {rc=0} 14:31:36.734080 bus /sierra_3: Setting Powered False 14:31:37.833942 bus /sierra_3: Setting Powered False 14:31:38.947321 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 14:31:40.097878 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:40.110464 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:31:40.169496 tst mo_mt_call_osmux.py: using LAC 41548 14:31:40.300471 tst mo_mt_call_osmux.py: using RAC 238 14:31:40.429867 tst mo_mt_call_osmux.py: using CellId 41548 14:31:40.553803 tst mo_mt_call_osmux.py: using BVCI 41549 14:31:40.675782 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:40.687538 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:40.699174 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:40.710713 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:40.722241 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:31:40.733837 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:31:40.850934 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:31:40.971676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:31:41.486094 run create_hlr_db(pid=1577): Launched 14:31:41.620001 bus /sierra_2: Setting Powered False 14:31:42.684515 run create_hlr_db(pid=1577): Terminated: ok {rc=0} 14:31:43.125470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1579): Launched 14:31:43.432684 run osmo-hlr_10.42.42.2(pid=1580): Launched 14:31:43.551526 run osmo-stp_10.42.42.5: Starting osmo-stp 14:31:44.097302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1582): Launched 14:31:44.405269 run osmo-stp_10.42.42.5(pid=1583): Launched 14:31:44.523911 run osmo-msc_10.42.42.6: Starting osmo-msc 14:31:45.081303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1585): Launched 14:31:45.389060 run osmo-msc_10.42.42.6(pid=1586): Launched 14:31:45.563090 run osmo-stp_10.42.42.5(pid=1583): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1583)] 14:31:45.694135 run osmo-stp_10.42.42.5(pid=1583): stdout: | (launched: 2022-12-14_14:31:44.348606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:45.826613 run osmo-stp_10.42.42.5(pid=1583): stderr: | 20221214143144521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143144521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143144521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143144521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143144522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143144522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143144522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:45.981338 run osmo-stp_10.42.42.5(pid=1583): stdout: | (launched: 2022-12-14_14:31:44.348606) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:46.106605 run osmo-stp_10.42.42.5(pid=1583): stderr: | 20221214143144521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143144521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143144521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143144521 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143144522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143144522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143144522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:46.257354 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1583): Process ended prematurely: osmo-stp_10.42.42.5(pid=1583) [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1583)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 14:31:46.267521 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:31:46.295467 run osmo-hlr_10.42.42.2(pid=1580): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1580)] 14:31:46.347088 run osmo-hlr_10.42.42.2(pid=1580): stdout: | (launched: 2022-12-14_14:31:43.375929) 14:31:46.399946 run osmo-hlr_10.42.42.2(pid=1580): stderr: | 20221214143143553 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143143553 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143143553 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143143553 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143143553 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143143553 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143143566 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143143574 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143143574 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143143574 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:31:46.471933 run osmo-msc_10.42.42.6(pid=1586): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1586)] 14:31:46.521365 run osmo-msc_10.42.42.6(pid=1586): stdout: | (launched: 2022-12-14_14:31:45.332220) 14:31:46.574274 run osmo-msc_10.42.42.6(pid=1586): stderr: | 20221214143145603 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143145604 DLGLOBAL DEBUG validating counter group 0x7fb8127e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143145604 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143145604 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143145604 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143145604 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143145606 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143145606 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143145606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143145606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:31:46.627237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1579): Terminating (SIGTERM) 14:31:46.669288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1582): Terminating (SIGTERM) 14:31:46.712767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1585): Terminating (SIGTERM) 14:31:46.756198 --- ParallelTerminationStrategy: PID 1579 died... 14:31:46.777483 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1579): Terminated: ok {rc=0} 14:31:46.825443 --- ParallelTerminationStrategy: PID 1582 died... 14:31:46.845810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1582): Terminated: ok {rc=0} 14:31:46.892577 --- ParallelTerminationStrategy: PID 1585 died... 14:31:46.913329 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1585): Terminated: ok {rc=0} 14:31:47.002321 bus /sierra_3: Setting Powered False 14:31:48.098783 bus /sierra_3: Setting Powered False 14:31:49.211500 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 14:31:50.446912 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:31:50.453409 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 14:31:50.473704 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 14:31:50.500871 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 14:31:50.552243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 14:31:50.572693 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 14:31:50.599137 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 14:31:51.150336 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 14:31:51.200295 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:31:51.211754 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:31:51.268876 tst mo_mt_call.py: using LAC 41549 14:31:51.401535 tst mo_mt_call.py: using RAC 239 14:31:51.532597 tst mo_mt_call.py: using CellId 41549 14:31:51.663109 tst mo_mt_call.py: using BVCI 41550 14:31:51.785055 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:31:51.796795 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:31:51.808286 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:31:51.819721 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:31:51.831428 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:31:51.842935 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:31:51.959737 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:31:52.078474 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:31:52.593148 run create_hlr_db(pid=1591): Launched 14:31:52.728502 bus /sierra_2: Setting Powered False 14:31:53.793606 run create_hlr_db(pid=1591): Terminated: ok {rc=0} 14:31:54.236750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1593): Launched 14:31:54.547137 run osmo-hlr_10.42.42.2(pid=1594): Launched 14:31:54.666231 run osmo-stp_10.42.42.5: Starting osmo-stp 14:31:55.196384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1596): Launched 14:31:55.505539 run osmo-stp_10.42.42.5(pid=1597): Launched 14:31:55.623639 run osmo-msc_10.42.42.6: Starting osmo-msc 14:31:56.181530 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1599): Launched 14:31:56.490440 run osmo-msc_10.42.42.6(pid=1600): Launched 14:31:56.667655 run osmo-stp_10.42.42.5(pid=1597): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1597)] 14:31:56.798461 run osmo-stp_10.42.42.5(pid=1597): stdout: | (launched: 2022-12-14_14:31:55.448745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:56.929554 run osmo-stp_10.42.42.5(pid=1597): stderr: | 20221214143155619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143155619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143155619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143155619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143155620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143155620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143155620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:57.058051 run osmo-stp_10.42.42.5(pid=1597): stdout: | (launched: 2022-12-14_14:31:55.448745) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:31:57.179894 run osmo-stp_10.42.42.5(pid=1597): stderr: | 20221214143155619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143155619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143155619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143155619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143155620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143155620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143155620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:31:57.325767 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1597): Process ended prematurely: osmo-stp_10.42.42.5(pid=1597) [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1597)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 14:31:57.334666 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 14:31:57.361363 run osmo-hlr_10.42.42.2(pid=1594): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1594)] 14:31:57.410031 run osmo-hlr_10.42.42.2(pid=1594): stdout: | (launched: 2022-12-14_14:31:54.490054) 14:31:57.459733 run osmo-hlr_10.42.42.2(pid=1594): stderr: | 20221214143154669 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143154669 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143154669 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143154669 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143154669 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143154669 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143154693 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143154702 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143154703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143154703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:31:57.530172 run osmo-msc_10.42.42.6(pid=1600): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1600)] 14:31:57.578127 run osmo-msc_10.42.42.6(pid=1600): stdout: | (launched: 2022-12-14_14:31:56.433321) 14:31:57.628085 run osmo-msc_10.42.42.6(pid=1600): stderr: | 20221214143156707 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143156707 DLGLOBAL DEBUG validating counter group 0x7fc386d48c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143156707 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143156707 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143156707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143156707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143156709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143156709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143156710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143156710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:31:57.678258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1593): Terminating (SIGTERM) 14:31:57.718463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1596): Terminating (SIGTERM) 14:31:57.758635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1599): Terminating (SIGTERM) 14:31:57.799637 --- ParallelTerminationStrategy: PID 1593 died... 14:31:57.819600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1593): Terminated: ok {rc=0} 14:31:57.863758 --- ParallelTerminationStrategy: PID 1596 died... 14:31:57.882449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1596): Terminated: ok {rc=0} 14:31:57.926423 --- ParallelTerminationStrategy: PID 1599 died... 14:31:57.945343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1599): Terminated: ok {rc=0} 14:31:58.031902 bus /sierra_3: Setting Powered False 14:31:59.131195 bus /sierra_3: Setting Powered False 14:32:00.244445 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 14:32:01.395765 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:32:01.409250 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:32:01.470963 tst mo_mt_call_osmux.py: using LAC 41550 14:32:01.602865 tst mo_mt_call_osmux.py: using RAC 240 14:32:01.768397 tst mo_mt_call_osmux.py: using CellId 41550 14:32:01.892267 tst mo_mt_call_osmux.py: using BVCI 41551 14:32:02.007909 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:32:02.020037 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:32:02.032020 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:32:02.044069 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:32:02.057510 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:32:02.071668 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:32:02.193525 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:32:02.319786 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:32:02.835459 run create_hlr_db(pid=1602): Launched 14:32:02.971496 bus /sierra_2: Setting Powered False 14:32:04.036772 run create_hlr_db(pid=1602): Terminated: ok {rc=0} 14:32:04.476442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1604): Launched 14:32:04.785657 run osmo-hlr_10.42.42.2(pid=1605): Launched 14:32:04.903099 run osmo-stp_10.42.42.5: Starting osmo-stp 14:32:05.434354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1607): Launched 14:32:05.744189 run osmo-stp_10.42.42.5(pid=1608): Launched 14:32:05.861843 run osmo-msc_10.42.42.6: Starting osmo-msc 14:32:06.416866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1610): Launched 14:32:06.725260 run osmo-msc_10.42.42.6(pid=1611): Launched 14:32:06.898333 run osmo-stp_10.42.42.5(pid=1608): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1608)] 14:32:07.028043 run osmo-stp_10.42.42.5(pid=1608): stdout: | (launched: 2022-12-14_14:32:05.687515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:07.158139 run osmo-stp_10.42.42.5(pid=1608): stderr: | 20221214143205861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143205861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143205861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143205862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143205862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143205862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143205862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:07.285959 run osmo-stp_10.42.42.5(pid=1608): stdout: | (launched: 2022-12-14_14:32:05.687515) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:07.407584 run osmo-stp_10.42.42.5(pid=1608): stderr: | 20221214143205861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143205861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143205861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143205862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143205862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143205862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143205862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:07.553386 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1608): Process ended prematurely: osmo-stp_10.42.42.5(pid=1608) [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1608)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 14:32:07.562309 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:32:07.588927 run osmo-hlr_10.42.42.2(pid=1605): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1605)] 14:32:07.637378 run osmo-hlr_10.42.42.2(pid=1605): stdout: | (launched: 2022-12-14_14:32:04.728379) 14:32:07.686965 run osmo-hlr_10.42.42.2(pid=1605): stderr: | 20221214143204909 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143204909 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143204909 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143204909 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143204909 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143204909 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143204925 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143204936 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143204936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143204936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:32:07.756786 run osmo-msc_10.42.42.6(pid=1611): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1611)] 14:32:07.804351 run osmo-msc_10.42.42.6(pid=1611): stdout: | (launched: 2022-12-14_14:32:06.668255) 14:32:07.853910 run osmo-msc_10.42.42.6(pid=1611): stderr: | 20221214143206938 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143206938 DLGLOBAL DEBUG validating counter group 0x7f279e1a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143206938 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143206938 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143206938 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143206939 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143206940 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143206941 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143206941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143206941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:32:07.903802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1604): Terminating (SIGTERM) 14:32:07.943870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1607): Terminating (SIGTERM) 14:32:07.983808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1610): Terminating (SIGTERM) 14:32:08.023897 --- ParallelTerminationStrategy: PID 1604 died... 14:32:08.043503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1604): Terminated: ok {rc=0} 14:32:08.087865 --- ParallelTerminationStrategy: PID 1607 died... 14:32:08.106928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1607): Terminated: ok {rc=0} 14:32:08.150928 --- ParallelTerminationStrategy: PID 1610 died... 14:32:08.169897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1610): Terminated: ok {rc=0} 14:32:08.253296 bus /sierra_3: Setting Powered False 14:32:09.351470 bus /sierra_3: Setting Powered False 14:32:10.468223 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 14:32:11.698993 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:32:11.705367 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 14:32:11.725837 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 14:32:11.754157 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 14:32:11.805998 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 14:32:11.827353 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 14:32:11.854659 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 14:32:12.406672 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 14:32:12.459526 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:12.471130 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:32:12.527631 tst mo_mt_call.py: using LAC 41551 14:32:12.660173 tst mo_mt_call.py: using RAC 241 14:32:12.793928 tst mo_mt_call.py: using CellId 41551 14:32:12.923282 tst mo_mt_call.py: using BVCI 41552 14:32:13.043523 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:13.055175 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:13.066543 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:13.077978 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:13.089442 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:13.100918 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:32:13.218975 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:32:13.339764 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:32:13.818987 run create_hlr_db(pid=1616): Launched 14:32:13.937732 bus /sierra_2: Setting Powered False 14:32:14.998798 run create_hlr_db(pid=1616): Terminated: ok {rc=0} 14:32:15.450312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1618): Launched 14:32:15.781374 run osmo-hlr_10.42.42.2(pid=1619): Launched 14:32:16.044519 run osmo-stp_10.42.42.5: Starting osmo-stp 14:32:16.705791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1621): Launched 14:32:17.035727 run osmo-stp_10.42.42.5(pid=1622): Launched 14:32:17.330738 run osmo-msc_10.42.42.6: Starting osmo-msc 14:32:17.927490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1624): Launched 14:32:18.259561 run osmo-msc_10.42.42.6(pid=1625): Launched 14:32:18.443563 run osmo-stp_10.42.42.5(pid=1622): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1622)] 14:32:18.582115 run osmo-stp_10.42.42.5(pid=1622): stdout: | (launched: 2022-12-14_14:32:16.978250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:18.721343 run osmo-stp_10.42.42.5(pid=1622): stderr: | 20221214143217173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143217173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143217173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143217174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143217176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143217176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143217176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:18.859694 run osmo-stp_10.42.42.5(pid=1622): stdout: | (launched: 2022-12-14_14:32:16.978250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:18.991295 run osmo-stp_10.42.42.5(pid=1622): stderr: | 20221214143217173 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143217173 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143217173 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143217174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143217176 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143217176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143217176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:19.149206 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1622): Process ended prematurely: osmo-stp_10.42.42.5(pid=1622) [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1622)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 14:32:19.158997 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 14:32:19.187292 run osmo-hlr_10.42.42.2(pid=1619): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1619)] 14:32:19.238050 run osmo-hlr_10.42.42.2(pid=1619): stdout: | (launched: 2022-12-14_14:32:15.720921) 14:32:19.290221 run osmo-hlr_10.42.42.2(pid=1619): stderr: | 20221214143215980 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143215980 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143215980 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143215980 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143215980 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143215980 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143215995 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143216007 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143216007 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143216008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:32:19.363085 run osmo-msc_10.42.42.6(pid=1625): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1625)] 14:32:19.413579 run osmo-msc_10.42.42.6(pid=1625): stdout: | (launched: 2022-12-14_14:32:18.198420) 14:32:19.465338 run osmo-msc_10.42.42.6(pid=1625): stderr: | 20221214143218523 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143218523 DLGLOBAL DEBUG validating counter group 0x7f9c17237c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143218523 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143218523 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143218523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143218523 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143218525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143218525 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143218526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143218526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:32:19.517670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1618): Terminating (SIGTERM) 14:32:19.559394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1621): Terminating (SIGTERM) 14:32:19.601831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1624): Terminating (SIGTERM) 14:32:19.644458 --- ParallelTerminationStrategy: PID 1618 died... 14:32:19.664485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1618): Terminated: ok {rc=0} 14:32:19.710512 --- ParallelTerminationStrategy: PID 1621 died... 14:32:19.730009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1621): Terminated: ok {rc=0} 14:32:19.775667 --- ParallelTerminationStrategy: PID 1624 died... 14:32:19.795298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1624): Terminated: ok {rc=0} 14:32:19.882725 bus /sierra_3: Setting Powered False 14:32:20.981917 bus /sierra_3: Setting Powered False 14:32:22.098143 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 14:32:23.247995 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:23.260389 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:32:23.319905 tst mo_mt_call_osmux.py: using LAC 41552 14:32:23.450424 tst mo_mt_call_osmux.py: using RAC 242 14:32:23.578528 tst mo_mt_call_osmux.py: using CellId 41552 14:32:23.699808 tst mo_mt_call_osmux.py: using BVCI 41553 14:32:23.812772 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:23.824042 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:23.835078 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:23.846046 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:23.857765 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:32:23.869243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:32:23.985349 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:32:24.107674 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:32:24.620182 run create_hlr_db(pid=1627): Launched 14:32:24.752893 bus /sierra_2: Setting Powered False 14:32:25.814239 run create_hlr_db(pid=1627): Terminated: ok {rc=0} 14:32:26.265899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1629): Launched 14:32:26.596875 run osmo-hlr_10.42.42.2(pid=1630): Launched 14:32:26.725619 run osmo-stp_10.42.42.5: Starting osmo-stp 14:32:27.298757 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1632): Launched 14:32:27.629633 run osmo-stp_10.42.42.5(pid=1633): Launched 14:32:27.756743 run osmo-msc_10.42.42.6: Starting osmo-msc 14:32:28.355033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1635): Launched 14:32:28.687192 run osmo-msc_10.42.42.6(pid=1636): Launched 14:32:28.873242 run osmo-stp_10.42.42.5(pid=1633): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1633)] 14:32:29.012590 run osmo-stp_10.42.42.5(pid=1633): stdout: | (launched: 2022-12-14_14:32:27.568908) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:29.152673 run osmo-stp_10.42.42.5(pid=1633): stderr: | 20221214143227765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143227765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143227765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143227766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143227768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143227768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143227768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:29.290278 run osmo-stp_10.42.42.5(pid=1633): stdout: | (launched: 2022-12-14_14:32:27.568908) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:29.421185 run osmo-stp_10.42.42.5(pid=1633): stderr: | 20221214143227765 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143227765 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143227765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143227766 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143227768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143227768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143227768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:29.577433 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1633): Process ended prematurely: osmo-stp_10.42.42.5(pid=1633) [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1633)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 14:32:29.587001 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 14:32:29.615002 run osmo-hlr_10.42.42.2(pid=1630): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1630)] 14:32:29.665185 run osmo-hlr_10.42.42.2(pid=1630): stdout: | (launched: 2022-12-14_14:32:26.536149) 14:32:29.717248 run osmo-hlr_10.42.42.2(pid=1630): stderr: | 20221214143226739 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143226739 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143226739 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143226739 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143226740 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143226740 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143226752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143226762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143226762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143226762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:32:29.789457 run osmo-msc_10.42.42.6(pid=1636): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1636)] 14:32:29.839382 run osmo-msc_10.42.42.6(pid=1636): stdout: | (launched: 2022-12-14_14:32:28.626297) 14:32:29.891125 run osmo-msc_10.42.42.6(pid=1636): stderr: | 20221214143228947 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143228948 DLGLOBAL DEBUG validating counter group 0x7f37b3030c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143228948 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143228948 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143228948 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143228948 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143228950 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143228950 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143228950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143228950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:32:29.943515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1629): Terminating (SIGTERM) 14:32:29.985247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1632): Terminating (SIGTERM) 14:32:30.026866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1635): Terminating (SIGTERM) 14:32:30.068538 --- ParallelTerminationStrategy: PID 1629 died... 14:32:30.088604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1629): Terminated: ok {rc=0} 14:32:30.134922 --- ParallelTerminationStrategy: PID 1632 died... 14:32:30.154505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1632): Terminated: ok {rc=0} 14:32:30.200350 --- ParallelTerminationStrategy: PID 1635 died... 14:32:30.219975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1635): Terminated: ok {rc=0} 14:32:30.308016 bus /sierra_3: Setting Powered False 14:32:31.405250 bus /sierra_3: Setting Powered False 14:32:32.522541 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 14:32:33.757049 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:32:33.763553 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 14:32:33.783955 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 14:32:33.811700 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 14:32:33.863109 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 14:32:33.883692 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 14:32:33.910446 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 14:32:34.460276 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 14:32:34.510573 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:34.521825 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:32:34.578359 tst mo_mt_call.py: using LAC 41553 14:32:34.700252 tst mo_mt_call.py: using RAC 243 14:32:34.822255 tst mo_mt_call.py: using CellId 41553 14:32:34.944573 tst mo_mt_call.py: using BVCI 41554 14:32:35.055941 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:35.067158 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:35.078189 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:35.089232 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:35.100457 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:35.111874 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:32:35.231890 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:32:35.353706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:32:35.830938 run create_hlr_db(pid=1641): Launched 14:32:35.948844 bus /sierra_2: Setting Powered False 14:32:37.010124 run create_hlr_db(pid=1641): Terminated: ok {rc=0} 14:32:37.462674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1643): Launched 14:32:37.796083 run osmo-hlr_10.42.42.2(pid=1644): Launched 14:32:37.923032 run osmo-stp_10.42.42.5: Starting osmo-stp 14:32:38.492305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1646): Launched 14:32:38.824521 run osmo-stp_10.42.42.5(pid=1647): Launched 14:32:38.952674 run osmo-msc_10.42.42.6: Starting osmo-msc 14:32:39.550787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1649): Launched 14:32:39.883104 run osmo-msc_10.42.42.6(pid=1650): Launched 14:32:40.069218 run osmo-stp_10.42.42.5(pid=1647): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1647)] 14:32:40.208080 run osmo-stp_10.42.42.5(pid=1647): stdout: | (launched: 2022-12-14_14:32:38.763883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:40.347589 run osmo-stp_10.42.42.5(pid=1647): stderr: | 20221214143238960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143238960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143238960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143238961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143238961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143238961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143238961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:40.486049 run osmo-stp_10.42.42.5(pid=1647): stdout: | (launched: 2022-12-14_14:32:38.763883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:40.617171 run osmo-stp_10.42.42.5(pid=1647): stderr: | 20221214143238960 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143238960 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143238960 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143238961 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143238961 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143238961 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143238961 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:40.773635 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1647): Process ended prematurely: osmo-stp_10.42.42.5(pid=1647) [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1647)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 14:32:40.783266 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:32:40.811341 run osmo-hlr_10.42.42.2(pid=1644): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1644)] 14:32:40.862317 run osmo-hlr_10.42.42.2(pid=1644): stdout: | (launched: 2022-12-14_14:32:37.735603) 14:32:40.915165 run osmo-hlr_10.42.42.2(pid=1644): stderr: | 20221214143237935 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143237935 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143237935 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143237935 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143237935 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143237935 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143237946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143237955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143237955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143237955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:32:40.988365 run osmo-msc_10.42.42.6(pid=1650): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1650)] 14:32:41.039218 run osmo-msc_10.42.42.6(pid=1650): stdout: | (launched: 2022-12-14_14:32:39.822603) 14:32:41.091458 run osmo-msc_10.42.42.6(pid=1650): stderr: | 20221214143240146 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143240146 DLGLOBAL DEBUG validating counter group 0x7fe705c9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143240146 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143240146 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143240146 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143240146 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143240150 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143240150 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143240150 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143240150 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:32:41.144210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1643): Terminating (SIGTERM) 14:32:41.186325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1646): Terminating (SIGTERM) 14:32:41.228650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1649): Terminating (SIGTERM) 14:32:41.271566 --- ParallelTerminationStrategy: PID 1643 died... 14:32:41.291809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1643): Terminated: ok {rc=0} 14:32:41.338708 --- ParallelTerminationStrategy: PID 1646 died... 14:32:41.358453 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1646): Terminated: ok {rc=0} 14:32:41.404819 --- ParallelTerminationStrategy: PID 1649 died... 14:32:41.425022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1649): Terminated: ok {rc=0} 14:32:41.512850 bus /sierra_3: Setting Powered False 14:32:42.613015 bus /sierra_3: Setting Powered False 14:32:43.729905 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 14:32:44.879215 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:44.891689 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:32:44.950688 tst mo_mt_call_osmux.py: using LAC 41554 14:32:45.080092 tst mo_mt_call_osmux.py: using RAC 244 14:32:45.200302 tst mo_mt_call_osmux.py: using CellId 41554 14:32:45.332787 tst mo_mt_call_osmux.py: using BVCI 41555 14:32:45.453943 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:45.465746 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:45.477317 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:45.488761 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:45.500424 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:32:45.511870 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:32:45.629377 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:32:45.751225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:32:46.285164 run create_hlr_db(pid=1652): Launched 14:32:46.478848 bus /sierra_2: Setting Powered False 14:32:47.540177 run create_hlr_db(pid=1652): Terminated: ok {rc=0} 14:32:47.993691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1654): Launched 14:32:48.326662 run osmo-hlr_10.42.42.2(pid=1655): Launched 14:32:48.454143 run osmo-stp_10.42.42.5: Starting osmo-stp 14:32:49.025797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1657): Launched 14:32:49.357497 run osmo-stp_10.42.42.5(pid=1658): Launched 14:32:49.482873 run osmo-msc_10.42.42.6: Starting osmo-msc 14:32:50.080399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1660): Launched 14:32:50.410767 run osmo-msc_10.42.42.6(pid=1661): Launched 14:32:50.597275 run osmo-stp_10.42.42.5(pid=1658): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1658)] 14:32:50.735814 run osmo-stp_10.42.42.5(pid=1658): stdout: | (launched: 2022-12-14_14:32:49.296347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:50.874706 run osmo-stp_10.42.42.5(pid=1658): stderr: | 20221214143249494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143249494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143249494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143249495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143249495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143249495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143249495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:51.012919 run osmo-stp_10.42.42.5(pid=1658): stdout: | (launched: 2022-12-14_14:32:49.296347) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:32:51.143451 run osmo-stp_10.42.42.5(pid=1658): stderr: | 20221214143249494 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143249494 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143249494 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143249495 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143249495 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143249495 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143249495 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:32:51.299674 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1658): Process ended prematurely: osmo-stp_10.42.42.5(pid=1658) [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1658)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 14:32:51.309816 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 14:32:51.338108 run osmo-hlr_10.42.42.2(pid=1655): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1655)] 14:32:51.388217 run osmo-hlr_10.42.42.2(pid=1655): stdout: | (launched: 2022-12-14_14:32:48.265866) 14:32:51.440217 run osmo-hlr_10.42.42.2(pid=1655): stderr: | 20221214143248465 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143248465 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143248465 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143248465 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143248465 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143248465 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143248477 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143248486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143248486 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143248487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:32:51.512401 run osmo-msc_10.42.42.6(pid=1661): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1661)] 14:32:51.562462 run osmo-msc_10.42.42.6(pid=1661): stdout: | (launched: 2022-12-14_14:32:50.350216) 14:32:51.614051 run osmo-msc_10.42.42.6(pid=1661): stderr: | 20221214143250676 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143250676 DLGLOBAL DEBUG validating counter group 0x7f4601e8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143250676 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143250676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143250676 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143250676 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143250680 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143250680 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143250680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143250680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:32:51.665833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1654): Terminating (SIGTERM) 14:32:51.707477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1657): Terminating (SIGTERM) 14:32:51.749779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1660): Terminating (SIGTERM) 14:32:51.791789 --- ParallelTerminationStrategy: PID 1654 died... 14:32:51.811969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1654): Terminated: ok {rc=0} 14:32:51.858167 --- ParallelTerminationStrategy: PID 1657 died... 14:32:51.877778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1657): Terminated: ok {rc=0} 14:32:51.924677 --- ParallelTerminationStrategy: PID 1660 died... 14:32:51.944764 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1660): Terminated: ok {rc=0} 14:32:52.032588 bus /sierra_3: Setting Powered False 14:32:53.129510 bus /sierra_3: Setting Powered False 14:32:54.245147 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 14:32:55.480249 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:32:55.486606 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 14:32:55.507013 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 14:32:55.533522 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 14:32:55.587508 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 14:32:55.609068 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 14:32:55.635619 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 14:32:56.182167 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 14:32:56.231655 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:32:56.242913 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:32:56.298634 tst mo_mt_call.py: using LAC 41555 14:32:56.418939 tst mo_mt_call.py: using RAC 245 14:32:56.538782 tst mo_mt_call.py: using CellId 41555 14:32:56.659253 tst mo_mt_call.py: using BVCI 41556 14:32:56.772180 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:32:56.783259 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:32:56.794265 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:32:56.805169 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:32:56.816534 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:32:56.827914 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:32:56.947855 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:32:57.068597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:32:57.581870 run create_hlr_db(pid=1667): Launched 14:32:57.716254 bus /sierra_2: Setting Powered False 14:32:58.781644 run create_hlr_db(pid=1667): Terminated: ok {rc=0} 14:32:59.221374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1669): Launched 14:32:59.530244 run osmo-hlr_10.42.42.2(pid=1670): Launched 14:32:59.648416 run osmo-stp_10.42.42.5: Starting osmo-stp 14:33:00.199350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1672): Launched 14:33:00.507972 run osmo-stp_10.42.42.5(pid=1673): Launched 14:33:00.626591 run osmo-msc_10.42.42.6: Starting osmo-msc 14:33:01.239542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1675): Launched 14:33:01.656838 run osmo-msc_10.42.42.6(pid=1677): Launched 14:33:01.999026 run osmo-stp_10.42.42.5(pid=1673): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1673)] 14:33:02.171380 run osmo-stp_10.42.42.5(pid=1673): stdout: | (launched: 2022-12-14_14:33:00.451155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:02.384173 run osmo-stp_10.42.42.5(pid=1673): stderr: | 20221214143300623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143300623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143300624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143300624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143300624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143300625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143300625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:02.522870 run osmo-stp_10.42.42.5(pid=1673): stdout: | (launched: 2022-12-14_14:33:00.451155) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:02.653895 run osmo-stp_10.42.42.5(pid=1673): stderr: | 20221214143300623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143300623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143300624 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143300624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143300624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143300625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143300625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:02.811552 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1673): Process ended prematurely: osmo-stp_10.42.42.5(pid=1673) [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1673)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 14:33:02.821265 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 14:33:02.849320 run osmo-hlr_10.42.42.2(pid=1670): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1670)] 14:33:02.899895 run osmo-hlr_10.42.42.2(pid=1670): stdout: | (launched: 2022-12-14_14:32:59.473722) 14:33:02.952282 run osmo-hlr_10.42.42.2(pid=1670): stderr: | 20221214143259649 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143259649 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143259649 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143259649 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143259649 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143259649 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143259661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143259670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143259670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143259670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:33:03.025317 run osmo-msc_10.42.42.6(pid=1677): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1677)] 14:33:03.075808 run osmo-msc_10.42.42.6(pid=1677): stdout: | (launched: 2022-12-14_14:33:01.596329) 14:33:03.127706 run osmo-msc_10.42.42.6(pid=1677): stderr: | 20221214143302100 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143302101 DLGLOBAL DEBUG validating counter group 0x7f62618ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143302101 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143302101 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143302101 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143302101 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143302103 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143302103 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143302103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143302103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:33:03.180079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1669): Terminating (SIGTERM) 14:33:03.222292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1672): Terminating (SIGTERM) 14:33:03.264812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1675): Terminating (SIGTERM) 14:33:03.307416 --- ParallelTerminationStrategy: PID 1669 died... 14:33:03.327614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1669): Terminated: ok {rc=0} 14:33:03.374408 --- ParallelTerminationStrategy: PID 1672 died... 14:33:03.394111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1672): Terminated: ok {rc=0} 14:33:03.440890 --- ParallelTerminationStrategy: PID 1675 died... 14:33:03.461241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1675): Terminated: ok {rc=0} 14:33:03.549163 bus /sierra_3: Setting Powered False 14:33:04.647523 bus /sierra_3: Setting Powered False 14:33:05.766615 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 14:33:06.910444 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:33:06.922232 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:33:06.978668 tst mo_mt_call_osmux.py: using LAC 41556 14:33:07.099761 tst mo_mt_call_osmux.py: using RAC 246 14:33:07.221748 tst mo_mt_call_osmux.py: using CellId 41556 14:33:07.350773 tst mo_mt_call_osmux.py: using BVCI 41557 14:33:07.464499 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:33:07.475648 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:33:07.486595 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:33:07.497629 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:33:07.508737 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:33:07.519910 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:33:07.639490 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:33:07.757198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:33:08.234732 run create_hlr_db(pid=1679): Launched 14:33:08.353533 bus /sierra_2: Setting Powered False 14:33:09.414863 run create_hlr_db(pid=1679): Terminated: ok {rc=0} 14:33:09.865957 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1681): Launched 14:33:10.197652 run osmo-hlr_10.42.42.2(pid=1682): Launched 14:33:10.326048 run osmo-stp_10.42.42.5: Starting osmo-stp 14:33:10.899024 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1684): Launched 14:33:11.230883 run osmo-stp_10.42.42.5(pid=1685): Launched 14:33:11.356087 run osmo-msc_10.42.42.6: Starting osmo-msc 14:33:11.954751 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1687): Launched 14:33:12.286152 run osmo-msc_10.42.42.6(pid=1688): Launched 14:33:12.470671 run osmo-stp_10.42.42.5(pid=1685): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1685)] 14:33:12.609797 run osmo-stp_10.42.42.5(pid=1685): stdout: | (launched: 2022-12-14_14:33:11.169885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:12.748780 run osmo-stp_10.42.42.5(pid=1685): stderr: | 20221214143311366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143311366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143311366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143311367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143311367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143311367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143311367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:12.887173 run osmo-stp_10.42.42.5(pid=1685): stdout: | (launched: 2022-12-14_14:33:11.169885) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:13.017821 run osmo-stp_10.42.42.5(pid=1685): stderr: | 20221214143311366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143311366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143311366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143311367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143311367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143311367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143311367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:13.174802 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1685): Process ended prematurely: osmo-stp_10.42.42.5(pid=1685) [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1685)] [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 14:33:13.184308 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:33:13.212142 run osmo-hlr_10.42.42.2(pid=1682): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1682)] 14:33:13.262095 run osmo-hlr_10.42.42.2(pid=1682): stdout: | (launched: 2022-12-14_14:33:10.137317) 14:33:13.313986 run osmo-hlr_10.42.42.2(pid=1682): stderr: | 20221214143310338 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143310338 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143310338 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143310338 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143310338 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143310338 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143310350 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143310360 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143310360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143310360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:33:13.386417 run osmo-msc_10.42.42.6(pid=1688): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1688)] 14:33:13.436555 run osmo-msc_10.42.42.6(pid=1688): stdout: | (launched: 2022-12-14_14:33:12.225160) 14:33:13.488422 run osmo-msc_10.42.42.6(pid=1688): stderr: | 20221214143312551 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143312551 DLGLOBAL DEBUG validating counter group 0x7f4967712c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143312551 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143312551 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143312551 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143312552 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143312553 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143312554 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143312554 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143312554 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:33:13.540653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1681): Terminating (SIGTERM) 14:33:13.582669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1684): Terminating (SIGTERM) 14:33:13.624363 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1687): Terminating (SIGTERM) 14:33:13.666405 --- ParallelTerminationStrategy: PID 1681 died... 14:33:13.686486 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1681): Terminated: ok {rc=0} 14:33:13.732852 --- ParallelTerminationStrategy: PID 1684 died... 14:33:13.752521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1684): Terminated: ok {rc=0} 14:33:13.798777 --- ParallelTerminationStrategy: PID 1687 died... 14:33:13.818407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1687): Terminated: ok {rc=0} 14:33:13.906385 bus /sierra_3: Setting Powered False 14:33:15.004317 bus /sierra_3: Setting Powered False 14:33:16.120437 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:33:17.370900 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:33:17.377840 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:33:17.398957 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 14:33:17.426355 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:33:17.481735 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:33:17.503036 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 14:33:17.530525 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:33:18.078361 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 14:33:18.128252 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:18.139576 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:33:18.195932 tst mo_mt_call.py: using LAC 41557 14:33:18.317121 tst mo_mt_call.py: using RAC 247 14:33:18.438436 tst mo_mt_call.py: using CellId 41557 14:33:18.560442 tst mo_mt_call.py: using BVCI 41558 14:33:18.671226 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:18.682362 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:18.693211 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:18.703967 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:18.714992 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:18.726256 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:33:18.847585 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:33:18.965450 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:33:19.442777 run create_hlr_db(pid=1694): Launched 14:33:19.562888 bus /sierra_2: Setting Powered False 14:33:20.623673 run create_hlr_db(pid=1694): Terminated: ok {rc=0} 14:33:21.074239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1696): Launched 14:33:21.405979 run osmo-hlr_10.42.42.2(pid=1697): Launched 14:33:21.533577 run osmo-stp_10.42.42.5: Starting osmo-stp 14:33:22.103310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1699): Launched 14:33:22.434230 run osmo-stp_10.42.42.5(pid=1700): Launched 14:33:22.561445 run osmo-msc_10.42.42.6: Starting osmo-msc 14:33:23.157581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1702): Launched 14:33:23.489131 run osmo-msc_10.42.42.6(pid=1703): Launched 14:33:23.676115 run osmo-stp_10.42.42.5(pid=1700): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1700)] 14:33:23.814511 run osmo-stp_10.42.42.5(pid=1700): stdout: | (launched: 2022-12-14_14:33:22.373733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:23.954143 run osmo-stp_10.42.42.5(pid=1700): stderr: | 20221214143322568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143322569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143322569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143322569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143322570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143322570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143322570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:24.092191 run osmo-stp_10.42.42.5(pid=1700): stdout: | (launched: 2022-12-14_14:33:22.373733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:24.222866 run osmo-stp_10.42.42.5(pid=1700): stderr: | 20221214143322568 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143322569 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143322569 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143322569 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143322570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143322570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143322570 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:24.379205 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1700): Process ended prematurely: osmo-stp_10.42.42.5(pid=1700) [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1700)] [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 14:33:24.388750 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:33:24.416766 run osmo-hlr_10.42.42.2(pid=1697): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1697)] 14:33:24.467122 run osmo-hlr_10.42.42.2(pid=1697): stdout: | (launched: 2022-12-14_14:33:21.345449) 14:33:24.519071 run osmo-hlr_10.42.42.2(pid=1697): stderr: | 20221214143321544 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143321544 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143321544 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143321544 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143321544 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143321544 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143321557 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143321566 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143321566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143321566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:33:24.591578 run osmo-msc_10.42.42.6(pid=1703): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1703)] 14:33:24.641826 run osmo-msc_10.42.42.6(pid=1703): stdout: | (launched: 2022-12-14_14:33:23.428498) 14:33:24.693876 run osmo-msc_10.42.42.6(pid=1703): stderr: | 20221214143323754 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143323754 DLGLOBAL DEBUG validating counter group 0x7f51b7694c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143323754 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143323754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143323754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143323755 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143323758 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143323759 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143323759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143323759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:33:24.746356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1696): Terminating (SIGTERM) 14:33:24.788305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1699): Terminating (SIGTERM) 14:33:24.830204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1702): Terminating (SIGTERM) 14:33:24.872694 --- ParallelTerminationStrategy: PID 1696 died... 14:33:24.892810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1696): Terminated: ok {rc=0} 14:33:24.939418 --- ParallelTerminationStrategy: PID 1699 died... 14:33:24.959220 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1699): Terminated: ok {rc=0} 14:33:25.005757 --- ParallelTerminationStrategy: PID 1702 died... 14:33:25.025505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1702): Terminated: ok {rc=0} 14:33:25.114833 bus /sierra_3: Setting Powered False 14:33:26.214524 bus /sierra_3: Setting Powered False 14:33:27.330224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 14:33:28.481431 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:28.493879 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:33:28.553615 tst mo_mt_call_osmux.py: using LAC 41558 14:33:28.684920 tst mo_mt_call_osmux.py: using RAC 248 14:33:28.815279 tst mo_mt_call_osmux.py: using CellId 41558 14:33:28.946847 tst mo_mt_call_osmux.py: using BVCI 41559 14:33:29.068199 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:29.080057 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:29.091784 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:29.103435 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:29.115120 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:33:29.126845 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:33:29.244116 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:33:29.364346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:33:29.878518 run create_hlr_db(pid=1705): Launched 14:33:30.013830 bus /sierra_2: Setting Powered False 14:33:31.095950 run create_hlr_db(pid=1705): Terminated: ok {rc=0} 14:33:31.643137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1707): Launched 14:33:31.994081 run osmo-hlr_10.42.42.2(pid=1708): Launched 14:33:32.147341 run osmo-stp_10.42.42.5: Starting osmo-stp 14:33:32.771081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1710): Launched 14:33:33.079652 run osmo-stp_10.42.42.5(pid=1711): Launched 14:33:33.196802 run osmo-msc_10.42.42.6: Starting osmo-msc 14:33:33.756112 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1713): Launched 14:33:34.065452 run osmo-msc_10.42.42.6(pid=1714): Launched 14:33:34.238087 run osmo-stp_10.42.42.5(pid=1711): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1711)] 14:33:34.368682 run osmo-stp_10.42.42.5(pid=1711): stdout: | (launched: 2022-12-14_14:33:33.023172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:34.499243 run osmo-stp_10.42.42.5(pid=1711): stderr: | 20221214143333194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143333194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143333195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143333195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143333197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143333198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143333198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:34.627640 run osmo-stp_10.42.42.5(pid=1711): stdout: | (launched: 2022-12-14_14:33:33.023172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:34.749622 run osmo-stp_10.42.42.5(pid=1711): stderr: | 20221214143333194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143333194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143333195 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143333195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143333197 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143333198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143333198 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:34.895921 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1711): Process ended prematurely: osmo-stp_10.42.42.5(pid=1711) [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1711)] [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 14:33:34.904908 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 14:33:34.931786 run osmo-hlr_10.42.42.2(pid=1708): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1708)] 14:33:34.980447 run osmo-hlr_10.42.42.2(pid=1708): stdout: | (launched: 2022-12-14_14:33:31.932733) 14:33:35.030440 run osmo-hlr_10.42.42.2(pid=1708): stderr: | 20221214143332315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143332315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143332315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143332315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143332315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143332316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143332327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143332344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143332344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143332344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:33:35.100780 run osmo-msc_10.42.42.6(pid=1714): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1714)] 14:33:35.148639 run osmo-msc_10.42.42.6(pid=1714): stdout: | (launched: 2022-12-14_14:33:34.008294) 14:33:35.198729 run osmo-msc_10.42.42.6(pid=1714): stderr: | 20221214143334280 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143334280 DLGLOBAL DEBUG validating counter group 0x7f11a95d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143334281 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143334281 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143334281 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143334281 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143334284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143334284 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143334284 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143334285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:33:35.249769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1707): Terminating (SIGTERM) 14:33:35.290068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1710): Terminating (SIGTERM) 14:33:35.330333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1713): Terminating (SIGTERM) 14:33:35.371036 --- ParallelTerminationStrategy: PID 1707 died... 14:33:35.390777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1707): Terminated: ok {rc=0} 14:33:35.435538 --- ParallelTerminationStrategy: PID 1710 died... 14:33:35.454753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1710): Terminated: ok {rc=0} 14:33:35.499373 --- ParallelTerminationStrategy: PID 1713 died... 14:33:35.518564 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1713): Terminated: ok {rc=0} 14:33:35.605031 bus /sierra_3: Setting Powered False 14:33:36.703944 bus /sierra_3: Setting Powered False 14:33:37.820734 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:33:39.061140 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:33:39.066828 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:33:39.087201 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 14:33:39.114800 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 14:33:39.166045 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:33:39.187938 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 14:33:39.215831 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 14:33:39.765597 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 14:33:39.819636 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:39.831092 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:33:39.889921 tst mo_mt_call.py: using LAC 41559 14:33:40.015006 tst mo_mt_call.py: using RAC 249 14:33:40.135224 tst mo_mt_call.py: using CellId 41559 14:33:40.255068 tst mo_mt_call.py: using BVCI 41560 14:33:40.366585 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:40.377562 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:40.388212 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:40.398914 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:40.409903 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:40.420894 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:33:40.542491 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:33:40.659977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:33:41.174486 run create_hlr_db(pid=1720): Launched 14:33:41.310791 bus /sierra_2: Setting Powered False 14:33:42.372014 run create_hlr_db(pid=1720): Terminated: ok {rc=0} 14:33:42.833683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1722): Launched 14:33:43.166095 run osmo-hlr_10.42.42.2(pid=1723): Launched 14:33:43.293072 run osmo-stp_10.42.42.5: Starting osmo-stp 14:33:43.865125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1725): Launched 14:33:44.198592 run osmo-stp_10.42.42.5(pid=1726): Launched 14:33:44.326000 run osmo-msc_10.42.42.6: Starting osmo-msc 14:33:44.923916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1728): Launched 14:33:45.256069 run osmo-msc_10.42.42.6(pid=1729): Launched 14:33:45.441266 run osmo-stp_10.42.42.5(pid=1726): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1726)] 14:33:45.583744 run osmo-stp_10.42.42.5(pid=1726): stdout: | (launched: 2022-12-14_14:33:44.137771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:45.723240 run osmo-stp_10.42.42.5(pid=1726): stderr: | 20221214143344331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143344331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143344332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143344332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143344332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143344333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143344333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:45.868895 run osmo-stp_10.42.42.5(pid=1726): stdout: | (launched: 2022-12-14_14:33:44.137771) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:46.003206 run osmo-stp_10.42.42.5(pid=1726): stderr: | 20221214143344331 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143344331 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143344332 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143344332 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143344332 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143344333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143344333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:46.162409 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1726): Process ended prematurely: osmo-stp_10.42.42.5(pid=1726) [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1726)] [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 14:33:46.173160 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 14:33:46.202509 run osmo-hlr_10.42.42.2(pid=1723): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1723)] 14:33:46.253809 run osmo-hlr_10.42.42.2(pid=1723): stdout: | (launched: 2022-12-14_14:33:43.105695) 14:33:46.307236 run osmo-hlr_10.42.42.2(pid=1723): stderr: | 20221214143343306 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143343306 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143343306 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143343306 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143343306 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143343306 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143343319 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143343327 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143343327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143343327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:33:46.381188 run osmo-msc_10.42.42.6(pid=1729): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1729)] 14:33:46.432313 run osmo-msc_10.42.42.6(pid=1729): stdout: | (launched: 2022-12-14_14:33:45.195366) 14:33:46.485227 run osmo-msc_10.42.42.6(pid=1729): stderr: | 20221214143345523 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143345523 DLGLOBAL DEBUG validating counter group 0x7f2f9acb2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143345523 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143345523 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143345523 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143345523 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143345525 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143345525 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143345526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143345526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:33:46.538362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1722): Terminating (SIGTERM) 14:33:46.581427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1725): Terminating (SIGTERM) 14:33:46.625442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1728): Terminating (SIGTERM) 14:33:46.671629 --- ParallelTerminationStrategy: PID 1722 died... 14:33:46.692736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1722): Terminated: ok {rc=0} 14:33:46.740597 --- ParallelTerminationStrategy: PID 1725 died... 14:33:46.761561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1725): Terminated: ok {rc=0} 14:33:46.810383 --- ParallelTerminationStrategy: PID 1728 died... 14:33:46.831346 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1728): Terminated: ok {rc=0} 14:33:46.920291 bus /sierra_3: Setting Powered False 14:33:48.021019 bus /sierra_3: Setting Powered False 14:33:49.139292 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 14:33:50.286636 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:50.298310 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:33:50.361729 tst mo_mt_call_osmux.py: using LAC 41560 14:33:50.481942 tst mo_mt_call_osmux.py: using RAC 250 14:33:50.603485 tst mo_mt_call_osmux.py: using CellId 41560 14:33:50.723220 tst mo_mt_call_osmux.py: using BVCI 41561 14:33:50.834296 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:50.845288 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:50.856018 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:50.866704 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:50.877400 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:33:50.887999 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:33:51.008660 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:33:51.126813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:33:51.601949 run create_hlr_db(pid=1731): Launched 14:33:51.721508 bus /sierra_2: Setting Powered False 14:33:52.782556 run create_hlr_db(pid=1731): Terminated: ok {rc=0} 14:33:53.234664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1733): Launched 14:33:53.568055 run osmo-hlr_10.42.42.2(pid=1734): Launched 14:33:53.696348 run osmo-stp_10.42.42.5: Starting osmo-stp 14:33:54.271094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1736): Launched 14:33:54.601492 run osmo-stp_10.42.42.5(pid=1737): Launched 14:33:54.726657 run osmo-msc_10.42.42.6: Starting osmo-msc 14:33:55.329709 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1739): Launched 14:33:55.663153 run osmo-msc_10.42.42.6(pid=1740): Launched 14:33:55.849489 run osmo-stp_10.42.42.5(pid=1737): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1737)] 14:33:55.988806 run osmo-stp_10.42.42.5(pid=1737): stdout: | (launched: 2022-12-14_14:33:54.540592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:56.128618 run osmo-stp_10.42.42.5(pid=1737): stderr: | 20221214143354737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143354737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143354737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143354738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143354738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143354738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143354738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:56.267279 run osmo-stp_10.42.42.5(pid=1737): stdout: | (launched: 2022-12-14_14:33:54.540592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:33:56.398904 run osmo-stp_10.42.42.5(pid=1737): stderr: | 20221214143354737 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143354737 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143354737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143354738 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143354738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143354738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143354738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:33:56.556260 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1737): Process ended prematurely: osmo-stp_10.42.42.5(pid=1737) [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1737)] [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 14:33:56.566093 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:33:56.594256 run osmo-hlr_10.42.42.2(pid=1734): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1734)] 14:33:56.644793 run osmo-hlr_10.42.42.2(pid=1734): stdout: | (launched: 2022-12-14_14:33:53.507192) 14:33:56.697145 run osmo-hlr_10.42.42.2(pid=1734): stderr: | 20221214143353707 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143353707 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143353708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143353708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143353708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143353708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143353719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143353729 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143353729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143353729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:33:56.769893 run osmo-msc_10.42.42.6(pid=1740): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1740)] 14:33:56.820279 run osmo-msc_10.42.42.6(pid=1740): stdout: | (launched: 2022-12-14_14:33:55.602579) 14:33:56.872424 run osmo-msc_10.42.42.6(pid=1740): stderr: | 20221214143355928 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143355928 DLGLOBAL DEBUG validating counter group 0x7f94687e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143355929 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143355929 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143355929 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143355929 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143355931 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143355931 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143355932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143355932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:33:56.924518 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1733): Terminating (SIGTERM) 14:33:56.966937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1736): Terminating (SIGTERM) 14:33:57.009515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1739): Terminating (SIGTERM) 14:33:57.051880 --- ParallelTerminationStrategy: PID 1733 died... 14:33:57.072124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1733): Terminated: ok {rc=0} 14:33:57.118790 --- ParallelTerminationStrategy: PID 1736 died... 14:33:57.138574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1736): Terminated: ok {rc=0} 14:33:57.184801 --- ParallelTerminationStrategy: PID 1739 died... 14:33:57.204881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1739): Terminated: ok {rc=0} 14:33:57.293340 bus /sierra_3: Setting Powered False 14:33:58.390647 bus /sierra_3: Setting Powered False 14:33:59.507345 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 emergency:oc2g --------------------------------------------------------------------- 14:34:00.741880 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:34:00.746160 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 14:34:00.766327 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 14:34:00.793876 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 14:34:00.883077 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 14:34:00.922798 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 14:34:00.961218 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 14:34:01.518169 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2406 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 14:34:01.525867 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:01.538860 tst emergency:oc2g: Using 1 x bts (candidates: 1) 14:34:01.582625 tst emergency_mo_mt_call.py: using LAC 41561 14:34:01.714078 tst emergency_mo_mt_call.py: using RAC 251 14:34:01.868642 tst emergency_mo_mt_call.py: using CellId 41561 14:34:01.999913 tst emergency_mo_mt_call.py: using BVCI 41562 14:34:02.123262 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:02.135354 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:02.147425 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:02.159471 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:02.172549 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:02.185714 tst emergency:oc2g: Using 1 x modem (candidates: 4) 14:34:02.316688 tst emergency:oc2g: Using 1 x modem (candidates: 4) 14:34:02.442267 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:34:02.946867 run create_hlr_db(pid=1745): Launched 14:34:03.081189 bus /sierra_2: Setting Powered False 14:34:04.145385 run create_hlr_db(pid=1745): Terminated: ok {rc=0} 14:34:04.598613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1747): Launched 14:34:04.925065 run osmo-hlr_10.42.42.2(pid=1748): Launched 14:34:05.050275 run osmo-stp_10.42.42.5: Starting osmo-stp 14:34:05.611253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1750): Launched 14:34:05.937821 run osmo-stp_10.42.42.5(pid=1751): Launched 14:34:06.073224 tst emergency_mo_mt_call.py: using MSISDN 8737 14:34:06.239774 run osmo-msc_10.42.42.6: Starting osmo-msc 14:34:06.823469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1753): Launched 14:34:07.150400 run osmo-msc_10.42.42.6(pid=1754): Launched 14:34:07.332668 run osmo-stp_10.42.42.5(pid=1751): ERR: Terminated: ERROR {rc=1} [trial-2406↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1751)] 14:34:07.469488 run osmo-stp_10.42.42.5(pid=1751): stdout: | (launched: 2022-12-14_14:34:05.877795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:34:07.607350 run osmo-stp_10.42.42.5(pid=1751): stderr: | 20221214143406071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143406071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143406071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143406071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143406072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143406072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143406072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:34:07.743494 run osmo-stp_10.42.42.5(pid=1751): stdout: | (launched: 2022-12-14_14:34:05.877795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:34:07.872198 run osmo-stp_10.42.42.5(pid=1751): stderr: | 20221214143406071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143406071 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143406071 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143406071 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143406072 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143406072 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143406072 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:34:08.027560 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1751): Process ended prematurely: osmo-stp_10.42.42.5(pid=1751) [trial-2406↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1751)] [trial-2406↪emergency:oc2g↪emergency_mo_mt_call.py:19] 14:34:08.036858 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 14:34:08.064474 run osmo-hlr_10.42.42.2(pid=1748): ERR: Terminated: ERROR {rc=237} [trial-2406↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1748)] 14:34:08.114311 run osmo-hlr_10.42.42.2(pid=1748): stdout: | (launched: 2022-12-14_14:34:04.865439) 14:34:08.165990 run osmo-hlr_10.42.42.2(pid=1748): stderr: | 20221214143405064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143405064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143405064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143405064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143405064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143405064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143405077 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143405086 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143405086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143405086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:34:08.237781 run osmo-msc_10.42.42.6(pid=1754): ERR: Terminated: ERROR {rc=2} [trial-2406↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1754)] 14:34:08.287564 run osmo-msc_10.42.42.6(pid=1754): stdout: | (launched: 2022-12-14_14:34:07.090749) 14:34:08.339136 run osmo-msc_10.42.42.6(pid=1754): stderr: | 20221214143407415 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143407415 DLGLOBAL DEBUG validating counter group 0x7fc41f87ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143407415 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143407415 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143407415 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143407415 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143407417 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143407418 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143407418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143407418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:34:08.390972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1747): Terminating (SIGTERM) 14:34:08.432421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1750): Terminating (SIGTERM) 14:34:08.474089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1753): Terminating (SIGTERM) 14:34:08.515881 --- ParallelTerminationStrategy: PID 1747 died... 14:34:08.535501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1747): Terminated: ok {rc=0} 14:34:08.581355 --- ParallelTerminationStrategy: PID 1750 died... 14:34:08.600609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1750): Terminated: ok {rc=0} 14:34:08.646560 --- ParallelTerminationStrategy: PID 1753 died... 14:34:08.666125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1753): Terminated: ok {rc=0} 14:34:08.754039 bus /sierra_3: Setting Powered False 14:34:09.852024 bus /sierra_3: Setting Powered False 14:34:10.967480 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 14:34:12.053920 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:12.065774 tst emergency:oc2g: Using 1 x bts (candidates: 1) 14:34:12.103221 tst emergency_preemptive_call.py: using LAC 41562 14:34:12.228029 tst emergency_preemptive_call.py: using RAC 252 14:34:12.353515 tst emergency_preemptive_call.py: using CellId 41562 14:34:12.472676 tst emergency_preemptive_call.py: using BVCI 41563 14:34:12.582341 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:12.593188 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:12.603789 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:12.614419 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:12.625477 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 14:34:12.636061 tst emergency:oc2g: Using 1 x modem (candidates: 4) 14:34:12.756159 tst emergency:oc2g: Using 1 x modem (candidates: 4) 14:34:12.872063 tst emergency:oc2g: Using 1 x modem (candidates: 4) 14:34:12.991744 tst emergency:oc2g: Using 1 x modem (candidates: 4) 14:34:13.107457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:34:13.578407 run create_hlr_db(pid=1756): Launched 14:34:13.695835 bus /sierra_2: Setting Powered False 14:34:14.755790 run create_hlr_db(pid=1756): Terminated: ok {rc=0} 14:34:15.179800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1758): Launched 14:34:15.486064 run osmo-hlr_10.42.42.2(pid=1759): Launched 14:34:15.604299 run osmo-stp_10.42.42.5: Starting osmo-stp 14:34:16.175105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1761): Launched 14:34:16.583922 run osmo-stp_10.42.42.5(pid=1762): Launched 14:34:16.780297 tst emergency_preemptive_call.py: using MSISDN 8738 14:34:17.142701 run osmo-msc_10.42.42.6: Starting osmo-msc 14:34:17.731856 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1764): Launched 14:34:18.060444 run osmo-msc_10.42.42.6(pid=1765): Launched 14:34:18.242888 run osmo-stp_10.42.42.5(pid=1762): ERR: Terminated: ERROR {rc=1} [trial-2406↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1762)] 14:34:18.378803 run osmo-stp_10.42.42.5(pid=1762): stdout: | (launched: 2022-12-14_14:34:16.521263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:34:18.516564 run osmo-stp_10.42.42.5(pid=1762): stderr: | 20221214143416884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143416885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143416885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143416887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143416891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143416892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143416892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:34:18.652714 run osmo-stp_10.42.42.5(pid=1762): stdout: | (launched: 2022-12-14_14:34:16.521263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:34:18.782187 run osmo-stp_10.42.42.5(pid=1762): stderr: | 20221214143416884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143416885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143416885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143416887 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143416891 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143416892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143416892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:34:18.936456 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1762): Process ended prematurely: osmo-stp_10.42.42.5(pid=1762) [trial-2406↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1762)] [trial-2406↪emergency:oc2g↪emergency_preemptive_call.py:32] 14:34:18.945676 tst emergency_preemptive_call.py:32: Test FAILED (6.9 sec) 14:34:18.973674 run osmo-hlr_10.42.42.2(pid=1759): ERR: Terminated: ERROR {rc=237} [trial-2406↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1759)] 14:34:19.024488 run osmo-hlr_10.42.42.2(pid=1759): stdout: | (launched: 2022-12-14_14:34:15.429923) 14:34:19.076476 run osmo-hlr_10.42.42.2(pid=1759): stderr: | 20221214143415608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143415608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143415608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143415608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143415608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143415608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143415620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143415628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143415628 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143415629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:34:19.149086 run osmo-msc_10.42.42.6(pid=1765): ERR: Terminated: ERROR {rc=2} [trial-2406↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1765)] 14:34:19.198820 run osmo-msc_10.42.42.6(pid=1765): stdout: | (launched: 2022-12-14_14:34:18.000016) 14:34:19.250603 run osmo-msc_10.42.42.6(pid=1765): stderr: | 20221214143418327 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143418327 DLGLOBAL DEBUG validating counter group 0x7f47ec181c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143418327 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143418327 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143418327 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143418328 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143418329 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143418330 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143418330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143418330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:34:19.302587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1758): Terminating (SIGTERM) 14:34:19.346042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1761): Terminating (SIGTERM) 14:34:19.388723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1764): Terminating (SIGTERM) 14:34:19.431092 --- ParallelTerminationStrategy: PID 1758 died... 14:34:19.451354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1758): Terminated: ok {rc=0} 14:34:19.497739 --- ParallelTerminationStrategy: PID 1761 died... 14:34:19.517465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1761): Terminated: ok {rc=0} 14:34:19.563675 --- ParallelTerminationStrategy: PID 1764 died... 14:34:19.583532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1764): Terminated: ok {rc=0} 14:34:19.671852 bus /sierra_9: Setting Powered False 14:34:20.772932 bus /sierra_9: Setting Powered False 14:34:21.890447 bus /sierra_8: Setting Powered False 14:34:22.989917 bus /sierra_8: Setting Powered False 14:34:24.107244 bus /sierra_3: Setting Powered False 14:34:25.205633 bus /sierra_3: Setting Powered False 14:34:26.322199 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:oc2g --------------------------------------------------------------------- 14:34:27.590003 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:34:27.595117 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 14:34:27.616550 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 14:34:27.656443 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 14:34:27.746277 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 14:34:27.767617 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 14:34:27.807307 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 14:34:28.397872 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 14:34:28.451323 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:28.462478 tst gprs:oc2g: Using 1 x bts (candidates: 1) 14:34:28.498234 tst cs_paging_gprs_active.py: using LAC 41563 14:34:28.628142 tst cs_paging_gprs_active.py: using RAC 253 14:34:28.760683 tst cs_paging_gprs_active.py: using CellId 41563 14:34:28.889584 tst cs_paging_gprs_active.py: using BVCI 41564 14:34:29.012378 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:29.023459 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:29.034394 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:29.045341 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:29.056050 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:29.066885 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:29.077816 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:29.088613 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:29.100284 tst gprs:oc2g: Using 1 x modem (candidates: 4) 14:34:29.217609 tst gprs:oc2g: Using 1 x modem (candidates: 4) 14:34:29.334219 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:34:29.541590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:34:29.851957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1770): Launched 14:34:30.122644 run iperf3-srv_10.42.42.10(pid=1771): Launched 14:34:30.241252 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:34:30.447997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:34:30.761752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1772): Launched 14:34:31.073741 run iperf3-srv_10.42.42.10(pid=1773): Launched 14:34:31.204800 tst cs_paging_gprs_active.py:38: start network... 14:34:31.416203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:34:31.910800 run create_hlr_db(pid=1774): Launched 14:34:32.094536 bus /sierra_2: Setting Powered False 14:34:33.154976 run create_hlr_db(pid=1774): Terminated: ok {rc=0} 14:34:33.649325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1776): Launched 14:34:33.984505 run osmo-hlr_10.42.42.2(pid=1777): Launched 14:34:34.112473 run osmo-stp_10.42.42.5: Starting osmo-stp 14:34:34.686158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1780): Launched 14:34:35.018580 run osmo-stp_10.42.42.5(pid=1781): Launched 14:34:35.146593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:34:35.718591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1783): Launched 14:34:35.847654 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:34:36.128011 run patchelf(pid=1784): Launched 14:34:36.315777 run osmo-stp_10.42.42.5(pid=1781): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1781)] 14:34:36.456535 run osmo-stp_10.42.42.5(pid=1781): stdout: | (launched: 2022-12-14_14:34:34.957186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:34:36.598804 run osmo-stp_10.42.42.5(pid=1781): stderr: | 20221214143435152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143435152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143435153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143435153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143435155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143435155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143435156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:34:36.740341 run osmo-stp_10.42.42.5(pid=1781): stdout: | (launched: 2022-12-14_14:34:34.957186) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:34:36.876578 run osmo-stp_10.42.42.5(pid=1781): stderr: | 20221214143435152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143435152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143435153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143435153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143435155 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143435155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143435156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:34:37.038798 run patchelf(pid=1784): Terminating (SIGINT) 14:34:37.225314 run patchelf(pid=1784): Terminated: ok {rc=0} 14:34:37.359427 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1781): Process ended prematurely: osmo-stp_10.42.42.5(pid=1781) [trial-2406↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1781)] [trial-2406↪gprs:oc2g↪cs_paging_gprs_active.py:38] 14:34:37.369830 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 14:34:37.398915 run osmo-hlr_10.42.42.2(pid=1777): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1777)] 14:34:37.449779 run osmo-hlr_10.42.42.2(pid=1777): stdout: | (launched: 2022-12-14_14:34:33.922873) 14:34:37.502579 run osmo-hlr_10.42.42.2(pid=1777): stderr: | 20221214143434124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143434124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143434124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143434124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143434124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143434124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143434137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143434145 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143434146 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143434146 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:34:37.556359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1770): Terminating (SIGTERM) 14:34:37.598972 run iperf3-srv_10.42.42.10(pid=1771): Terminating (SIGTERM) 14:34:37.641523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1772): Terminating (SIGTERM) 14:34:37.683941 run iperf3-srv_10.42.42.10(pid=1773): Terminating (SIGTERM) 14:34:37.726507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1776): Terminating (SIGTERM) 14:34:37.769128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1780): Terminating (SIGTERM) 14:34:37.811425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1783): Terminating (SIGTERM) 14:34:37.853930 --- ParallelTerminationStrategy: PID 1770 died... 14:34:37.874377 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1770): Terminated: ok {rc=0} 14:34:37.921201 --- ParallelTerminationStrategy: PID 1771 died... 14:34:37.940889 run iperf3-srv_10.42.42.10(pid=1771): Terminated {rc=256} 14:34:37.987408 --- ParallelTerminationStrategy: PID 1772 died... 14:34:38.007149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1772): Terminated: ok {rc=0} 14:34:38.053554 --- ParallelTerminationStrategy: PID 1773 died... 14:34:38.073242 run iperf3-srv_10.42.42.10(pid=1773): Terminated {rc=256} 14:34:38.119271 --- ParallelTerminationStrategy: PID 1776 died... 14:34:38.139103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1776): Terminated: ok {rc=0} 14:34:38.185843 --- ParallelTerminationStrategy: PID 1780 died... 14:34:38.205727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1780): Terminated: ok {rc=0} 14:34:38.251969 --- ParallelTerminationStrategy: PID 1783 died... 14:34:38.271890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1783): Terminated: ok {rc=0} 14:34:38.359779 bus /gobi_0: Setting Powered False 14:34:39.459433 bus /gobi_0: Setting Powered False 14:34:40.574715 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g iperf3.py ---------------------------------------------- 14:34:41.725434 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:41.737099 tst gprs:oc2g: Using 1 x bts (candidates: 1) 14:34:41.773881 tst iperf3.py: using LAC 41564 14:34:41.904319 tst iperf3.py: using RAC 254 14:34:42.035755 tst iperf3.py: using CellId 41564 14:34:42.167079 tst iperf3.py: using BVCI 41565 14:34:42.289858 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:42.300900 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:42.311831 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:42.322748 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:42.333596 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:42.344695 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:42.355906 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:42.366984 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:42.378058 tst gprs:oc2g: Using 1 x modem (candidates: 4) 14:34:42.497072 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:34:42.705633 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:34:43.015282 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1785): Launched 14:34:43.286354 run iperf3-srv_10.42.42.10(pid=1786): Launched 14:34:43.404089 tst iperf3.py:8: start network... 14:34:43.609713 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:34:44.086803 run create_hlr_db(pid=1787): Launched 14:34:44.207372 bus /gobi_6: Setting Powered False 14:34:45.268740 run create_hlr_db(pid=1787): Terminated: ok {rc=0} 14:34:45.698493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1789): Launched 14:34:46.013771 run osmo-hlr_10.42.42.2(pid=1790): Launched 14:34:46.413332 run osmo-stp_10.42.42.5: Starting osmo-stp 14:34:47.108586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1792): Launched 14:34:47.453735 run osmo-stp_10.42.42.5(pid=1793): Launched 14:34:47.572595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:34:48.107496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1795): Launched 14:34:48.227321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:34:48.489577 run patchelf(pid=1796): Launched 14:34:48.662314 run osmo-stp_10.42.42.5(pid=1793): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1793)] 14:34:48.793276 run osmo-stp_10.42.42.5(pid=1793): stdout: | (launched: 2022-12-14_14:34:47.396487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:34:48.925189 run osmo-stp_10.42.42.5(pid=1793): stderr: | 20221214143447570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143447570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143447570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143447571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143447571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143447571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143447571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:34:49.057358 run osmo-stp_10.42.42.5(pid=1793): stdout: | (launched: 2022-12-14_14:34:47.396487) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:34:49.184169 run osmo-stp_10.42.42.5(pid=1793): stderr: | 20221214143447570 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143447570 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143447570 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143447571 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143447571 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143447571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143447571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:34:49.333722 run patchelf(pid=1796): Terminating (SIGINT) 14:34:49.507627 run patchelf(pid=1796): Terminated: ok {rc=0} 14:34:49.633757 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1793): Process ended prematurely: osmo-stp_10.42.42.5(pid=1793) [trial-2406↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1793)] [trial-2406↪gprs:oc2g↪iperf3.py:8] 14:34:49.643451 tst iperf3.py:8: Test FAILED (8.0 sec) 14:34:49.670931 run osmo-hlr_10.42.42.2(pid=1790): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1790)] 14:34:49.719550 run osmo-hlr_10.42.42.2(pid=1790): stdout: | (launched: 2022-12-14_14:34:45.954611) 14:34:49.769517 run osmo-hlr_10.42.42.2(pid=1790): stderr: | 20221214143446298 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143446298 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143446298 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143446298 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143446298 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143446298 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143446317 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143446346 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143446347 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143446347 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:34:49.819772 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1785): Terminating (SIGTERM) 14:34:49.860526 run iperf3-srv_10.42.42.10(pid=1786): Terminating (SIGTERM) 14:34:49.900789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1789): Terminating (SIGTERM) 14:34:49.941258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1792): Terminating (SIGTERM) 14:34:49.981512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1795): Terminating (SIGTERM) 14:34:50.022261 --- ParallelTerminationStrategy: PID 1785 died... 14:34:50.042036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1785): Terminated: ok {rc=0} 14:34:50.086544 --- ParallelTerminationStrategy: PID 1786 died... 14:34:50.106004 run iperf3-srv_10.42.42.10(pid=1786): Terminated {rc=256} 14:34:50.150463 --- ParallelTerminationStrategy: PID 1789 died... 14:34:50.169628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1789): Terminated: ok {rc=0} 14:34:50.214171 --- ParallelTerminationStrategy: PID 1792 died... 14:34:50.233309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1792): Terminated: ok {rc=0} 14:34:50.278118 --- ParallelTerminationStrategy: PID 1795 died... 14:34:50.297377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1795): Terminated: ok {rc=0} 14:34:50.383882 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g iperf3m4.py ---------------------------------------------- 14:34:51.530433 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:51.541833 tst gprs:oc2g: Using 1 x bts (candidates: 1) 14:34:51.576637 tst iperf3m4.py: using LAC 41565 14:34:51.695993 tst iperf3m4.py: using RAC 255 14:34:51.814351 tst iperf3m4.py: using CellId 41565 14:34:51.935653 tst iperf3m4.py: using BVCI 41566 14:34:52.047469 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:52.058003 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:52.068292 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:52.078722 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:52.089030 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:52.099570 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:52.111115 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:52.122117 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:34:52.132811 tst gprs:oc2g: Using 1 x modem (candidates: 4) 14:34:52.255342 tst gprs:oc2g: Using 1 x modem (candidates: 4) 14:34:52.380443 tst gprs:oc2g: Using 1 x modem (candidates: 4) 14:34:52.499584 tst gprs:oc2g: Using 1 x modem (candidates: 4) 14:34:52.619086 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:34:52.843327 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:34:53.178806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1797): Launched 14:34:53.468123 run iperf3-srv_10.42.42.10(pid=1798): Launched 14:34:53.594565 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:34:53.818570 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:34:54.151793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1799): Launched 14:34:54.443587 run iperf3-srv_10.42.42.10(pid=1800): Launched 14:34:54.570357 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:34:54.793737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:34:55.128248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1801): Launched 14:34:55.418680 run iperf3-srv_10.42.42.10(pid=1802): Launched 14:34:55.543693 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:34:55.767119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:34:56.101369 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1803): Launched 14:34:56.391030 run iperf3-srv_10.42.42.10(pid=1804): Launched 14:34:56.517178 tst iperf3m4.py:8: start network... 14:34:56.740313 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:34:57.255800 run create_hlr_db(pid=1805): Launched 14:34:57.390625 bus /gobi_6: Setting Powered False 14:34:58.456084 run create_hlr_db(pid=1805): Terminated: ok {rc=0} 14:34:58.897254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1807): Launched 14:34:59.207297 run osmo-hlr_10.42.42.2(pid=1808): Launched 14:34:59.325421 run osmo-stp_10.42.42.5: Starting osmo-stp 14:34:59.898032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1810): Launched 14:35:00.232351 run osmo-stp_10.42.42.5(pid=1811): Launched 14:35:00.361331 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:35:00.957641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1813): Launched 14:35:01.091651 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:35:01.389700 run patchelf(pid=1815): Launched 14:35:01.581249 run osmo-stp_10.42.42.5(pid=1811): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1811)] 14:35:01.719641 run osmo-stp_10.42.42.5(pid=1811): stdout: | (launched: 2022-12-14_14:35:00.170604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:01.869714 run osmo-stp_10.42.42.5(pid=1811): stderr: | 20221214143500366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143500366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143500367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143500367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143500367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143500367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143500368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:02.049120 run osmo-stp_10.42.42.5(pid=1811): stdout: | (launched: 2022-12-14_14:35:00.170604) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:02.194888 run osmo-stp_10.42.42.5(pid=1811): stderr: | 20221214143500366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143500366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143500367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143500367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143500367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143500367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143500368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:02.354514 run patchelf(pid=1815): Terminating (SIGINT) 14:35:02.541356 run patchelf(pid=1815): Terminated: ok {rc=0} 14:35:02.675409 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1811): Process ended prematurely: osmo-stp_10.42.42.5(pid=1811) [trial-2406↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1811)] [trial-2406↪gprs:oc2g↪iperf3m4.py:8] 14:35:02.686003 tst iperf3m4.py:8: Test FAILED (11.2 sec) 14:35:02.715588 run osmo-hlr_10.42.42.2(pid=1808): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1808)] 14:35:02.766277 run osmo-hlr_10.42.42.2(pid=1808): stdout: | (launched: 2022-12-14_14:34:59.150152) 14:35:02.818876 run osmo-hlr_10.42.42.2(pid=1808): stderr: | 20221214143459328 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143459328 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143459328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143459328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143459328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143459328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143459340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143459350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143459350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143459350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:35:02.871740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1797): Terminating (SIGTERM) 14:35:02.914074 run iperf3-srv_10.42.42.10(pid=1798): Terminating (SIGTERM) 14:35:02.956774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1799): Terminating (SIGTERM) 14:35:02.999448 run iperf3-srv_10.42.42.10(pid=1800): Terminating (SIGTERM) 14:35:03.041831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1801): Terminating (SIGTERM) 14:35:03.084326 run iperf3-srv_10.42.42.10(pid=1802): Terminating (SIGTERM) 14:35:03.126860 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1803): Terminating (SIGTERM) 14:35:03.169168 run iperf3-srv_10.42.42.10(pid=1804): Terminating (SIGTERM) 14:35:03.211250 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1807): Terminating (SIGTERM) 14:35:03.253697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1810): Terminating (SIGTERM) 14:35:03.296081 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1813): Terminating (SIGTERM) 14:35:03.338756 --- ParallelTerminationStrategy: PID 1797 died... 14:35:03.359337 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1797): Terminated: ok {rc=0} 14:35:03.406187 --- ParallelTerminationStrategy: PID 1798 died... 14:35:03.426088 run iperf3-srv_10.42.42.10(pid=1798): Terminated {rc=256} 14:35:03.472733 --- ParallelTerminationStrategy: PID 1799 died... 14:35:03.492897 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1799): Terminated: ok {rc=0} 14:35:03.539767 --- ParallelTerminationStrategy: PID 1800 died... 14:35:03.559828 run iperf3-srv_10.42.42.10(pid=1800): Terminated {rc=256} 14:35:03.606983 --- ParallelTerminationStrategy: PID 1801 died... 14:35:03.627018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1801): Terminated: ok {rc=0} 14:35:03.673807 --- ParallelTerminationStrategy: PID 1802 died... 14:35:03.693898 run iperf3-srv_10.42.42.10(pid=1802): Terminated {rc=256} 14:35:03.740610 --- ParallelTerminationStrategy: PID 1803 died... 14:35:03.760546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1803): Terminated: ok {rc=0} 14:35:03.807644 --- ParallelTerminationStrategy: PID 1804 died... 14:35:03.827704 run iperf3-srv_10.42.42.10(pid=1804): Terminated {rc=256} 14:35:03.874604 --- ParallelTerminationStrategy: PID 1807 died... 14:35:03.894775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1807): Terminated: ok {rc=0} 14:35:03.941558 --- ParallelTerminationStrategy: PID 1810 died... 14:35:03.961570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1810): Terminated: ok {rc=0} 14:35:04.008795 --- ParallelTerminationStrategy: PID 1813 died... 14:35:04.029544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1813): Terminated: ok {rc=0} 14:35:04.119003 bus /gobi_4: Setting Powered False 14:35:05.218858 bus /gobi_4: Setting Powered False 14:35:06.335817 bus /gobi_1: Setting Powered False 14:35:07.434756 bus /gobi_1: Setting Powered False 14:35:08.552780 bus /gobi_0: Setting Powered False 14:35:09.651779 bus /gobi_0: Setting Powered False 14:35:10.769915 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g ping.py ---------------------------------------------- 14:35:11.873354 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:11.885189 tst gprs:oc2g: Using 1 x bts (candidates: 1) 14:35:11.921947 tst ping.py: using LAC 41566 14:35:12.041910 tst ping.py: using RAC 1 14:35:12.162157 tst ping.py: using CellId 41566 14:35:12.282330 tst ping.py: using BVCI 41567 14:35:12.394374 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:12.405209 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:12.415636 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:12.426310 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:12.437146 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:12.448872 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:12.459883 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:12.470853 tst gprs:oc2g: Using 1 x modem (candidates: 4) 14:35:12.584714 tst ping.py:19: start network... 14:35:12.788792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:35:13.258886 run create_hlr_db(pid=1820): Launched 14:35:13.376932 bus /gobi_6: Setting Powered False 14:35:14.441442 run create_hlr_db(pid=1820): Terminated: ok {rc=0} 14:35:14.896164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1822): Launched 14:35:15.223519 run osmo-hlr_10.42.42.2(pid=1823): Launched 14:35:15.350548 run osmo-stp_10.42.42.5: Starting osmo-stp 14:35:15.941778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1825): Launched 14:35:16.281862 run osmo-stp_10.42.42.5(pid=1826): Launched 14:35:16.444475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:35:17.143589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1828): Launched 14:35:17.281135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:35:17.538752 run patchelf(pid=1829): Launched 14:35:17.707850 run osmo-stp_10.42.42.5(pid=1826): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1826)] 14:35:17.837101 run osmo-stp_10.42.42.5(pid=1826): stdout: | (launched: 2022-12-14_14:35:16.221961) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:17.967609 run osmo-stp_10.42.42.5(pid=1826): stderr: | 20221214143516567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143516567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143516568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143516568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143516570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143516570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143516571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:18.098171 run osmo-stp_10.42.42.5(pid=1826): stdout: | (launched: 2022-12-14_14:35:16.221961) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:18.222738 run osmo-stp_10.42.42.5(pid=1826): stderr: | 20221214143516567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143516567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143516568 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143516568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143516570 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143516570 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143516571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:18.370085 run patchelf(pid=1829): Terminating (SIGINT) 14:35:18.541093 run patchelf(pid=1829): Terminated: ok {rc=0} 14:35:18.663528 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1826): Process ended prematurely: osmo-stp_10.42.42.5(pid=1826) [trial-2406↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1826)] [trial-2406↪gprs:oc2g↪ping.py:22] 14:35:18.672623 tst ping.py:22: Test FAILED (6.8 sec) 14:35:18.699773 run osmo-hlr_10.42.42.2(pid=1823): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1823)] 14:35:18.748310 run osmo-hlr_10.42.42.2(pid=1823): stdout: | (launched: 2022-12-14_14:35:15.163526) 14:35:18.798521 run osmo-hlr_10.42.42.2(pid=1823): stderr: | 20221214143515363 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143515363 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143515363 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143515363 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143515363 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143515363 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143515376 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143515386 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143515386 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143515386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:35:18.849053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1822): Terminating (SIGTERM) 14:35:18.889600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1825): Terminating (SIGTERM) 14:35:18.929943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1828): Terminating (SIGTERM) 14:35:18.970481 --- ParallelTerminationStrategy: PID 1822 died... 14:35:18.990237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1822): Terminated: ok {rc=0} 14:35:19.034622 --- ParallelTerminationStrategy: PID 1825 died... 14:35:19.053799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1825): Terminated: ok {rc=0} 14:35:19.098173 --- ParallelTerminationStrategy: PID 1828 died... 14:35:19.117370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1828): Terminated: ok {rc=0} 14:35:19.203415 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 14:35:20.291409 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:20.302907 tst gprs:oc2g: Using 1 x bts (candidates: 1) 14:35:20.338278 tst ping_idle_ping.py: using LAC 41567 14:35:20.457453 tst ping_idle_ping.py: using RAC 2 14:35:20.578695 tst ping_idle_ping.py: using CellId 41567 14:35:20.697717 tst ping_idle_ping.py: using BVCI 41568 14:35:20.807541 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:20.818162 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:20.828639 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:20.839099 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:20.849492 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:20.860306 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:20.871851 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 14:35:20.882836 tst gprs:oc2g: Using 1 x modem (candidates: 4) 14:35:21.003888 tst ping_idle_ping.py:24: start network... 14:35:21.224262 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:35:21.730785 run create_hlr_db(pid=1830): Launched 14:35:21.865104 bus /gobi_6: Setting Powered False 14:35:22.930120 run create_hlr_db(pid=1830): Terminated: ok {rc=0} 14:35:23.384455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1833): Launched 14:35:23.714255 run osmo-hlr_10.42.42.2(pid=1834): Launched 14:35:23.840396 run osmo-stp_10.42.42.5: Starting osmo-stp 14:35:24.406747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1836): Launched 14:35:24.734976 run osmo-stp_10.42.42.5(pid=1837): Launched 14:35:24.860125 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:35:25.424488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1839): Launched 14:35:25.551014 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:35:25.826781 run patchelf(pid=1840): Launched 14:35:26.010554 run osmo-stp_10.42.42.5(pid=1837): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1837)] 14:35:26.148750 run osmo-stp_10.42.42.5(pid=1837): stdout: | (launched: 2022-12-14_14:35:24.674875) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:26.288190 run osmo-stp_10.42.42.5(pid=1837): stderr: | 20221214143524868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143524868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143524868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143524868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143524871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143524871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143524871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:26.427759 run osmo-stp_10.42.42.5(pid=1837): stdout: | (launched: 2022-12-14_14:35:24.674875) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:26.561572 run osmo-stp_10.42.42.5(pid=1837): stderr: | 20221214143524868 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143524868 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143524868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143524868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143524871 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143524871 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143524871 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:26.719309 run patchelf(pid=1840): Terminating (SIGINT) 14:35:26.901909 run patchelf(pid=1840): Terminated: ok {rc=0} 14:35:27.033483 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1837): Process ended prematurely: osmo-stp_10.42.42.5(pid=1837) [trial-2406↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1837)] [trial-2406↪gprs:oc2g↪ping_idle_ping.py:27] 14:35:27.043260 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 14:35:27.071521 run osmo-hlr_10.42.42.2(pid=1834): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1834)] 14:35:27.121532 run osmo-hlr_10.42.42.2(pid=1834): stdout: | (launched: 2022-12-14_14:35:23.653904) 14:35:27.173229 run osmo-hlr_10.42.42.2(pid=1834): stderr: | 20221214143523854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143523854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143523855 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143523855 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143523855 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143523855 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143523867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143523875 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143523876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143523876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:35:27.225104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1833): Terminating (SIGTERM) 14:35:27.266892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1836): Terminating (SIGTERM) 14:35:27.308857 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1839): Terminating (SIGTERM) 14:35:27.351491 --- ParallelTerminationStrategy: PID 1833 died... 14:35:27.371719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1833): Terminated: ok {rc=0} 14:35:27.418032 --- ParallelTerminationStrategy: PID 1836 died... 14:35:27.437719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1836): Terminated: ok {rc=0} 14:35:27.483627 --- ParallelTerminationStrategy: PID 1839 died... 14:35:27.503359 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1839): Terminated: ok {rc=0} 14:35:27.590523 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 14:35:28.879930 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:35:28.886428 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 14:35:28.907335 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 14:35:28.946422 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 14:35:29.031748 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 14:35:29.052096 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 14:35:29.090076 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 14:35:29.682705 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 14:35:29.732132 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:29.742938 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:35:29.784364 tst cs_paging_gprs_active.py: using LAC 41568 14:35:29.920636 tst cs_paging_gprs_active.py: using RAC 3 14:35:30.053146 tst cs_paging_gprs_active.py: using CellId 41568 14:35:30.183406 tst cs_paging_gprs_active.py: using BVCI 41569 14:35:30.303088 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:30.314589 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:30.325775 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:30.336841 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:30.347902 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:30.359017 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:30.370337 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:30.381466 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:30.392662 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:35:30.512095 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:35:30.630829 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:35:30.874980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:35:31.210300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1844): Launched 14:35:31.500029 run iperf3-srv_10.42.42.10(pid=1845): Launched 14:35:31.649374 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:35:31.863298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:35:32.183635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1846): Launched 14:35:32.473653 run iperf3-srv_10.42.42.10(pid=1847): Launched 14:35:32.595891 tst cs_paging_gprs_active.py:38: start network... 14:35:32.815566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:35:33.323379 run create_hlr_db(pid=1848): Launched 14:35:33.458774 bus /gobi_6: Setting Powered False 14:35:34.522891 run create_hlr_db(pid=1848): Terminated: ok {rc=0} 14:35:34.959397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1850): Launched 14:35:35.266196 run osmo-hlr_10.42.42.2(pid=1851): Launched 14:35:35.383380 run osmo-stp_10.42.42.5: Starting osmo-stp 14:35:35.925116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1853): Launched 14:35:36.231157 run osmo-stp_10.42.42.5(pid=1854): Launched 14:35:36.347863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:35:36.874293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1856): Launched 14:35:36.992117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:35:37.251176 run patchelf(pid=1857): Launched 14:35:37.422580 run osmo-stp_10.42.42.5(pid=1854): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1854)] 14:35:37.552313 run osmo-stp_10.42.42.5(pid=1854): stdout: | (launched: 2022-12-14_14:35:36.175156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:37.683815 run osmo-stp_10.42.42.5(pid=1854): stderr: | 20221214143536347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143536347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143536347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143536348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143536350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143536350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143536350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:37.814993 run osmo-stp_10.42.42.5(pid=1854): stdout: | (launched: 2022-12-14_14:35:36.175156) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:37.940377 run osmo-stp_10.42.42.5(pid=1854): stderr: | 20221214143536347 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143536347 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143536347 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143536348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143536350 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143536350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143536350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:38.089204 run patchelf(pid=1857): Terminating (SIGINT) 14:35:38.260150 run patchelf(pid=1857): Terminated: ok {rc=0} 14:35:38.383408 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1854): Process ended prematurely: osmo-stp_10.42.42.5(pid=1854) [trial-2406↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1854)] [trial-2406↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 14:35:38.393021 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 14:35:38.420257 run osmo-hlr_10.42.42.2(pid=1851): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1851)] 14:35:38.469108 run osmo-hlr_10.42.42.2(pid=1851): stdout: | (launched: 2022-12-14_14:35:35.210046) 14:35:38.519289 run osmo-hlr_10.42.42.2(pid=1851): stderr: | 20221214143535385 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143535385 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143535385 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143535385 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143535385 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143535385 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143535397 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143535404 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143535405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143535405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:35:38.569512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1844): Terminating (SIGTERM) 14:35:38.609916 run iperf3-srv_10.42.42.10(pid=1845): Terminating (SIGTERM) 14:35:38.650550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1846): Terminating (SIGTERM) 14:35:38.692059 run iperf3-srv_10.42.42.10(pid=1847): Terminating (SIGTERM) 14:35:38.732431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1850): Terminating (SIGTERM) 14:35:38.772717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1853): Terminating (SIGTERM) 14:35:38.812833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1856): Terminating (SIGTERM) 14:35:38.853365 --- ParallelTerminationStrategy: PID 1844 died... 14:35:38.872866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1844): Terminated: ok {rc=0} 14:35:38.917260 --- ParallelTerminationStrategy: PID 1845 died... 14:35:38.936207 run iperf3-srv_10.42.42.10(pid=1845): Terminated {rc=256} 14:35:38.980230 --- ParallelTerminationStrategy: PID 1846 died... 14:35:38.999227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1846): Terminated: ok {rc=0} 14:35:39.043139 --- ParallelTerminationStrategy: PID 1847 died... 14:35:39.062190 run iperf3-srv_10.42.42.10(pid=1847): Terminated {rc=256} 14:35:39.106238 --- ParallelTerminationStrategy: PID 1850 died... 14:35:39.125036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1850): Terminated: ok {rc=0} 14:35:39.169148 --- ParallelTerminationStrategy: PID 1853 died... 14:35:39.187835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1853): Terminated: ok {rc=0} 14:35:39.231907 --- ParallelTerminationStrategy: PID 1856 died... 14:35:39.250957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1856): Terminated: ok {rc=0} 14:35:39.337165 bus /gobi_0: Setting Powered False 14:35:40.435706 bus /gobi_0: Setting Powered False 14:35:41.551076 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 14:35:42.697838 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:42.709499 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:35:42.746356 tst iperf3.py: using LAC 41569 14:35:42.866434 tst iperf3.py: using RAC 4 14:35:42.987587 tst iperf3.py: using CellId 41569 14:35:43.108771 tst iperf3.py: using BVCI 41570 14:35:43.220806 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:43.231526 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:43.242231 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:43.252683 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:43.263420 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:43.274276 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:43.285221 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:43.295681 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:43.306562 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:35:43.427642 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:35:43.648282 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:35:43.975359 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1858): Launched 14:35:44.261219 run iperf3-srv_10.42.42.10(pid=1859): Launched 14:35:44.383061 tst iperf3.py:8: start network... 14:35:44.601469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:35:45.106823 run create_hlr_db(pid=1860): Launched 14:35:45.239311 bus /gobi_6: Setting Powered False 14:35:46.313526 run create_hlr_db(pid=1860): Terminated: ok {rc=0} 14:35:46.782171 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1862): Launched 14:35:47.109606 run osmo-hlr_10.42.42.2(pid=1863): Launched 14:35:47.269757 run osmo-stp_10.42.42.5: Starting osmo-stp 14:35:47.803036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1865): Launched 14:35:48.110096 run osmo-stp_10.42.42.5(pid=1866): Launched 14:35:48.229222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:35:48.755293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1868): Launched 14:35:48.873218 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:35:49.131060 run patchelf(pid=1869): Launched 14:35:49.302495 run osmo-stp_10.42.42.5(pid=1866): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1866)] 14:35:49.432432 run osmo-stp_10.42.42.5(pid=1866): stdout: | (launched: 2022-12-14_14:35:48.053954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:49.563028 run osmo-stp_10.42.42.5(pid=1866): stderr: | 20221214143548223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143548223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143548223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143548223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143548226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143548226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143548226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:49.693949 run osmo-stp_10.42.42.5(pid=1866): stdout: | (launched: 2022-12-14_14:35:48.053954) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:35:49.818799 run osmo-stp_10.42.42.5(pid=1866): stderr: | 20221214143548223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143548223 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143548223 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143548223 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143548226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143548226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143548226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:35:49.966692 run patchelf(pid=1869): Terminating (SIGINT) 14:35:50.138391 run patchelf(pid=1869): Terminated: ok {rc=0} 14:35:50.262256 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1866): Process ended prematurely: osmo-stp_10.42.42.5(pid=1866) [trial-2406↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1866)] [trial-2406↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 14:35:50.271761 tst iperf3.py:8: Test FAILED (7.6 sec) 14:35:50.298886 run osmo-hlr_10.42.42.2(pid=1863): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1863)] 14:35:50.347107 run osmo-hlr_10.42.42.2(pid=1863): stdout: | (launched: 2022-12-14_14:35:47.049431) 14:35:50.396870 run osmo-hlr_10.42.42.2(pid=1863): stderr: | 20221214143547281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143547281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143547282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143547282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143547282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143547282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143547295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143547305 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143547305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143547306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:35:50.447258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1858): Terminating (SIGTERM) 14:35:50.488281 run iperf3-srv_10.42.42.10(pid=1859): Terminating (SIGTERM) 14:35:50.528407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1862): Terminating (SIGTERM) 14:35:50.568866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1865): Terminating (SIGTERM) 14:35:50.608926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1868): Terminating (SIGTERM) 14:35:50.649373 --- ParallelTerminationStrategy: PID 1858 died... 14:35:50.669085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1858): Terminated: ok {rc=0} 14:35:50.713425 --- ParallelTerminationStrategy: PID 1859 died... 14:35:50.732571 run iperf3-srv_10.42.42.10(pid=1859): Terminated {rc=256} 14:35:50.776899 --- ParallelTerminationStrategy: PID 1862 died... 14:35:50.796581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1862): Terminated: ok {rc=0} 14:35:50.840921 --- ParallelTerminationStrategy: PID 1865 died... 14:35:50.860620 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1865): Terminated: ok {rc=0} 14:35:50.905053 --- ParallelTerminationStrategy: PID 1868 died... 14:35:50.924132 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1868): Terminated: ok {rc=0} 14:35:51.011204 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 14:35:52.159729 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:52.171495 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:35:52.209452 tst iperf3m4.py: using LAC 41570 14:35:52.331483 tst iperf3m4.py: using RAC 5 14:35:52.452376 tst iperf3m4.py: using CellId 41570 14:35:52.573385 tst iperf3m4.py: using BVCI 41571 14:35:52.686181 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:52.697134 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:52.707699 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:52.718513 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:52.729914 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:52.741434 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:52.753354 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:52.764906 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:35:52.776859 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:35:52.901322 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:35:53.019479 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:35:53.140195 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:35:53.258760 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:35:53.477985 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:35:53.805235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1872): Launched 14:35:54.089733 run iperf3-srv_10.42.42.10(pid=1873): Launched 14:35:54.211344 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:35:54.429606 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:35:54.755302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1874): Launched 14:35:55.040550 run iperf3-srv_10.42.42.10(pid=1875): Launched 14:35:55.162491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:35:55.380262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:35:55.705640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1876): Launched 14:35:55.988355 run iperf3-srv_10.42.42.10(pid=1877): Launched 14:35:56.111030 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:35:56.330034 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:35:56.656180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1878): Launched 14:35:56.940613 run iperf3-srv_10.42.42.10(pid=1879): Launched 14:35:57.063027 tst iperf3m4.py:8: start network... 14:35:57.281079 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:35:57.786185 run create_hlr_db(pid=1880): Launched 14:35:57.920460 bus /gobi_6: Setting Powered False 14:35:58.981524 run create_hlr_db(pid=1880): Terminated: ok {rc=0} 14:35:59.435742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1882): Launched 14:35:59.762189 run osmo-hlr_10.42.42.2(pid=1883): Launched 14:35:59.887359 run osmo-stp_10.42.42.5: Starting osmo-stp 14:36:00.446977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1885): Launched 14:36:00.773735 run osmo-stp_10.42.42.5(pid=1886): Launched 14:36:00.982283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:36:01.625802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1888): Launched 14:36:01.760782 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:36:02.049861 run patchelf(pid=1889): Launched 14:36:02.229159 run osmo-stp_10.42.42.5(pid=1886): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1886)] 14:36:02.361796 run osmo-stp_10.42.42.5(pid=1886): stdout: | (launched: 2022-12-14_14:36:00.714888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:02.493344 run osmo-stp_10.42.42.5(pid=1886): stderr: | 20221214143600937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143600937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143600938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143600938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143600938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143600938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143600938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:02.624588 run osmo-stp_10.42.42.5(pid=1886): stdout: | (launched: 2022-12-14_14:36:00.714888) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:02.750166 run osmo-stp_10.42.42.5(pid=1886): stderr: | 20221214143600937 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143600937 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143600938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143600938 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143600938 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143600938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143600938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:02.898891 run patchelf(pid=1889): Terminating (SIGINT) 14:36:03.070838 run patchelf(pid=1889): Terminated: ok {rc=0} 14:36:03.194896 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1886): Process ended prematurely: osmo-stp_10.42.42.5(pid=1886) [trial-2406↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1886)] [trial-2406↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 14:36:03.204738 tst iperf3m4.py:8: Test FAILED (11.1 sec) 14:36:03.232446 run osmo-hlr_10.42.42.2(pid=1883): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1883)] 14:36:03.281498 run osmo-hlr_10.42.42.2(pid=1883): stdout: | (launched: 2022-12-14_14:35:59.702431) 14:36:03.331820 run osmo-hlr_10.42.42.2(pid=1883): stderr: | 20221214143559902 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143559902 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143559902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143559902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143559902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143559902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143559947 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143559957 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143559957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143559957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:36:03.382680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1872): Terminating (SIGTERM) 14:36:03.423600 run iperf3-srv_10.42.42.10(pid=1873): Terminating (SIGTERM) 14:36:03.464368 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1874): Terminating (SIGTERM) 14:36:03.505746 run iperf3-srv_10.42.42.10(pid=1875): Terminating (SIGTERM) 14:36:03.546477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1876): Terminating (SIGTERM) 14:36:03.587361 run iperf3-srv_10.42.42.10(pid=1877): Terminating (SIGTERM) 14:36:03.628077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1878): Terminating (SIGTERM) 14:36:03.668845 run iperf3-srv_10.42.42.10(pid=1879): Terminating (SIGTERM) 14:36:03.709428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1882): Terminating (SIGTERM) 14:36:03.750081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1885): Terminating (SIGTERM) 14:36:03.790727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1888): Terminating (SIGTERM) 14:36:03.831510 --- ParallelTerminationStrategy: PID 1872 died... 14:36:03.850877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1872): Terminated: ok {rc=0} 14:36:03.896099 --- ParallelTerminationStrategy: PID 1873 died... 14:36:03.915335 run iperf3-srv_10.42.42.10(pid=1873): Terminated {rc=256} 14:36:03.959910 --- ParallelTerminationStrategy: PID 1874 died... 14:36:03.979307 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1874): Terminated: ok {rc=0} 14:36:04.024222 --- ParallelTerminationStrategy: PID 1875 died... 14:36:04.043569 run iperf3-srv_10.42.42.10(pid=1875): Terminated {rc=256} 14:36:04.088537 --- ParallelTerminationStrategy: PID 1876 died... 14:36:04.107911 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1876): Terminated: ok {rc=0} 14:36:04.152499 --- ParallelTerminationStrategy: PID 1877 died... 14:36:04.171849 run iperf3-srv_10.42.42.10(pid=1877): Terminated {rc=256} 14:36:04.216613 --- ParallelTerminationStrategy: PID 1878 died... 14:36:04.235929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1878): Terminated: ok {rc=0} 14:36:04.280776 --- ParallelTerminationStrategy: PID 1879 died... 14:36:04.300044 run iperf3-srv_10.42.42.10(pid=1879): Terminated {rc=256} 14:36:04.344635 --- ParallelTerminationStrategy: PID 1882 died... 14:36:04.364142 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1882): Terminated: ok {rc=0} 14:36:04.408942 --- ParallelTerminationStrategy: PID 1885 died... 14:36:04.428652 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1885): Terminated: ok {rc=0} 14:36:04.473430 --- ParallelTerminationStrategy: PID 1888 died... 14:36:04.492797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1888): Terminated: ok {rc=0} 14:36:04.580343 bus /gobi_4: Setting Powered False 14:36:05.682212 bus /gobi_4: Setting Powered False 14:36:06.798266 bus /gobi_1: Setting Powered False 14:36:07.899344 bus /gobi_1: Setting Powered False 14:36:09.012893 bus /gobi_0: Setting Powered False 14:36:10.111611 bus /gobi_0: Setting Powered False 14:36:11.228234 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 14:36:12.329099 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:12.340504 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:36:12.377528 tst ping.py: using LAC 41571 14:36:12.495062 tst ping.py: using RAC 6 14:36:12.621106 tst ping.py: using CellId 41571 14:36:12.739297 tst ping.py: using BVCI 41572 14:36:12.850004 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:12.860799 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:12.871455 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:12.882256 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:12.893233 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:12.904003 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:12.915119 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:12.926103 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:36:13.045182 tst ping.py:19: start network... 14:36:13.260814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:36:13.754554 run create_hlr_db(pid=1890): Launched 14:36:13.885699 bus /gobi_6: Setting Powered False 14:36:14.950012 run create_hlr_db(pid=1890): Terminated: ok {rc=0} 14:36:15.379847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1892): Launched 14:36:15.681070 run osmo-hlr_10.42.42.2(pid=1893): Launched 14:36:15.795820 run osmo-stp_10.42.42.5: Starting osmo-stp 14:36:16.417801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1895): Launched 14:36:16.736377 run osmo-stp_10.42.42.5(pid=1896): Launched 14:36:17.040550 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:36:17.673781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1898): Launched 14:36:17.789101 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:36:18.042431 run patchelf(pid=1899): Launched 14:36:18.211545 run osmo-stp_10.42.42.5(pid=1896): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1896)] 14:36:18.339203 run osmo-stp_10.42.42.5(pid=1896): stdout: | (launched: 2022-12-14_14:36:16.678230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:18.467978 run osmo-stp_10.42.42.5(pid=1896): stderr: | 20221214143616965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143616966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143616968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143616969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143616971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143616972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143616972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:18.596737 run osmo-stp_10.42.42.5(pid=1896): stdout: | (launched: 2022-12-14_14:36:16.678230) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:18.719777 run osmo-stp_10.42.42.5(pid=1896): stderr: | 20221214143616965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143616966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143616968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143616969 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143616971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143616972 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143616972 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:18.865613 run patchelf(pid=1899): Terminating (SIGINT) 14:36:19.035315 run patchelf(pid=1899): Terminated: ok {rc=0} 14:36:19.156896 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1896): Process ended prematurely: osmo-stp_10.42.42.5(pid=1896) [trial-2406↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1896)] [trial-2406↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 14:36:19.166062 tst ping.py:22: Test FAILED (6.8 sec) 14:36:19.192704 run osmo-hlr_10.42.42.2(pid=1893): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1893)] 14:36:19.241440 run osmo-hlr_10.42.42.2(pid=1893): stdout: | (launched: 2022-12-14_14:36:15.625823) 14:36:19.291320 run osmo-hlr_10.42.42.2(pid=1893): stderr: | 20221214143615802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143615802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143615802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143615802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143615802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143615802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143615814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143615823 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143615823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143615823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:36:19.341701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1892): Terminating (SIGTERM) 14:36:19.382352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1895): Terminating (SIGTERM) 14:36:19.422494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1898): Terminating (SIGTERM) 14:36:19.463251 --- ParallelTerminationStrategy: PID 1892 died... 14:36:19.482761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1892): Terminated: ok {rc=0} 14:36:19.527907 --- ParallelTerminationStrategy: PID 1895 died... 14:36:19.547338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1895): Terminated: ok {rc=0} 14:36:19.592014 --- ParallelTerminationStrategy: PID 1898 died... 14:36:19.611248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1898): Terminated: ok {rc=0} 14:36:19.697866 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 14:36:20.786839 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:20.799013 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:36:20.838093 tst ping_idle_ping.py: using LAC 41572 14:36:20.958044 tst ping_idle_ping.py: using RAC 7 14:36:21.079573 tst ping_idle_ping.py: using CellId 41572 14:36:21.199062 tst ping_idle_ping.py: using BVCI 41573 14:36:21.317107 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:21.328660 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:21.340087 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:21.351553 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:21.363304 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:21.375072 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:21.387525 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:36:21.399297 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:36:21.518127 tst ping_idle_ping.py:24: start network... 14:36:21.719062 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:36:22.187708 run create_hlr_db(pid=1900): Launched 14:36:22.322196 bus /gobi_6: Setting Powered False 14:36:23.385858 run create_hlr_db(pid=1900): Terminated: ok {rc=0} 14:36:23.818080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1902): Launched 14:36:24.143367 run osmo-hlr_10.42.42.2(pid=1903): Launched 14:36:24.266528 run osmo-stp_10.42.42.5: Starting osmo-stp 14:36:24.823945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1905): Launched 14:36:25.146830 run osmo-stp_10.42.42.5(pid=1906): Launched 14:36:25.271780 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:36:25.827638 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1908): Launched 14:36:25.951976 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:36:26.224664 run patchelf(pid=1909): Launched 14:36:26.405343 run osmo-stp_10.42.42.5(pid=1906): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1906)] 14:36:26.542268 run osmo-stp_10.42.42.5(pid=1906): stdout: | (launched: 2022-12-14_14:36:25.087510) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:26.680075 run osmo-stp_10.42.42.5(pid=1906): stderr: | 20221214143625281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143625281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143625281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143625282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143625282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143625282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143625282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:26.817852 run osmo-stp_10.42.42.5(pid=1906): stdout: | (launched: 2022-12-14_14:36:25.087510) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:26.949797 run osmo-stp_10.42.42.5(pid=1906): stderr: | 20221214143625281 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143625281 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143625281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143625282 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143625282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143625282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143625282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:27.107145 run patchelf(pid=1909): Terminating (SIGINT) 14:36:27.287058 run patchelf(pid=1909): Terminated: ok {rc=0} 14:36:27.416714 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1906): Process ended prematurely: osmo-stp_10.42.42.5(pid=1906) [trial-2406↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1906)] [trial-2406↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 14:36:27.426455 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 14:36:27.454491 run osmo-hlr_10.42.42.2(pid=1903): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1903)] 14:36:27.505446 run osmo-hlr_10.42.42.2(pid=1903): stdout: | (launched: 2022-12-14_14:36:24.083559) 14:36:27.557753 run osmo-hlr_10.42.42.2(pid=1903): stderr: | 20221214143624282 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143624282 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143624282 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143624282 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143624282 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143624282 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143624295 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143624303 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143624303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143624303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:36:27.610340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1902): Terminating (SIGTERM) 14:36:27.652623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1905): Terminating (SIGTERM) 14:36:27.695322 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1908): Terminating (SIGTERM) 14:36:27.738101 --- ParallelTerminationStrategy: PID 1902 died... 14:36:27.758438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1902): Terminated: ok {rc=0} 14:36:27.805179 --- ParallelTerminationStrategy: PID 1905 died... 14:36:27.824894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1905): Terminated: ok {rc=0} 14:36:27.871461 --- ParallelTerminationStrategy: PID 1908 died... 14:36:27.891286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1908): Terminated: ok {rc=0} 14:36:27.980022 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 14:36:29.281969 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:36:29.288389 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 14:36:29.309698 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 14:36:29.349270 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 14:36:29.438547 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 14:36:29.459686 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 14:36:29.498943 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 14:36:30.094586 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 14:36:30.147082 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:30.158526 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:36:30.219862 tst cs_paging_gprs_active.py: using LAC 41573 14:36:30.346793 tst cs_paging_gprs_active.py: using RAC 8 14:36:30.473167 tst cs_paging_gprs_active.py: using CellId 41573 14:36:30.598943 tst cs_paging_gprs_active.py: using BVCI 41574 14:36:30.717396 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:30.728714 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:30.739846 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:30.751017 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:30.762109 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:30.773202 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:30.784348 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:30.795497 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:30.806816 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:36:30.952845 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:36:31.099211 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:36:31.325280 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:36:31.669892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1913): Launched 14:36:31.962918 run iperf3-srv_10.42.42.10(pid=1914): Launched 14:36:32.102982 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:36:32.325976 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:36:32.655906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1915): Launched 14:36:32.942335 run iperf3-srv_10.42.42.10(pid=1916): Launched 14:36:33.066143 tst cs_paging_gprs_active.py:38: start network... 14:36:33.288462 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:36:33.797974 run create_hlr_db(pid=1917): Launched 14:36:33.932575 bus /gobi_6: Setting Powered False 14:36:34.997377 run create_hlr_db(pid=1917): Terminated: ok {rc=0} 14:36:35.452143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1919): Launched 14:36:35.780606 run osmo-hlr_10.42.42.2(pid=1920): Launched 14:36:35.906025 run osmo-stp_10.42.42.5: Starting osmo-stp 14:36:36.471528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1922): Launched 14:36:36.800289 run osmo-stp_10.42.42.5(pid=1923): Launched 14:36:36.925502 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:36:37.489606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1925): Launched 14:36:37.615642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:36:37.892735 run patchelf(pid=1926): Launched 14:36:38.076127 run osmo-stp_10.42.42.5(pid=1923): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1923)] 14:36:38.215056 run osmo-stp_10.42.42.5(pid=1923): stdout: | (launched: 2022-12-14_14:36:36.740410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:38.355103 run osmo-stp_10.42.42.5(pid=1923): stderr: | 20221214143636935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143636935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143636935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143636936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143636936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143636936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143636936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:38.494824 run osmo-stp_10.42.42.5(pid=1923): stdout: | (launched: 2022-12-14_14:36:36.740410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:38.628704 run osmo-stp_10.42.42.5(pid=1923): stderr: | 20221214143636935 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143636935 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143636935 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143636936 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143636936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143636936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143636936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:38.787501 run patchelf(pid=1926): Terminating (SIGINT) 14:36:38.971061 run patchelf(pid=1926): Terminated: ok {rc=0} 14:36:39.103483 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1923): Process ended prematurely: osmo-stp_10.42.42.5(pid=1923) [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1923)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 14:36:39.113823 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 14:36:39.142594 run osmo-hlr_10.42.42.2(pid=1920): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1920)] 14:36:39.192819 run osmo-hlr_10.42.42.2(pid=1920): stdout: | (launched: 2022-12-14_14:36:35.720601) 14:36:39.244612 run osmo-hlr_10.42.42.2(pid=1920): stderr: | 20221214143635922 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143635922 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143635922 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143635922 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143635922 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143635923 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143635935 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143635943 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143635943 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143635943 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:36:39.296714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1913): Terminating (SIGTERM) 14:36:39.338832 run iperf3-srv_10.42.42.10(pid=1914): Terminating (SIGTERM) 14:36:39.380906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1915): Terminating (SIGTERM) 14:36:39.422861 run iperf3-srv_10.42.42.10(pid=1916): Terminating (SIGTERM) 14:36:39.464517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1919): Terminating (SIGTERM) 14:36:39.506640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1922): Terminating (SIGTERM) 14:36:39.549131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1925): Terminating (SIGTERM) 14:36:39.591193 --- ParallelTerminationStrategy: PID 1913 died... 14:36:39.611298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1913): Terminated: ok {rc=0} 14:36:39.657408 --- ParallelTerminationStrategy: PID 1914 died... 14:36:39.676772 run iperf3-srv_10.42.42.10(pid=1914): Terminated {rc=256} 14:36:39.722597 --- ParallelTerminationStrategy: PID 1915 died... 14:36:39.742099 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1915): Terminated: ok {rc=0} 14:36:39.787783 --- ParallelTerminationStrategy: PID 1916 died... 14:36:39.807379 run iperf3-srv_10.42.42.10(pid=1916): Terminated {rc=256} 14:36:39.853277 --- ParallelTerminationStrategy: PID 1919 died... 14:36:39.872749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1919): Terminated: ok {rc=0} 14:36:39.918326 --- ParallelTerminationStrategy: PID 1922 died... 14:36:39.937709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1922): Terminated: ok {rc=0} 14:36:39.983426 --- ParallelTerminationStrategy: PID 1925 died... 14:36:40.002866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1925): Terminated: ok {rc=0} 14:36:40.090972 bus /gobi_0: Setting Powered False 14:36:41.189783 bus /gobi_0: Setting Powered False 14:36:42.305027 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 14:36:43.455401 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:43.467586 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:36:43.527869 tst iperf3.py: using LAC 41574 14:36:43.657137 tst iperf3.py: using RAC 9 14:36:43.784669 tst iperf3.py: using CellId 41574 14:36:43.914060 tst iperf3.py: using BVCI 41575 14:36:44.034250 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:44.045702 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:44.056605 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:44.067795 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:44.079134 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:44.090200 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:44.101575 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:44.112499 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:44.123801 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:36:44.240711 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:36:44.461380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:36:44.789107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1927): Launched 14:36:45.074872 run iperf3-srv_10.42.42.10(pid=1928): Launched 14:36:45.199891 tst iperf3.py:8: start network... 14:36:45.420263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:36:45.949723 run create_hlr_db(pid=1931): Launched 14:36:46.122553 bus /gobi_6: Setting Powered False 14:36:47.191680 run create_hlr_db(pid=1931): Terminated: ok {rc=0} 14:36:47.647902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1933): Launched 14:36:47.975137 run osmo-hlr_10.42.42.2(pid=1934): Launched 14:36:48.100661 run osmo-stp_10.42.42.5: Starting osmo-stp 14:36:48.666537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1936): Launched 14:36:48.992563 run osmo-stp_10.42.42.5(pid=1937): Launched 14:36:49.117338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:36:49.680101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1939): Launched 14:36:49.805332 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:36:50.081309 run patchelf(pid=1940): Launched 14:36:50.263134 run osmo-stp_10.42.42.5(pid=1937): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1937)] 14:36:50.401572 run osmo-stp_10.42.42.5(pid=1937): stdout: | (launched: 2022-12-14_14:36:48.932608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:50.541169 run osmo-stp_10.42.42.5(pid=1937): stderr: | 20221214143649127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143649127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143649127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143649128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143649128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143649128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143649128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:50.680300 run osmo-stp_10.42.42.5(pid=1937): stdout: | (launched: 2022-12-14_14:36:48.932608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:36:50.814005 run osmo-stp_10.42.42.5(pid=1937): stderr: | 20221214143649127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143649127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143649127 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143649128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143649128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143649128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143649128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:36:50.971920 run patchelf(pid=1940): Terminating (SIGINT) 14:36:51.155003 run patchelf(pid=1940): Terminated: ok {rc=0} 14:36:51.287527 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1937): Process ended prematurely: osmo-stp_10.42.42.5(pid=1937) [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1937)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 14:36:51.298043 tst iperf3.py:8: Test FAILED (7.9 sec) 14:36:51.326441 run osmo-hlr_10.42.42.2(pid=1934): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1934)] 14:36:51.377134 run osmo-hlr_10.42.42.2(pid=1934): stdout: | (launched: 2022-12-14_14:36:47.915039) 14:36:51.429317 run osmo-hlr_10.42.42.2(pid=1934): stderr: | 20221214143648114 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143648114 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143648114 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143648114 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143648114 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143648114 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143648127 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143648135 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143648135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143648136 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:36:51.481893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1927): Terminating (SIGTERM) 14:36:51.524041 run iperf3-srv_10.42.42.10(pid=1928): Terminating (SIGTERM) 14:36:51.566622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1933): Terminating (SIGTERM) 14:36:51.609009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1936): Terminating (SIGTERM) 14:36:51.651319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1939): Terminating (SIGTERM) 14:36:51.693711 --- ParallelTerminationStrategy: PID 1927 died... 14:36:51.714028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1927): Terminated: ok {rc=0} 14:36:51.760557 --- ParallelTerminationStrategy: PID 1928 died... 14:36:51.780228 run iperf3-srv_10.42.42.10(pid=1928): Terminated {rc=256} 14:36:51.826561 --- ParallelTerminationStrategy: PID 1933 died... 14:36:51.846287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1933): Terminated: ok {rc=0} 14:36:51.892558 --- ParallelTerminationStrategy: PID 1936 died... 14:36:51.912367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1936): Terminated: ok {rc=0} 14:36:51.958485 --- ParallelTerminationStrategy: PID 1939 died... 14:36:51.978329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1939): Terminated: ok {rc=0} 14:36:52.066218 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 14:36:53.212009 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:53.223711 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:36:53.280362 tst iperf3m4.py: using LAC 41575 14:36:53.400928 tst iperf3m4.py: using RAC 10 14:36:53.519687 tst iperf3m4.py: using CellId 41575 14:36:53.640279 tst iperf3m4.py: using BVCI 41576 14:36:53.752142 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:53.763224 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:53.774001 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:53.784655 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:53.795727 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:53.806771 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:53.818053 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:53.829049 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:36:53.840214 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:36:53.956911 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:36:54.079116 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:36:54.197950 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:36:54.319196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:36:54.539694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:36:54.868514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1941): Launched 14:36:55.156019 run iperf3-srv_10.42.42.10(pid=1942): Launched 14:36:55.279953 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:36:55.500703 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:36:55.830218 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1943): Launched 14:36:56.116626 run iperf3-srv_10.42.42.10(pid=1944): Launched 14:36:56.239503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:36:56.459646 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:36:56.788928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1945): Launched 14:36:57.075994 run iperf3-srv_10.42.42.10(pid=1946): Launched 14:36:57.201061 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:36:57.422627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:36:57.752556 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1947): Launched 14:36:58.041113 run iperf3-srv_10.42.42.10(pid=1948): Launched 14:36:58.167361 tst iperf3m4.py:8: start network... 14:36:58.388498 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:36:58.898746 run create_hlr_db(pid=1949): Launched 14:36:59.031725 bus /gobi_6: Setting Powered False 14:37:00.095227 run create_hlr_db(pid=1949): Terminated: ok {rc=0} 14:37:00.532472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Launched 14:37:00.850810 run osmo-hlr_10.42.42.2(pid=1952): Launched 14:37:01.085203 run osmo-stp_10.42.42.5: Starting osmo-stp 14:37:01.768440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Launched 14:37:02.095000 run osmo-stp_10.42.42.5(pid=1955): Launched 14:37:02.384198 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:37:02.979492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1957): Launched 14:37:03.107441 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:37:03.385307 run patchelf(pid=1958): Launched 14:37:03.573196 run osmo-stp_10.42.42.5(pid=1955): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] 14:37:03.711974 run osmo-stp_10.42.42.5(pid=1955): stdout: | (launched: 2022-12-14_14:37:02.035410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:03.851380 run osmo-stp_10.42.42.5(pid=1955): stderr: | 20221214143702330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143702330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143702330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143702331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143702331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143702331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143702331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:03.990879 run osmo-stp_10.42.42.5(pid=1955): stdout: | (launched: 2022-12-14_14:37:02.035410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:04.125417 run osmo-stp_10.42.42.5(pid=1955): stderr: | 20221214143702330 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143702330 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143702330 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143702331 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143702331 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143702331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143702331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:04.283893 run patchelf(pid=1958): Terminating (SIGINT) 14:37:04.466738 run patchelf(pid=1958): Terminated: ok {rc=0} 14:37:04.598597 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1955): Process ended prematurely: osmo-stp_10.42.42.5(pid=1955) [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1955)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 14:37:04.608914 tst iperf3m4.py:8: Test FAILED (11.4 sec) 14:37:04.637910 run osmo-hlr_10.42.42.2(pid=1952): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1952)] 14:37:04.688242 run osmo-hlr_10.42.42.2(pid=1952): stdout: | (launched: 2022-12-14_14:37:00.784164) 14:37:04.740186 run osmo-hlr_10.42.42.2(pid=1952): stderr: | 20221214143701071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143701072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143701072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143701072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143701072 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143701072 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143701097 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143701123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143701123 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143701123 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:37:04.792467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1941): Terminating (SIGTERM) 14:37:04.834324 run iperf3-srv_10.42.42.10(pid=1942): Terminating (SIGTERM) 14:37:04.876167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1943): Terminating (SIGTERM) 14:37:04.918217 run iperf3-srv_10.42.42.10(pid=1944): Terminating (SIGTERM) 14:37:04.959961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1945): Terminating (SIGTERM) 14:37:05.002050 run iperf3-srv_10.42.42.10(pid=1946): Terminating (SIGTERM) 14:37:05.044031 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1947): Terminating (SIGTERM) 14:37:05.086382 run iperf3-srv_10.42.42.10(pid=1948): Terminating (SIGTERM) 14:37:05.128556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Terminating (SIGTERM) 14:37:05.170669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Terminating (SIGTERM) 14:37:05.212874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1957): Terminating (SIGTERM) 14:37:05.255324 --- ParallelTerminationStrategy: PID 1941 died... 14:37:05.275441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1941): Terminated: ok {rc=0} 14:37:05.321543 --- ParallelTerminationStrategy: PID 1942 died... 14:37:05.341788 run iperf3-srv_10.42.42.10(pid=1942): Terminated {rc=256} 14:37:05.387856 --- ParallelTerminationStrategy: PID 1943 died... 14:37:05.407484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1943): Terminated: ok {rc=0} 14:37:05.453906 --- ParallelTerminationStrategy: PID 1944 died... 14:37:05.473426 run iperf3-srv_10.42.42.10(pid=1944): Terminated {rc=256} 14:37:05.519378 --- ParallelTerminationStrategy: PID 1945 died... 14:37:05.539004 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1945): Terminated: ok {rc=0} 14:37:05.584842 --- ParallelTerminationStrategy: PID 1946 died... 14:37:05.604842 run iperf3-srv_10.42.42.10(pid=1946): Terminated {rc=256} 14:37:05.650739 --- ParallelTerminationStrategy: PID 1947 died... 14:37:05.670354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1947): Terminated: ok {rc=0} 14:37:05.716402 --- ParallelTerminationStrategy: PID 1948 died... 14:37:05.736001 run iperf3-srv_10.42.42.10(pid=1948): Terminated {rc=256} 14:37:05.781763 --- ParallelTerminationStrategy: PID 1951 died... 14:37:05.801528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1951): Terminated: ok {rc=0} 14:37:05.847429 --- ParallelTerminationStrategy: PID 1954 died... 14:37:05.866946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1954): Terminated: ok {rc=0} 14:37:05.912804 --- ParallelTerminationStrategy: PID 1957 died... 14:37:05.933092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1957): Terminated: ok {rc=0} 14:37:06.020733 bus /gobi_4: Setting Powered False 14:37:07.121386 bus /gobi_4: Setting Powered False 14:37:08.237088 bus /gobi_1: Setting Powered False 14:37:09.334554 bus /gobi_1: Setting Powered False 14:37:10.450644 bus /gobi_0: Setting Powered False 14:37:11.548485 bus /gobi_0: Setting Powered False 14:37:12.665121 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 14:37:13.769113 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:13.781362 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:37:13.840266 tst ping.py: using LAC 41576 14:37:13.967626 tst ping.py: using RAC 11 14:37:14.092798 tst ping.py: using CellId 41576 14:37:14.218291 tst ping.py: using BVCI 41577 14:37:14.336215 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:14.347888 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:14.359256 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:14.370661 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:14.381982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:14.393135 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:14.404407 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:14.415673 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:37:14.531751 tst ping.py:19: start network... 14:37:14.734504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:37:15.199386 run create_hlr_db(pid=1959): Launched 14:37:15.315176 bus /gobi_6: Setting Powered False 14:37:16.396684 run create_hlr_db(pid=1959): Terminated: ok {rc=0} 14:37:16.877966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Launched 14:37:17.226164 run osmo-hlr_10.42.42.2(pid=1962): Launched 14:37:17.341403 run osmo-stp_10.42.42.5: Starting osmo-stp 14:37:17.876319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Launched 14:37:18.175450 run osmo-stp_10.42.42.5(pid=1966): Launched 14:37:18.289730 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:37:18.806838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1968): Launched 14:37:18.922182 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:37:19.175086 run patchelf(pid=1969): Launched 14:37:19.342521 run osmo-stp_10.42.42.5(pid=1966): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1966)] 14:37:19.470665 run osmo-stp_10.42.42.5(pid=1966): stdout: | (launched: 2022-12-14_14:37:18.120305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:19.599036 run osmo-stp_10.42.42.5(pid=1966): stderr: | 20221214143718290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143718290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143718291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143718291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143718291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143718291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143718291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:19.727934 run osmo-stp_10.42.42.5(pid=1966): stdout: | (launched: 2022-12-14_14:37:18.120305) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:19.850872 run osmo-stp_10.42.42.5(pid=1966): stderr: | 20221214143718290 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143718290 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143718291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143718291 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143718291 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143718291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143718291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:19.996682 run patchelf(pid=1969): Terminating (SIGINT) 14:37:20.165924 run patchelf(pid=1969): Terminated: ok {rc=0} 14:37:20.287319 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1966): Process ended prematurely: osmo-stp_10.42.42.5(pid=1966) [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1966)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 14:37:20.296380 tst ping.py:22: Test FAILED (6.5 sec) 14:37:20.323661 run osmo-hlr_10.42.42.2(pid=1962): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1962)] 14:37:20.372444 run osmo-hlr_10.42.42.2(pid=1962): stdout: | (launched: 2022-12-14_14:37:17.168090) 14:37:20.422561 run osmo-hlr_10.42.42.2(pid=1962): stderr: | 20221214143717348 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143717348 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143717348 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143717348 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143717348 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143717348 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143717359 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143717368 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143717368 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143717368 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:37:20.472838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Terminating (SIGTERM) 14:37:20.513152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Terminating (SIGTERM) 14:37:20.553571 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1968): Terminating (SIGTERM) 14:37:20.594096 --- ParallelTerminationStrategy: PID 1961 died... 14:37:20.613731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Terminated: ok {rc=0} 14:37:20.658267 --- ParallelTerminationStrategy: PID 1965 died... 14:37:20.677367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Terminated: ok {rc=0} 14:37:20.721731 --- ParallelTerminationStrategy: PID 1968 died... 14:37:20.740726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1968): Terminated: ok {rc=0} 14:37:20.825519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 14:37:21.910061 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:21.921823 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:37:21.981674 tst ping_idle_ping.py: using LAC 41577 14:37:22.111900 tst ping_idle_ping.py: using RAC 12 14:37:22.237152 tst ping_idle_ping.py: using CellId 41577 14:37:22.363052 tst ping_idle_ping.py: using BVCI 41578 14:37:22.479607 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:22.491323 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:22.502766 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:22.514068 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:22.525647 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:22.537018 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:22.548565 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:37:22.560102 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:37:22.675573 tst ping_idle_ping.py:24: start network... 14:37:22.878049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:37:23.347089 run create_hlr_db(pid=1970): Launched 14:37:23.464888 bus /gobi_6: Setting Powered False 14:37:24.525193 run create_hlr_db(pid=1970): Terminated: ok {rc=0} 14:37:24.965967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1972): Launched 14:37:25.289541 run osmo-hlr_10.42.42.2(pid=1973): Launched 14:37:25.414412 run osmo-stp_10.42.42.5: Starting osmo-stp 14:37:25.974064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1975): Launched 14:37:26.296662 run osmo-stp_10.42.42.5(pid=1976): Launched 14:37:26.420680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:37:26.976445 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1978): Launched 14:37:27.101974 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:37:27.373729 run patchelf(pid=1979): Launched 14:37:27.555337 run osmo-stp_10.42.42.5(pid=1976): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1976)] 14:37:27.692333 run osmo-stp_10.42.42.5(pid=1976): stdout: | (launched: 2022-12-14_14:37:26.237704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:27.829876 run osmo-stp_10.42.42.5(pid=1976): stderr: | 20221214143726429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143726429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143726430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143726430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143726430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143726431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143726431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:27.967808 run osmo-stp_10.42.42.5(pid=1976): stdout: | (launched: 2022-12-14_14:37:26.237704) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:28.099763 run osmo-stp_10.42.42.5(pid=1976): stderr: | 20221214143726429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143726429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143726430 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143726430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143726430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143726431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143726431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:28.255923 run patchelf(pid=1979): Terminating (SIGINT) 14:37:28.436635 run patchelf(pid=1979): Terminated: ok {rc=0} 14:37:28.567060 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1976): Process ended prematurely: osmo-stp_10.42.42.5(pid=1976) [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1976)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 14:37:28.576579 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 14:37:28.604681 run osmo-hlr_10.42.42.2(pid=1973): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1973)] 14:37:28.654712 run osmo-hlr_10.42.42.2(pid=1973): stdout: | (launched: 2022-12-14_14:37:25.230527) 14:37:28.706637 run osmo-hlr_10.42.42.2(pid=1973): stderr: | 20221214143725428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143725428 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143725428 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143725428 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143725428 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143725429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143725440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143725448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143725449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143725449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:37:28.759221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1972): Terminating (SIGTERM) 14:37:28.801150 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1975): Terminating (SIGTERM) 14:37:28.843424 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1978): Terminating (SIGTERM) 14:37:28.885491 --- ParallelTerminationStrategy: PID 1972 died... 14:37:28.905544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1972): Terminated: ok {rc=0} 14:37:28.951787 --- ParallelTerminationStrategy: PID 1975 died... 14:37:28.971390 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1975): Terminated: ok {rc=0} 14:37:29.017540 --- ParallelTerminationStrategy: PID 1978 died... 14:37:29.037337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1978): Terminated: ok {rc=0} 14:37:29.124760 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:37:30.426136 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:37:30.433375 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:37:30.453749 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 14:37:30.492288 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 14:37:30.579767 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:37:30.600737 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 14:37:30.639754 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 14:37:31.269178 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 14:37:31.327167 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:31.339267 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:37:31.398832 tst cs_paging_gprs_active.py: using LAC 41578 14:37:31.522453 tst cs_paging_gprs_active.py: using RAC 13 14:37:31.656051 tst cs_paging_gprs_active.py: using CellId 41578 14:37:31.783011 tst cs_paging_gprs_active.py: using BVCI 41579 14:37:31.899154 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:31.912104 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:31.923585 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:31.934981 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:31.947991 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:31.961107 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:31.974091 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:31.986633 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:31.999535 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:37:32.120711 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:37:32.237617 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:37:32.444587 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:37:32.752253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1983): Launched 14:37:33.019369 run iperf3-srv_10.42.42.10(pid=1984): Launched 14:37:33.134907 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:37:33.339612 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:37:33.646932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1985): Launched 14:37:33.914487 run iperf3-srv_10.42.42.10(pid=1986): Launched 14:37:34.031601 tst cs_paging_gprs_active.py:38: start network... 14:37:34.235449 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:37:34.710353 run create_hlr_db(pid=1987): Launched 14:37:34.830573 bus /gobi_6: Setting Powered False 14:37:35.891563 run create_hlr_db(pid=1987): Terminated: ok {rc=0} 14:37:36.316667 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1989): Launched 14:37:36.623166 run osmo-hlr_10.42.42.2(pid=1990): Launched 14:37:36.740620 run osmo-stp_10.42.42.5: Starting osmo-stp 14:37:37.270400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1992): Launched 14:37:37.577676 run osmo-stp_10.42.42.5(pid=1993): Launched 14:37:37.697470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:37:38.224072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1995): Launched 14:37:38.342103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:37:38.600913 run patchelf(pid=1996): Launched 14:37:38.772175 run osmo-stp_10.42.42.5(pid=1993): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1993)] 14:37:38.901886 run osmo-stp_10.42.42.5(pid=1993): stdout: | (launched: 2022-12-14_14:37:37.520755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:39.033160 run osmo-stp_10.42.42.5(pid=1993): stderr: | 20221214143737695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143737695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143737695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143737696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143737696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143737696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143737696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:39.164212 run osmo-stp_10.42.42.5(pid=1993): stdout: | (launched: 2022-12-14_14:37:37.520755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:39.290101 run osmo-stp_10.42.42.5(pid=1993): stderr: | 20221214143737695 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143737695 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143737695 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143737696 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143737696 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143737696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143737696 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:39.438930 run patchelf(pid=1996): Terminating (SIGINT) 14:37:39.611300 run patchelf(pid=1996): Terminated: ok {rc=0} 14:37:39.734937 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1993): Process ended prematurely: osmo-stp_10.42.42.5(pid=1993) [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1993)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 14:37:39.744414 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 14:37:39.771416 run osmo-hlr_10.42.42.2(pid=1990): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1990)] 14:37:39.819395 run osmo-hlr_10.42.42.2(pid=1990): stdout: | (launched: 2022-12-14_14:37:36.566918) 14:37:39.868832 run osmo-hlr_10.42.42.2(pid=1990): stderr: | 20221214143736746 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143736746 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143736746 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143736746 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143736746 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143736746 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143736758 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143736767 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143736767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143736767 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:37:39.918836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1983): Terminating (SIGTERM) 14:37:39.959055 run iperf3-srv_10.42.42.10(pid=1984): Terminating (SIGTERM) 14:37:39.998878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1985): Terminating (SIGTERM) 14:37:40.038976 run iperf3-srv_10.42.42.10(pid=1986): Terminating (SIGTERM) 14:37:40.078864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1989): Terminating (SIGTERM) 14:37:40.118971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1992): Terminating (SIGTERM) 14:37:40.158715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1995): Terminating (SIGTERM) 14:37:40.198843 --- ParallelTerminationStrategy: PID 1983 died... 14:37:40.218123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1983): Terminated: ok {rc=0} 14:37:40.261973 --- ParallelTerminationStrategy: PID 1984 died... 14:37:40.280688 run iperf3-srv_10.42.42.10(pid=1984): Terminated {rc=256} 14:37:40.324405 --- ParallelTerminationStrategy: PID 1985 died... 14:37:40.343235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1985): Terminated: ok {rc=0} 14:37:40.386943 --- ParallelTerminationStrategy: PID 1986 died... 14:37:40.405640 run iperf3-srv_10.42.42.10(pid=1986): Terminated {rc=256} 14:37:40.449417 --- ParallelTerminationStrategy: PID 1989 died... 14:37:40.468021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1989): Terminated: ok {rc=0} 14:37:40.511671 --- ParallelTerminationStrategy: PID 1992 died... 14:37:40.530420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1992): Terminated: ok {rc=0} 14:37:40.574173 --- ParallelTerminationStrategy: PID 1995 died... 14:37:40.592860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1995): Terminated: ok {rc=0} 14:37:40.678913 bus /gobi_0: Setting Powered False 14:37:41.777625 bus /gobi_0: Setting Powered False 14:37:42.890809 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 14:37:44.034192 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:44.045788 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:37:44.105905 tst iperf3.py: using LAC 41579 14:37:44.235261 tst iperf3.py: using RAC 14 14:37:44.362584 tst iperf3.py: using CellId 41579 14:37:44.491615 tst iperf3.py: using BVCI 41580 14:37:44.609475 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:44.621088 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:44.632137 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:44.643231 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:44.654361 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:44.665539 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:44.676739 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:44.687822 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:44.699167 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:37:44.814694 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:37:45.019544 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:37:45.325800 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1997): Launched 14:37:45.591959 run iperf3-srv_10.42.42.10(pid=1998): Launched 14:37:45.707873 tst iperf3.py:8: start network... 14:37:45.922283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:37:46.437745 run create_hlr_db(pid=1999): Launched 14:37:46.599901 bus /gobi_6: Setting Powered False 14:37:47.661429 run create_hlr_db(pid=1999): Terminated: ok {rc=0} 14:37:48.088707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2001): Launched 14:37:48.395447 run osmo-hlr_10.42.42.2(pid=2002): Launched 14:37:48.511842 run osmo-stp_10.42.42.5: Starting osmo-stp 14:37:49.053682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2004): Launched 14:37:49.358745 run osmo-stp_10.42.42.5(pid=2005): Launched 14:37:49.475582 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:37:50.004233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2007): Launched 14:37:50.122212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:37:50.381156 run patchelf(pid=2008): Launched 14:37:50.551800 run osmo-stp_10.42.42.5(pid=2005): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2005)] 14:37:50.681759 run osmo-stp_10.42.42.5(pid=2005): stdout: | (launched: 2022-12-14_14:37:49.302620) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:50.812646 run osmo-stp_10.42.42.5(pid=2005): stderr: | 20221214143749473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143749473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143749473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143749474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143749474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143749474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143749474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:50.943380 run osmo-stp_10.42.42.5(pid=2005): stdout: | (launched: 2022-12-14_14:37:49.302620) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:37:51.068506 run osmo-stp_10.42.42.5(pid=2005): stderr: | 20221214143749473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143749473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143749473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143749474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143749474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143749474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143749474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:37:51.216752 run patchelf(pid=2008): Terminating (SIGINT) 14:37:51.388637 run patchelf(pid=2008): Terminated: ok {rc=0} 14:37:51.512793 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2005): Process ended prematurely: osmo-stp_10.42.42.5(pid=2005) [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2005)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 14:37:51.522491 tst iperf3.py:8: Test FAILED (7.5 sec) 14:37:51.549709 run osmo-hlr_10.42.42.2(pid=2002): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2002)] 14:37:51.598107 run osmo-hlr_10.42.42.2(pid=2002): stdout: | (launched: 2022-12-14_14:37:48.338735) 14:37:51.647759 run osmo-hlr_10.42.42.2(pid=2002): stderr: | 20221214143748517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143748517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143748517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143748517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143748517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143748517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143748530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143748538 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143748538 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143748538 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:37:51.698424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1997): Terminating (SIGTERM) 14:37:51.738976 run iperf3-srv_10.42.42.10(pid=1998): Terminating (SIGTERM) 14:37:51.779278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2001): Terminating (SIGTERM) 14:37:51.820412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2004): Terminating (SIGTERM) 14:37:51.860630 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2007): Terminating (SIGTERM) 14:37:51.901269 --- ParallelTerminationStrategy: PID 1997 died... 14:37:51.920546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1997): Terminated: ok {rc=0} 14:37:51.965085 --- ParallelTerminationStrategy: PID 1998 died... 14:37:51.983957 run iperf3-srv_10.42.42.10(pid=1998): Terminated {rc=256} 14:37:52.027873 --- ParallelTerminationStrategy: PID 2001 died... 14:37:52.046751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2001): Terminated: ok {rc=0} 14:37:52.090967 --- ParallelTerminationStrategy: PID 2004 died... 14:37:52.109998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2004): Terminated: ok {rc=0} 14:37:52.154077 --- ParallelTerminationStrategy: PID 2007 died... 14:37:52.173066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2007): Terminated: ok {rc=0} 14:37:52.261409 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 14:37:53.412396 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:53.424599 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:37:53.484850 tst iperf3m4.py: using LAC 41580 14:37:53.614728 tst iperf3m4.py: using RAC 15 14:37:53.748873 tst iperf3m4.py: using CellId 41580 14:37:53.876608 tst iperf3m4.py: using BVCI 41581 14:37:53.995030 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:54.006421 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:54.017530 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:54.028587 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:54.039739 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:54.050899 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:54.062668 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:54.073792 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:37:54.085057 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:37:54.201871 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:37:54.322993 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:37:54.440240 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:37:54.560811 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:37:54.782236 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:37:55.110615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2009): Launched 14:37:55.397221 run iperf3-srv_10.42.42.10(pid=2010): Launched 14:37:55.519375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:37:55.738943 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:37:56.066680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2011): Launched 14:37:56.350992 run iperf3-srv_10.42.42.10(pid=2012): Launched 14:37:56.474761 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:37:56.693875 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:37:57.021319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2013): Launched 14:37:57.305958 run iperf3-srv_10.42.42.10(pid=2014): Launched 14:37:57.429624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:37:57.647887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:37:57.975494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2015): Launched 14:37:58.261589 run iperf3-srv_10.42.42.10(pid=2016): Launched 14:37:58.383440 tst iperf3m4.py:8: start network... 14:37:58.602578 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:37:59.108902 run create_hlr_db(pid=2017): Launched 14:37:59.241572 bus /gobi_6: Setting Powered False 14:38:00.305827 run create_hlr_db(pid=2017): Terminated: ok {rc=0} 14:38:00.741533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2019): Launched 14:38:01.066219 run osmo-hlr_10.42.42.2(pid=2020): Launched 14:38:01.327498 run osmo-stp_10.42.42.5: Starting osmo-stp 14:38:01.969510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2022): Launched 14:38:02.313861 run osmo-stp_10.42.42.5(pid=2023): Launched 14:38:02.449517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:38:03.017344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2025): Launched 14:38:03.143401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:38:03.420039 run patchelf(pid=2026): Launched 14:38:03.602292 run osmo-stp_10.42.42.5(pid=2023): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2023)] 14:38:03.740353 run osmo-stp_10.42.42.5(pid=2023): stdout: | (launched: 2022-12-14_14:38:02.253131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:03.879648 run osmo-stp_10.42.42.5(pid=2023): stderr: | 20221214143802511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143802512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143802512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143802512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143802513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143802513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143802513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:04.018627 run osmo-stp_10.42.42.5(pid=2023): stdout: | (launched: 2022-12-14_14:38:02.253131) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:04.152634 run osmo-stp_10.42.42.5(pid=2023): stderr: | 20221214143802511 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143802512 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143802512 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143802512 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143802513 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143802513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143802513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:04.310828 run patchelf(pid=2026): Terminating (SIGINT) 14:38:04.493193 run patchelf(pid=2026): Terminated: ok {rc=0} 14:38:04.624686 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2023): Process ended prematurely: osmo-stp_10.42.42.5(pid=2023) [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2023)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 14:38:04.634944 tst iperf3m4.py:8: Test FAILED (11.3 sec) 14:38:04.663665 run osmo-hlr_10.42.42.2(pid=2020): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2020)] 14:38:04.714043 run osmo-hlr_10.42.42.2(pid=2020): stdout: | (launched: 2022-12-14_14:38:01.000373) 14:38:04.765790 run osmo-hlr_10.42.42.2(pid=2020): stderr: | 20221214143801241 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143801241 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143801241 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143801241 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143801241 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143801241 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143801255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143801269 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143801269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143801269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:38:04.817932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2009): Terminating (SIGTERM) 14:38:04.859936 run iperf3-srv_10.42.42.10(pid=2010): Terminating (SIGTERM) 14:38:04.901902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2011): Terminating (SIGTERM) 14:38:04.943643 run iperf3-srv_10.42.42.10(pid=2012): Terminating (SIGTERM) 14:38:04.985493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2013): Terminating (SIGTERM) 14:38:05.027345 run iperf3-srv_10.42.42.10(pid=2014): Terminating (SIGTERM) 14:38:05.069476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2015): Terminating (SIGTERM) 14:38:05.111460 run iperf3-srv_10.42.42.10(pid=2016): Terminating (SIGTERM) 14:38:05.153265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2019): Terminating (SIGTERM) 14:38:05.195097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2022): Terminating (SIGTERM) 14:38:05.237076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2025): Terminating (SIGTERM) 14:38:05.279031 --- ParallelTerminationStrategy: PID 2009 died... 14:38:05.299178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2009): Terminated: ok {rc=0} 14:38:05.345286 --- ParallelTerminationStrategy: PID 2010 died... 14:38:05.364906 run iperf3-srv_10.42.42.10(pid=2010): Terminated {rc=256} 14:38:05.411150 --- ParallelTerminationStrategy: PID 2011 died... 14:38:05.430837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2011): Terminated: ok {rc=0} 14:38:05.476627 --- ParallelTerminationStrategy: PID 2012 died... 14:38:05.496241 run iperf3-srv_10.42.42.10(pid=2012): Terminated {rc=256} 14:38:05.541942 --- ParallelTerminationStrategy: PID 2013 died... 14:38:05.561726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2013): Terminated: ok {rc=0} 14:38:05.607572 --- ParallelTerminationStrategy: PID 2014 died... 14:38:05.627175 run iperf3-srv_10.42.42.10(pid=2014): Terminated {rc=256} 14:38:05.673175 --- ParallelTerminationStrategy: PID 2015 died... 14:38:05.692910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2015): Terminated: ok {rc=0} 14:38:05.738998 --- ParallelTerminationStrategy: PID 2016 died... 14:38:05.758711 run iperf3-srv_10.42.42.10(pid=2016): Terminated {rc=256} 14:38:05.804601 --- ParallelTerminationStrategy: PID 2019 died... 14:38:05.824516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2019): Terminated: ok {rc=0} 14:38:05.870885 --- ParallelTerminationStrategy: PID 2022 died... 14:38:05.890720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2022): Terminated: ok {rc=0} 14:38:05.936898 --- ParallelTerminationStrategy: PID 2025 died... 14:38:05.957140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2025): Terminated: ok {rc=0} 14:38:06.045671 bus /gobi_4: Setting Powered False 14:38:07.142504 bus /gobi_4: Setting Powered False 14:38:08.258695 bus /gobi_1: Setting Powered False 14:38:09.357363 bus /gobi_1: Setting Powered False 14:38:10.476589 bus /gobi_0: Setting Powered False 14:38:11.575787 bus /gobi_0: Setting Powered False 14:38:12.691787 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 14:38:13.795894 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:13.808496 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:38:13.867848 tst ping.py: using LAC 41581 14:38:13.987191 tst ping.py: using RAC 16 14:38:14.106919 tst ping.py: using CellId 41581 14:38:14.225452 tst ping.py: using BVCI 41582 14:38:14.343196 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:14.354760 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:14.366135 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:14.377382 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:14.388926 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:14.401571 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:14.413839 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:14.425457 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:38:14.544754 tst ping.py:19: start network... 14:38:14.762718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:38:15.260463 run create_hlr_db(pid=2027): Launched 14:38:15.391365 bus /gobi_6: Setting Powered False 14:38:16.461830 run create_hlr_db(pid=2027): Terminated: ok {rc=0} 14:38:16.906500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2029): Launched 14:38:17.233759 run osmo-hlr_10.42.42.2(pid=2030): Launched 14:38:17.361648 run osmo-stp_10.42.42.5: Starting osmo-stp 14:38:17.923338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2032): Launched 14:38:18.246618 run osmo-stp_10.42.42.5(pid=2033): Launched 14:38:18.370037 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:38:18.921569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2035): Launched 14:38:19.044584 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:38:19.316352 run patchelf(pid=2036): Launched 14:38:19.495120 run osmo-stp_10.42.42.5(pid=2033): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2033)] 14:38:19.631275 run osmo-stp_10.42.42.5(pid=2033): stdout: | (launched: 2022-12-14_14:38:18.187939) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:19.768821 run osmo-stp_10.42.42.5(pid=2033): stderr: | 20221214143818380 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143818380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143818380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143818381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143818381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143818381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143818381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:19.906411 run osmo-stp_10.42.42.5(pid=2033): stdout: | (launched: 2022-12-14_14:38:18.187939) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:20.038984 run osmo-stp_10.42.42.5(pid=2033): stderr: | 20221214143818380 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143818380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143818380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143818381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143818381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143818381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143818381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:20.195060 run patchelf(pid=2036): Terminating (SIGINT) 14:38:20.374302 run patchelf(pid=2036): Terminated: ok {rc=0} 14:38:20.503308 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2033): Process ended prematurely: osmo-stp_10.42.42.5(pid=2033) [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2033)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 14:38:20.512908 tst ping.py:22: Test FAILED (6.7 sec) 14:38:20.541316 run osmo-hlr_10.42.42.2(pid=2030): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2030)] 14:38:20.592093 run osmo-hlr_10.42.42.2(pid=2030): stdout: | (launched: 2022-12-14_14:38:17.171631) 14:38:20.644400 run osmo-hlr_10.42.42.2(pid=2030): stderr: | 20221214143817382 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143817382 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143817382 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143817382 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143817382 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143817382 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143817394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143817402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143817402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143817403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:38:20.697073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2029): Terminating (SIGTERM) 14:38:20.739293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2032): Terminating (SIGTERM) 14:38:20.781618 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2035): Terminating (SIGTERM) 14:38:20.823716 --- ParallelTerminationStrategy: PID 2029 died... 14:38:20.843675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2029): Terminated: ok {rc=0} 14:38:20.890090 --- ParallelTerminationStrategy: PID 2032 died... 14:38:20.909715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2032): Terminated: ok {rc=0} 14:38:20.955799 --- ParallelTerminationStrategy: PID 2035 died... 14:38:20.975387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2035): Terminated: ok {rc=0} 14:38:21.063403 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 14:38:22.150715 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:22.162853 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:38:22.224551 tst ping_idle_ping.py: using LAC 41582 14:38:22.354382 tst ping_idle_ping.py: using RAC 17 14:38:22.479567 tst ping_idle_ping.py: using CellId 41582 14:38:22.604816 tst ping_idle_ping.py: using BVCI 41583 14:38:22.722086 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:22.733612 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:22.744775 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:22.755993 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:22.767557 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:22.779182 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:22.791016 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:38:22.802784 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:38:22.919963 tst ping_idle_ping.py:24: start network... 14:38:23.122134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:38:23.593244 run create_hlr_db(pid=2037): Launched 14:38:23.708853 bus /gobi_6: Setting Powered False 14:38:24.769226 run create_hlr_db(pid=2037): Terminated: ok {rc=0} 14:38:25.190705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2039): Launched 14:38:25.492750 run osmo-hlr_10.42.42.2(pid=2040): Launched 14:38:25.608478 run osmo-stp_10.42.42.5: Starting osmo-stp 14:38:26.143099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2042): Launched 14:38:26.445138 run osmo-stp_10.42.42.5(pid=2043): Launched 14:38:26.561386 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:38:27.080018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2045): Launched 14:38:27.195649 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:38:27.449307 run patchelf(pid=2046): Launched 14:38:27.616506 run osmo-stp_10.42.42.5(pid=2043): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2043)] 14:38:27.744356 run osmo-stp_10.42.42.5(pid=2043): stdout: | (launched: 2022-12-14_14:38:26.389062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:27.873217 run osmo-stp_10.42.42.5(pid=2043): stderr: | 20221214143826559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143826560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143826560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143826560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143826563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143826563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143826563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:28.002621 run osmo-stp_10.42.42.5(pid=2043): stdout: | (launched: 2022-12-14_14:38:26.389062) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:28.126098 run osmo-stp_10.42.42.5(pid=2043): stderr: | 20221214143826559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143826560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143826560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143826560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143826563 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143826563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143826563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:28.271309 run patchelf(pid=2046): Terminating (SIGINT) 14:38:28.440371 run patchelf(pid=2046): Terminated: ok {rc=0} 14:38:28.562563 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2043): Process ended prematurely: osmo-stp_10.42.42.5(pid=2043) [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2043)] [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 14:38:28.571674 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 14:38:28.598200 run osmo-hlr_10.42.42.2(pid=2040): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2040)] 14:38:28.646553 run osmo-hlr_10.42.42.2(pid=2040): stdout: | (launched: 2022-12-14_14:38:25.437325) 14:38:28.696421 run osmo-hlr_10.42.42.2(pid=2040): stderr: | 20221214143825614 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143825614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143825614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143825614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143825614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143825614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143825627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143825635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143825635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143825635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:38:28.746640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2039): Terminating (SIGTERM) 14:38:28.787068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2042): Terminating (SIGTERM) 14:38:28.827473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2045): Terminating (SIGTERM) 14:38:28.868207 --- ParallelTerminationStrategy: PID 2039 died... 14:38:28.887937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2039): Terminated: ok {rc=0} 14:38:28.933052 --- ParallelTerminationStrategy: PID 2042 died... 14:38:28.952364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2042): Terminated: ok {rc=0} 14:38:28.997072 --- ParallelTerminationStrategy: PID 2045 died... 14:38:29.016160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2045): Terminated: ok {rc=0} 14:38:29.104321 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:38:30.397364 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:38:30.404916 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:38:30.426493 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 14:38:30.462370 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:38:30.518813 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:38:30.539097 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 14:38:30.573755 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:38:31.142358 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2406 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 14:38:31.150309 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:38:31.167115 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:38:31.239597 tst switch_tch_pdch.py: using LAC 41583 14:38:31.401051 tst switch_tch_pdch.py: using RAC 18 14:38:31.551186 tst switch_tch_pdch.py: using CellId 41583 14:38:31.726276 tst switch_tch_pdch.py: using BVCI 41584 14:38:31.863380 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:38:31.876335 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:38:31.888760 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:38:31.902257 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:38:31.915667 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:38:31.929174 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:38:31.942412 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:38:31.955491 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:38:32.106244 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:38:32.225928 tst switch_tch_pdch.py:51: start network... 14:38:32.443838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:38:32.941491 run create_hlr_db(pid=2052): Launched 14:38:33.073282 bus /gobi_6: Setting Powered False 14:38:34.136772 run create_hlr_db(pid=2052): Terminated: ok {rc=0} 14:38:34.568077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Launched 14:38:34.870148 run osmo-hlr_10.42.42.2(pid=2055): Launched 14:38:34.987210 run osmo-stp_10.42.42.5: Starting osmo-stp 14:38:35.520769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Launched 14:38:35.820566 run osmo-stp_10.42.42.5(pid=2058): Launched 14:38:35.936746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:38:36.454753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2060): Launched 14:38:36.571001 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:38:36.823982 run patchelf(pid=2061): Launched 14:38:36.991586 run osmo-stp_10.42.42.5(pid=2058): ERR: Terminated: ERROR {rc=1} [trial-2406↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] 14:38:37.119207 run osmo-stp_10.42.42.5(pid=2058): stdout: | (launched: 2022-12-14_14:38:35.765192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:37.247920 run osmo-stp_10.42.42.5(pid=2058): stderr: | 20221214143835933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143835933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143835934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143835934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143835936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143835936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143835936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:37.376476 run osmo-stp_10.42.42.5(pid=2058): stdout: | (launched: 2022-12-14_14:38:35.765192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:37.499473 run osmo-stp_10.42.42.5(pid=2058): stderr: | 20221214143835933 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143835933 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143835934 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143835934 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143835936 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143835936 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143835936 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:37.644812 run patchelf(pid=2061): Terminating (SIGINT) 14:38:37.812875 run patchelf(pid=2061): Terminated: ok {rc=0} 14:38:37.934198 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2058): Process ended prematurely: osmo-stp_10.42.42.5(pid=2058) [trial-2406↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] [trial-2406↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 14:38:37.943166 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 14:38:37.969925 run osmo-hlr_10.42.42.2(pid=2055): ERR: Terminated: ERROR {rc=237} [trial-2406↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2055)] 14:38:38.018481 run osmo-hlr_10.42.42.2(pid=2055): stdout: | (launched: 2022-12-14_14:38:34.814357) 14:38:38.068336 run osmo-hlr_10.42.42.2(pid=2055): stderr: | 20221214143834993 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143834993 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143834993 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143834993 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143834993 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143834993 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143835006 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143835014 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143835014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143835014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:38:38.118416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Terminating (SIGTERM) 14:38:38.158708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Terminating (SIGTERM) 14:38:38.198901 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2060): Terminating (SIGTERM) 14:38:38.239166 --- ParallelTerminationStrategy: PID 2054 died... 14:38:38.258628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Terminated: ok {rc=0} 14:38:38.302830 --- ParallelTerminationStrategy: PID 2057 died... 14:38:38.321673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Terminated: ok {rc=0} 14:38:38.365779 --- ParallelTerminationStrategy: PID 2060 died... 14:38:38.384576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2060): Terminated: ok {rc=0} 14:38:38.470999 bus /gobi_0: Setting Powered False 14:38:39.569683 bus /gobi_0: Setting Powered False 14:38:40.684123 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 14:38:41.919273 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:38:41.924930 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 14:38:41.945298 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 14:38:41.979899 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 14:38:42.032830 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 14:38:42.053240 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 14:38:42.087547 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 14:38:42.641532 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2406 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 14:38:42.646778 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:38:42.657884 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 14:38:42.715749 tst switch_tch_pdch.py: using LAC 41584 14:38:42.838531 tst switch_tch_pdch.py: using RAC 19 14:38:42.956047 tst switch_tch_pdch.py: using CellId 41584 14:38:43.072190 tst switch_tch_pdch.py: using BVCI 41585 14:38:43.180829 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:38:43.191816 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:38:43.202776 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:38:43.213432 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:38:43.224810 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:38:43.236242 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:38:43.248051 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:38:43.259656 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:38:43.379805 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:38:43.495050 tst switch_tch_pdch.py:51: start network... 14:38:43.697140 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:38:44.137084 run create_hlr_db(pid=2066): Launched 14:38:44.251784 bus /gobi_6: Setting Powered False 14:38:45.311031 run create_hlr_db(pid=2066): Terminated: ok {rc=0} 14:38:45.723611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2068): Launched 14:38:46.067827 run osmo-hlr_10.42.42.2(pid=2069): Launched 14:38:46.285916 run osmo-stp_10.42.42.5: Starting osmo-stp 14:38:46.905274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2071): Launched 14:38:47.239786 run osmo-stp_10.42.42.5(pid=2072): Launched 14:38:47.358366 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:38:47.851739 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2074): Launched 14:38:47.966670 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:38:48.220226 run patchelf(pid=2075): Launched 14:38:48.387422 run osmo-stp_10.42.42.5(pid=2072): ERR: Terminated: ERROR {rc=1} [trial-2406↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2072)] 14:38:48.514557 run osmo-stp_10.42.42.5(pid=2072): stdout: | (launched: 2022-12-14_14:38:47.181360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:48.642777 run osmo-stp_10.42.42.5(pid=2072): stderr: | 20221214143847351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143847352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143847352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143847352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143847354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143847355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143847355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:48.771134 run osmo-stp_10.42.42.5(pid=2072): stdout: | (launched: 2022-12-14_14:38:47.181360) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:38:48.893227 run osmo-stp_10.42.42.5(pid=2072): stderr: | 20221214143847351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143847352 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143847352 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143847352 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143847354 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143847355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143847355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:38:49.038371 run patchelf(pid=2075): Terminating (SIGINT) 14:38:49.206987 run patchelf(pid=2075): Terminated: ok {rc=0} 14:38:49.328129 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2072): Process ended prematurely: osmo-stp_10.42.42.5(pid=2072) [trial-2406↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2072)] [trial-2406↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 14:38:49.337204 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 14:38:49.363780 run osmo-hlr_10.42.42.2(pid=2069): ERR: Terminated: ERROR {rc=237} [trial-2406↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2069)] 14:38:49.412237 run osmo-hlr_10.42.42.2(pid=2069): stdout: | (launched: 2022-12-14_14:38:46.011326) 14:38:49.462190 run osmo-hlr_10.42.42.2(pid=2069): stderr: | 20221214143846326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143846326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143846326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143846326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143846326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143846326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143846349 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143846366 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143846366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143846366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:38:49.512587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2068): Terminating (SIGTERM) 14:38:49.553081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2071): Terminating (SIGTERM) 14:38:49.593797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2074): Terminating (SIGTERM) 14:38:49.634567 --- ParallelTerminationStrategy: PID 2068 died... 14:38:49.653955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2068): Terminated: ok {rc=0} 14:38:49.698994 --- ParallelTerminationStrategy: PID 2071 died... 14:38:49.717872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2071): Terminated: ok {rc=0} 14:38:49.762173 --- ParallelTerminationStrategy: PID 2074 died... 14:38:49.781109 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2074): Terminated: ok {rc=0} 14:38:49.867779 bus /gobi_0: Setting Powered False 14:38:50.968020 bus /gobi_0: Setting Powered False 14:38:52.084804 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 nitb_sms:trx-b200 --------------------------------------------------------------------- 14:38:53.317474 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:38:53.321354 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 14:38:53.353939 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 14:38:53.362180 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 14:38:53.416428 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 14:38:53.450326 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 14:38:53.457410 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 14:38:53.993939 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 14:38:53.999222 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 14:38:54.010052 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 14:38:54.061442 tst mo_mt_sms.py: using LAC 41585 14:38:54.179165 tst mo_mt_sms.py: using RAC 20 14:38:54.294338 tst mo_mt_sms.py: using CellId 41585 14:38:54.409327 tst mo_mt_sms.py: using BVCI 41586 14:38:54.517585 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 14:38:54.635873 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 14:38:54.753495 tst mo_mt_sms.py:9: start nitb and bts... 14:38:54.971212 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:38:55.625577 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2079): Launched 14:38:55.949223 run osmo-nitb_10.42.42.2(pid=2080): Launched 14:38:56.129522 run osmo-nitb_10.42.42.2(pid=2080): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2080)] 14:38:56.274594 run osmo-nitb_10.42.42.2(pid=2080): stdout: | (launched: 2022-12-14_14:38:55.890117) 14:38:56.420856 run osmo-nitb_10.42.42.2(pid=2080): stderr: | (launched: 2022-12-14_14:38:55.938118) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:38:56.566598 run osmo-nitb_10.42.42.2(pid=2080): stdout: | (launched: 2022-12-14_14:38:55.890117) 14:38:56.706573 run osmo-nitb_10.42.42.2(pid=2080): stderr: | (launched: 2022-12-14_14:38:55.938118) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2080): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2080) [trial-2406↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2080)] 14:38:57.072308 tst osmo-nitb_10.42.42.2(pid=2080): stdout: | (launched: 2022-12-14_14:38:55.890117) 14:38:57.202004 tst osmo-nitb_10.42.42.2(pid=2080): stderr: | (launched: 2022-12-14_14:38:55.938118) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:38:57.354158 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2080): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2080) [trial-2406↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2080)] [trial-2406↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 14:38:57.363358 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 14:38:57.370561 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2079): Terminating (SIGTERM) 14:38:57.581485 --- ParallelTerminationStrategy: PID 2079 died... 14:38:57.603574 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2079): Terminated: ok {rc=0} 14:38:57.690666 bus /sierra_3: Setting Powered False 14:38:58.789799 bus /sierra_3: Setting Powered False 14:38:59.906159 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 sms:trx-b200 --------------------------------------------------------------------- 14:39:01.116907 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:39:01.121963 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 14:39:01.155837 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 14:39:01.186242 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 14:39:01.240098 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 14:39:01.280284 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 14:39:01.308878 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 14:39:01.885364 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 14:39:01.891564 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:01.903613 tst sms:trx-b200: Using 1 x bts (candidates: 1) 14:39:01.961373 tst mo_mt_sms.py: using LAC 41586 14:39:02.104373 tst mo_mt_sms.py: using RAC 21 14:39:02.251474 tst mo_mt_sms.py: using CellId 41586 14:39:02.395174 tst mo_mt_sms.py: using BVCI 41587 14:39:02.507016 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:02.518673 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:02.536794 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:02.549793 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:02.565676 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:02.582535 tst sms:trx-b200: Using 1 x modem (candidates: 2) 14:39:02.707530 tst sms:trx-b200: Using 1 x modem (candidates: 2) 14:39:02.871403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:39:03.433744 run create_hlr_db(pid=2189): Launched 14:39:03.614152 bus /sierra_2: Setting Powered False 14:39:04.674851 run create_hlr_db(pid=2189): Terminated: ok {rc=0} 14:39:05.152055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2355): Launched 14:39:05.489762 run osmo-hlr_10.42.42.2(pid=2356): Launched 14:39:05.738651 run osmo-stp_10.42.42.5: Starting osmo-stp 14:39:06.408177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2359): Launched 14:39:06.741695 run osmo-stp_10.42.42.5(pid=2361): Launched 14:39:06.983172 run osmo-msc_10.42.42.6: Starting osmo-msc 14:39:07.649054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2363): Launched 14:39:07.989111 run osmo-msc_10.42.42.6(pid=2364): Launched 14:39:08.343055 run osmo-stp_10.42.42.5(pid=2361): ERR: Terminated: ERROR {rc=1} [trial-2406↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2361)] 14:39:08.623348 run osmo-stp_10.42.42.5(pid=2361): stdout: | (launched: 2022-12-14_14:39:06.671324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:08.797924 run osmo-stp_10.42.42.5(pid=2361): stderr: | 20221214143906965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143906965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143906966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143906966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143906967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143906967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143906967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:08.934172 run osmo-stp_10.42.42.5(pid=2361): stdout: | (launched: 2022-12-14_14:39:06.671324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:09.066651 run osmo-stp_10.42.42.5(pid=2361): stderr: | 20221214143906965 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143906965 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143906966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143906966 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143906967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143906967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143906967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:09.222983 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2361): Process ended prematurely: osmo-stp_10.42.42.5(pid=2361) [trial-2406↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2361)] [trial-2406↪sms:trx-b200↪mo_mt_sms.py:16] 14:39:09.233051 tst mo_mt_sms.py:16: Test FAILED (7.3 sec) 14:39:09.262162 run osmo-hlr_10.42.42.2(pid=2356): ERR: Terminated: ERROR {rc=237} [trial-2406↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2356)] 14:39:09.314807 run osmo-hlr_10.42.42.2(pid=2356): stdout: | (launched: 2022-12-14_14:39:05.430834) 14:39:09.370099 run osmo-hlr_10.42.42.2(pid=2356): stderr: | 20221214143905735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143905735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143905735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143905735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143905735 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143905735 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143905759 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143905776 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143905776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143905776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:39:09.445402 run osmo-msc_10.42.42.6(pid=2364): ERR: Terminated: ERROR {rc=2} [trial-2406↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2364)] 14:39:09.497692 run osmo-msc_10.42.42.6(pid=2364): stdout: | (launched: 2022-12-14_14:39:07.927490) 14:39:09.551936 run osmo-msc_10.42.42.6(pid=2364): stderr: | 20221214143908420 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143908420 DLGLOBAL DEBUG validating counter group 0x7ff39a5ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143908420 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143908420 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143908420 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143908429 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143908431 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143908431 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143908431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143908431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:39:09.606150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2355): Terminating (SIGTERM) 14:39:09.650326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2359): Terminating (SIGTERM) 14:39:09.696795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2363): Terminating (SIGTERM) 14:39:09.742824 --- ParallelTerminationStrategy: PID 2355 died... 14:39:09.763940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2355): Terminated: ok {rc=0} 14:39:09.813636 --- ParallelTerminationStrategy: PID 2359 died... 14:39:09.834258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2359): Terminated: ok {rc=0} 14:39:09.882124 --- ParallelTerminationStrategy: PID 2363 died... 14:39:09.903556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2363): Terminated: ok {rc=0} 14:39:09.995685 bus /sierra_3: Setting Powered False 14:39:11.099577 bus /sierra_3: Setting Powered False 14:39:12.223713 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 nitb_ussd:trx-b200 --------------------------------------------------------------------- 14:39:13.456425 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:39:13.460934 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 14:39:13.494966 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 14:39:13.505452 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 14:39:13.542698 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 14:39:13.578092 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 14:39:13.587201 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 14:39:14.100622 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2406 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 14:39:14.107235 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 14:39:14.119499 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 14:39:14.174102 tst assert_extension.py: using LAC 41587 14:39:14.297035 tst assert_extension.py: using RAC 22 14:39:14.419536 tst assert_extension.py: using CellId 41587 14:39:14.542553 tst assert_extension.py: using BVCI 41588 14:39:14.655468 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 14:39:14.774427 tst assert_extension.py:10: start nitb and bts... 14:39:14.983593 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:39:15.618784 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2369): Launched 14:39:15.947722 run osmo-nitb_10.42.42.2(pid=2370): Launched 14:39:16.142345 run osmo-nitb_10.42.42.2(pid=2370): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2370)] 14:39:16.281461 run osmo-nitb_10.42.42.2(pid=2370): stdout: | (launched: 2022-12-14_14:39:15.885128) 14:39:16.424330 run osmo-nitb_10.42.42.2(pid=2370): stderr: | (launched: 2022-12-14_14:39:15.936461) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:39:16.566236 run osmo-nitb_10.42.42.2(pid=2370): stdout: | (launched: 2022-12-14_14:39:15.885128) 14:39:16.703247 run osmo-nitb_10.42.42.2(pid=2370): stderr: | (launched: 2022-12-14_14:39:15.936461) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2370): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2370) [trial-2406↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2370)] 14:39:17.085737 tst osmo-nitb_10.42.42.2(pid=2370): stdout: | (launched: 2022-12-14_14:39:15.885128) 14:39:17.233229 tst osmo-nitb_10.42.42.2(pid=2370): stderr: | (launched: 2022-12-14_14:39:15.936461) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:39:17.407254 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2370): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2370) [trial-2406↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2370)] [trial-2406↪nitb_ussd:trx-b200↪assert_extension.py:12] 14:39:17.417803 tst assert_extension.py:12: Test FAILED (3.3 sec) 14:39:17.427075 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2369): Terminating (SIGTERM) 14:39:17.644639 --- ParallelTerminationStrategy: PID 2369 died... 14:39:17.669471 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2369): Terminated: ok {rc=0} 14:39:17.766234 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 ussd:trx-b200 --------------------------------------------------------------------- 14:39:18.977661 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:39:18.982438 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 14:39:19.019053 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 14:39:19.048077 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 14:39:19.084151 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 14:39:19.119688 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 14:39:19.149352 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 14:39:19.676559 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2406 ussd:trx-b200 assert_extension.py ---------------------------------------------- 14:39:19.683405 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:19.696657 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 14:39:19.753435 tst assert_extension.py: using LAC 41588 14:39:19.881494 tst assert_extension.py: using RAC 23 14:39:20.011341 tst assert_extension.py: using CellId 41588 14:39:20.139721 tst assert_extension.py: using BVCI 41589 14:39:20.260592 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:20.272696 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:20.284701 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:20.297114 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:20.309815 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 14:39:20.322879 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 14:39:20.448729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:39:20.967647 run create_hlr_db(pid=2374): Launched 14:39:21.120720 bus /sierra_2: Setting Powered False 14:39:22.186500 run create_hlr_db(pid=2374): Terminated: ok {rc=0} 14:39:22.655587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2376): Launched 14:39:22.998720 run osmo-hlr_10.42.42.2(pid=2377): Launched 14:39:23.250603 run osmo-stp_10.42.42.5: Starting osmo-stp 14:39:23.930461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2379): Launched 14:39:24.276939 run osmo-stp_10.42.42.5(pid=2380): Launched 14:39:24.533270 run osmo-msc_10.42.42.6: Starting osmo-msc 14:39:25.186595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2383): Launched 14:39:25.488145 run osmo-msc_10.42.42.6(pid=2384): Launched 14:39:25.655639 run osmo-stp_10.42.42.5(pid=2380): ERR: Terminated: ERROR {rc=1} [trial-2406↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2380)] 14:39:25.784793 run osmo-stp_10.42.42.5(pid=2380): stdout: | (launched: 2022-12-14_14:39:24.214437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:25.911990 run osmo-stp_10.42.42.5(pid=2380): stderr: | 20221214143924515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143924516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143924516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143924516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143924522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143924522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143924522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:26.037449 run osmo-stp_10.42.42.5(pid=2380): stdout: | (launched: 2022-12-14_14:39:24.214437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:26.156592 run osmo-stp_10.42.42.5(pid=2380): stderr: | 20221214143924515 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143924516 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143924516 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143924516 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143924522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143924522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143924522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:26.298879 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2380): Process ended prematurely: osmo-stp_10.42.42.5(pid=2380) [trial-2406↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2380)] [trial-2406↪ussd:trx-b200↪assert_extension.py:17] 14:39:26.307237 tst assert_extension.py:17: Test FAILED (6.6 sec) 14:39:26.333542 run osmo-hlr_10.42.42.2(pid=2377): ERR: Terminated: ERROR {rc=237} [trial-2406↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2377)] 14:39:26.382252 run osmo-hlr_10.42.42.2(pid=2377): stdout: | (launched: 2022-12-14_14:39:22.938216) 14:39:26.432294 run osmo-hlr_10.42.42.2(pid=2377): stderr: | 20221214143923252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143923253 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143923253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143923253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143923253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143923253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143923273 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143923286 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143923286 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143923286 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:39:26.502651 run osmo-msc_10.42.42.6(pid=2384): ERR: Terminated: ERROR {rc=2} [trial-2406↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2384)] 14:39:26.550534 run osmo-msc_10.42.42.6(pid=2384): stdout: | (launched: 2022-12-14_14:39:25.432529) 14:39:26.600552 run osmo-msc_10.42.42.6(pid=2384): stderr: | 20221214143925706 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143925706 DLGLOBAL DEBUG validating counter group 0x7f394a764c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143925707 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143925707 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143925707 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143925707 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143925709 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143925709 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143925709 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143925709 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:39:26.650967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2376): Terminating (SIGTERM) 14:39:26.691516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2379): Terminating (SIGTERM) 14:39:26.731909 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2383): Terminating (SIGTERM) 14:39:26.772390 --- ParallelTerminationStrategy: PID 2376 died... 14:39:26.791935 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2376): Terminated: ok {rc=0} 14:39:26.836353 --- ParallelTerminationStrategy: PID 2379 died... 14:39:26.855352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2379): Terminated: ok {rc=0} 14:39:26.899572 --- ParallelTerminationStrategy: PID 2383 died... 14:39:26.918642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2383): Terminated: ok {rc=0} 14:39:27.003332 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 14:39:28.214540 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:39:28.221067 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 14:39:28.253457 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 14:39:28.281459 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 14:39:28.332707 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 14:39:28.365213 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 14:39:28.392013 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 14:39:28.942666 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 14:39:28.993891 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:29.004930 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:39:29.074728 tst mo_mt_call.py: using LAC 41589 14:39:29.196593 tst mo_mt_call.py: using RAC 24 14:39:29.317582 tst mo_mt_call.py: using CellId 41589 14:39:29.437931 tst mo_mt_call.py: using BVCI 41590 14:39:29.550325 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:29.561412 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:29.572332 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:29.583167 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:29.594596 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:29.605902 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:39:29.725766 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:39:29.843208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:39:30.317435 run create_hlr_db(pid=2390): Launched 14:39:30.433983 bus /sierra_2: Setting Powered False 14:39:31.498655 run create_hlr_db(pid=2390): Terminated: ok {rc=0} 14:39:31.968315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2392): Launched 14:39:32.289609 run osmo-hlr_10.42.42.2(pid=2393): Launched 14:39:32.406356 run osmo-stp_10.42.42.5: Starting osmo-stp 14:39:32.947256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2395): Launched 14:39:33.253788 run osmo-stp_10.42.42.5(pid=2396): Launched 14:39:33.371251 run osmo-msc_10.42.42.6: Starting osmo-msc 14:39:33.924594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2398): Launched 14:39:34.231729 run osmo-msc_10.42.42.6(pid=2399): Launched 14:39:34.402167 run osmo-stp_10.42.42.5(pid=2396): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2396)] 14:39:34.531733 run osmo-stp_10.42.42.5(pid=2396): stdout: | (launched: 2022-12-14_14:39:33.196841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:34.661560 run osmo-stp_10.42.42.5(pid=2396): stderr: | 20221214143933370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143933370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143933370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143933370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143933371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143933371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143933371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:34.789470 run osmo-stp_10.42.42.5(pid=2396): stdout: | (launched: 2022-12-14_14:39:33.196841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:34.910501 run osmo-stp_10.42.42.5(pid=2396): stderr: | 20221214143933370 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143933370 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143933370 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143933370 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143933371 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143933371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143933371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:35.055248 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2396): Process ended prematurely: osmo-stp_10.42.42.5(pid=2396) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2396)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 14:39:35.064459 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 14:39:35.090938 run osmo-hlr_10.42.42.2(pid=2393): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2393)] 14:39:35.139635 run osmo-hlr_10.42.42.2(pid=2393): stdout: | (launched: 2022-12-14_14:39:32.233574) 14:39:35.189309 run osmo-hlr_10.42.42.2(pid=2393): stderr: | 20221214143932411 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143932411 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143932411 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143932411 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143932411 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143932411 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143932422 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143932430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143932431 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143932431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:39:35.258770 run osmo-msc_10.42.42.6(pid=2399): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2399)] 14:39:35.306367 run osmo-msc_10.42.42.6(pid=2399): stdout: | (launched: 2022-12-14_14:39:34.174832) 14:39:35.355852 run osmo-msc_10.42.42.6(pid=2399): stderr: | 20221214143934446 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143934446 DLGLOBAL DEBUG validating counter group 0x7f3fd653bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143934446 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143934446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143934446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143934447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143934448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143934449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143934449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143934449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:39:35.405720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2392): Terminating (SIGTERM) 14:39:35.445479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2395): Terminating (SIGTERM) 14:39:35.485294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2398): Terminating (SIGTERM) 14:39:35.525980 --- ParallelTerminationStrategy: PID 2392 died... 14:39:35.545356 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2392): Terminated: ok {rc=0} 14:39:35.589625 --- ParallelTerminationStrategy: PID 2395 died... 14:39:35.608458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2395): Terminated: ok {rc=0} 14:39:35.652901 --- ParallelTerminationStrategy: PID 2398 died... 14:39:35.672305 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2398): Terminated: ok {rc=0} 14:39:35.759976 bus /sierra_3: Setting Powered False 14:39:36.858892 bus /sierra_3: Setting Powered False 14:39:37.974775 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 14:39:39.126484 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:39.138829 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:39:39.210615 tst mo_mt_call_osmux.py: using LAC 41590 14:39:39.339876 tst mo_mt_call_osmux.py: using RAC 25 14:39:39.468144 tst mo_mt_call_osmux.py: using CellId 41590 14:39:39.596244 tst mo_mt_call_osmux.py: using BVCI 41591 14:39:39.715956 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:39.727528 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:39.738854 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:39.750455 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:39.761888 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:39:39.773233 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:39:39.889954 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:39:40.010444 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:39:40.517063 run create_hlr_db(pid=2401): Launched 14:39:40.650591 bus /sierra_2: Setting Powered False 14:39:41.715399 run create_hlr_db(pid=2401): Terminated: ok {rc=0} 14:39:42.154555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2403): Launched 14:39:42.463726 run osmo-hlr_10.42.42.2(pid=2404): Launched 14:39:42.581797 run osmo-stp_10.42.42.5: Starting osmo-stp 14:39:43.123084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2406): Launched 14:39:43.430233 run osmo-stp_10.42.42.5(pid=2407): Launched 14:39:43.549291 run osmo-msc_10.42.42.6: Starting osmo-msc 14:39:44.106168 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2409): Launched 14:39:44.412038 run osmo-msc_10.42.42.6(pid=2410): Launched 14:39:44.584734 run osmo-stp_10.42.42.5(pid=2407): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2407)] 14:39:44.714654 run osmo-stp_10.42.42.5(pid=2407): stdout: | (launched: 2022-12-14_14:39:43.373755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:44.843967 run osmo-stp_10.42.42.5(pid=2407): stderr: | 20221214143943543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143943544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143943544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143943544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143943546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143943547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143943547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:44.971335 run osmo-stp_10.42.42.5(pid=2407): stdout: | (launched: 2022-12-14_14:39:43.373755) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:45.092134 run osmo-stp_10.42.42.5(pid=2407): stderr: | 20221214143943543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143943544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143943544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143943544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143943546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143943547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143943547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:45.237054 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2407): Process ended prematurely: osmo-stp_10.42.42.5(pid=2407) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2407)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 14:39:45.246034 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:39:45.272507 run osmo-hlr_10.42.42.2(pid=2404): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2404)] 14:39:45.321297 run osmo-hlr_10.42.42.2(pid=2404): stdout: | (launched: 2022-12-14_14:39:42.406767) 14:39:45.371532 run osmo-hlr_10.42.42.2(pid=2404): stderr: | 20221214143942583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143942583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143942583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143942583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143942583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143942583 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143942595 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143942603 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143942603 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143942603 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:39:45.441488 run osmo-msc_10.42.42.6(pid=2410): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2410)] 14:39:45.489443 run osmo-msc_10.42.42.6(pid=2410): stdout: | (launched: 2022-12-14_14:39:44.355726) 14:39:45.539353 run osmo-msc_10.42.42.6(pid=2410): stderr: | 20221214143944628 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143944629 DLGLOBAL DEBUG validating counter group 0x7fd3457cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143944629 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143944629 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143944629 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143944629 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143944631 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143944631 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143944631 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143944632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:39:45.589688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2403): Terminating (SIGTERM) 14:39:45.630199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2406): Terminating (SIGTERM) 14:39:45.670609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2409): Terminating (SIGTERM) 14:39:45.710842 --- ParallelTerminationStrategy: PID 2403 died... 14:39:45.730144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2403): Terminated: ok {rc=0} 14:39:45.774437 --- ParallelTerminationStrategy: PID 2406 died... 14:39:45.793333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2406): Terminated: ok {rc=0} 14:39:45.841419 --- ParallelTerminationStrategy: PID 2409 died... 14:39:45.876592 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2409): Terminated: ok {rc=0} 14:39:45.973323 bus /sierra_3: Setting Powered False 14:39:47.069785 bus /sierra_3: Setting Powered False 14:39:48.182823 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 14:39:49.437985 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:39:49.445061 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 14:39:49.479046 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 14:39:49.506731 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 14:39:49.559255 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 14:39:49.593377 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 14:39:49.620541 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 14:39:50.170622 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 14:39:50.219786 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:39:50.230898 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:39:50.299327 tst mo_mt_call.py: using LAC 41591 14:39:50.418949 tst mo_mt_call.py: using RAC 26 14:39:50.540357 tst mo_mt_call.py: using CellId 41591 14:39:50.665511 tst mo_mt_call.py: using BVCI 41592 14:39:50.786436 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:39:50.798421 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:39:50.810042 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:39:50.821642 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:39:50.833301 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:39:50.844884 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:39:50.961125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:39:51.080788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:39:51.588588 run create_hlr_db(pid=2416): Launched 14:39:51.721305 bus /sierra_2: Setting Powered False 14:39:52.782288 run create_hlr_db(pid=2416): Terminated: ok {rc=0} 14:39:53.239090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2418): Launched 14:39:53.568384 run osmo-hlr_10.42.42.2(pid=2419): Launched 14:39:53.693331 run osmo-stp_10.42.42.5: Starting osmo-stp 14:39:54.257676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2421): Launched 14:39:54.584859 run osmo-stp_10.42.42.5(pid=2422): Launched 14:39:54.709401 run osmo-msc_10.42.42.6: Starting osmo-msc 14:39:55.299582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2424): Launched 14:39:55.629332 run osmo-msc_10.42.42.6(pid=2425): Launched 14:39:55.811263 run osmo-stp_10.42.42.5(pid=2422): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2422)] 14:39:55.948852 run osmo-stp_10.42.42.5(pid=2422): stdout: | (launched: 2022-12-14_14:39:54.524177) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:56.087353 run osmo-stp_10.42.42.5(pid=2422): stderr: | 20221214143954719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143954719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143954719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143954720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143954720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143954720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143954720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:56.225660 run osmo-stp_10.42.42.5(pid=2422): stdout: | (launched: 2022-12-14_14:39:54.524177) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:39:56.355303 run osmo-stp_10.42.42.5(pid=2422): stderr: | 20221214143954719 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214143954719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214143954719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214143954720 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214143954720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214143954720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214143954720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:39:56.510883 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2422): Process ended prematurely: osmo-stp_10.42.42.5(pid=2422) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2422)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 14:39:56.520436 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:39:56.548216 run osmo-hlr_10.42.42.2(pid=2419): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2419)] 14:39:56.598342 run osmo-hlr_10.42.42.2(pid=2419): stdout: | (launched: 2022-12-14_14:39:53.507947) 14:39:56.650136 run osmo-hlr_10.42.42.2(pid=2419): stderr: | 20221214143953708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214143953708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214143953708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214143953708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214143953708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214143953708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214143953721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214143953730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214143953730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214143953730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:39:56.722468 run osmo-msc_10.42.42.6(pid=2425): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2425)] 14:39:56.772198 run osmo-msc_10.42.42.6(pid=2425): stdout: | (launched: 2022-12-14_14:39:55.569087) 14:39:56.823810 run osmo-msc_10.42.42.6(pid=2425): stderr: | 20221214143955893 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214143955893 DLGLOBAL DEBUG validating counter group 0x7fddac727c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214143955894 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214143955894 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214143955894 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214143955894 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214143955896 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214143955896 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214143955896 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214143955896 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:39:56.875796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2418): Terminating (SIGTERM) 14:39:56.917367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2421): Terminating (SIGTERM) 14:39:56.959120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2424): Terminating (SIGTERM) 14:39:57.001102 --- ParallelTerminationStrategy: PID 2418 died... 14:39:57.021098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2418): Terminated: ok {rc=0} 14:39:57.066971 --- ParallelTerminationStrategy: PID 2421 died... 14:39:57.086505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2421): Terminated: ok {rc=0} 14:39:57.133275 --- ParallelTerminationStrategy: PID 2424 died... 14:39:57.152813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2424): Terminated: ok {rc=0} 14:39:57.242006 bus /sierra_3: Setting Powered False 14:39:58.341136 bus /sierra_3: Setting Powered False 14:39:59.458813 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 14:40:00.604622 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:40:00.616416 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:40:00.685918 tst mo_mt_call_osmux.py: using LAC 41592 14:40:00.807071 tst mo_mt_call_osmux.py: using RAC 27 14:40:00.956826 tst mo_mt_call_osmux.py: using CellId 41592 14:40:01.081320 tst mo_mt_call_osmux.py: using BVCI 41593 14:40:01.242522 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:40:01.257650 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:40:01.272578 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:40:01.289621 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:40:01.306519 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:40:01.323187 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:40:01.470988 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:40:01.618338 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:40:02.200510 run create_hlr_db(pid=2430): Launched 14:40:02.380560 bus /sierra_2: Setting Powered False 14:40:03.442014 run create_hlr_db(pid=2430): Terminated: ok {rc=0} 14:40:03.889325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2432): Launched 14:40:04.219144 run osmo-hlr_10.42.42.2(pid=2433): Launched 14:40:04.344568 run osmo-stp_10.42.42.5: Starting osmo-stp 14:40:04.909281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2435): Launched 14:40:05.237047 run osmo-stp_10.42.42.5(pid=2436): Launched 14:40:05.363288 run osmo-msc_10.42.42.6: Starting osmo-msc 14:40:05.960492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2438): Launched 14:40:06.290331 run osmo-msc_10.42.42.6(pid=2439): Launched 14:40:06.475175 run osmo-stp_10.42.42.5(pid=2436): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2436)] 14:40:06.612443 run osmo-stp_10.42.42.5(pid=2436): stdout: | (launched: 2022-12-14_14:40:05.176805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:06.750523 run osmo-stp_10.42.42.5(pid=2436): stderr: | 20221214144005373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144005373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144005373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144005373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144005374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144005374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144005374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:06.888842 run osmo-stp_10.42.42.5(pid=2436): stdout: | (launched: 2022-12-14_14:40:05.176805) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:07.018976 run osmo-stp_10.42.42.5(pid=2436): stderr: | 20221214144005373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144005373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144005373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144005373 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144005374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144005374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144005374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:07.174739 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2436): Process ended prematurely: osmo-stp_10.42.42.5(pid=2436) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2436)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 14:40:07.184502 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 14:40:07.212510 run osmo-hlr_10.42.42.2(pid=2433): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2433)] 14:40:07.262603 run osmo-hlr_10.42.42.2(pid=2433): stdout: | (launched: 2022-12-14_14:40:04.158688) 14:40:07.314600 run osmo-hlr_10.42.42.2(pid=2433): stderr: | 20221214144004357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144004357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144004357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144004358 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144004358 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144004358 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144004411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144004422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144004422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144004422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:40:07.386762 run osmo-msc_10.42.42.6(pid=2439): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2439)] 14:40:07.436883 run osmo-msc_10.42.42.6(pid=2439): stdout: | (launched: 2022-12-14_14:40:06.229778) 14:40:07.490116 run osmo-msc_10.42.42.6(pid=2439): stderr: | 20221214144006555 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144006555 DLGLOBAL DEBUG validating counter group 0x7f1e1ba6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144006556 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144006556 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144006556 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144006556 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144006558 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144006558 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144006558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144006558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:40:07.542153 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2432): Terminating (SIGTERM) 14:40:07.584112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2435): Terminating (SIGTERM) 14:40:07.626085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2438): Terminating (SIGTERM) 14:40:07.668527 --- ParallelTerminationStrategy: PID 2432 died... 14:40:07.688580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2432): Terminated: ok {rc=0} 14:40:07.734623 --- ParallelTerminationStrategy: PID 2435 died... 14:40:07.754129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2435): Terminated: ok {rc=0} 14:40:07.799975 --- ParallelTerminationStrategy: PID 2438 died... 14:40:07.819493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2438): Terminated: ok {rc=0} 14:40:07.907186 bus /sierra_3: Setting Powered False 14:40:09.006622 bus /sierra_3: Setting Powered False 14:40:10.123701 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 14:40:11.375339 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:40:11.382458 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 14:40:11.416379 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 14:40:11.444185 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 14:40:11.496664 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 14:40:11.530455 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 14:40:11.557461 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 14:40:12.107036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 14:40:12.157561 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:12.168660 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:40:12.239131 tst mo_mt_call.py: using LAC 41593 14:40:12.363867 tst mo_mt_call.py: using RAC 28 14:40:12.483467 tst mo_mt_call.py: using CellId 41593 14:40:12.602769 tst mo_mt_call.py: using BVCI 41594 14:40:12.714806 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:12.725859 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:12.737270 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:12.748116 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:12.759497 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:12.770932 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:40:12.889903 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:40:13.010396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:40:13.518245 run create_hlr_db(pid=2445): Launched 14:40:13.652235 bus /sierra_2: Setting Powered False 14:40:14.717236 run create_hlr_db(pid=2445): Terminated: ok {rc=0} 14:40:15.173776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2447): Launched 14:40:15.501322 run osmo-hlr_10.42.42.2(pid=2448): Launched 14:40:15.631343 run osmo-stp_10.42.42.5: Starting osmo-stp 14:40:16.225641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2450): Launched 14:40:16.667830 run osmo-stp_10.42.42.5(pid=2451): Launched 14:40:16.858090 run osmo-msc_10.42.42.6: Starting osmo-msc 14:40:17.561485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2453): Launched 14:40:17.868188 run osmo-msc_10.42.42.6(pid=2454): Launched 14:40:18.039358 run osmo-stp_10.42.42.5(pid=2451): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2451)] 14:40:18.178933 run osmo-stp_10.42.42.5(pid=2451): stdout: | (launched: 2022-12-14_14:40:16.591206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:18.318386 run osmo-stp_10.42.42.5(pid=2451): stderr: | 20221214144016893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144016893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144016894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144016894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144016895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144016895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144016895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:18.454499 run osmo-stp_10.42.42.5(pid=2451): stdout: | (launched: 2022-12-14_14:40:16.591206) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:18.584772 run osmo-stp_10.42.42.5(pid=2451): stderr: | 20221214144016893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144016893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144016894 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144016894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144016895 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144016895 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144016895 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:18.740289 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2451): Process ended prematurely: osmo-stp_10.42.42.5(pid=2451) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2451)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 14:40:18.750291 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 14:40:18.778239 run osmo-hlr_10.42.42.2(pid=2448): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2448)] 14:40:18.828218 run osmo-hlr_10.42.42.2(pid=2448): stdout: | (launched: 2022-12-14_14:40:15.441704) 14:40:18.880409 run osmo-hlr_10.42.42.2(pid=2448): stderr: | 20221214144015642 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144015642 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144015642 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144015642 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144015642 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144015642 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144015655 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144015666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144015666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144015666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:40:18.952005 run osmo-msc_10.42.42.6(pid=2454): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2454)] 14:40:19.001876 run osmo-msc_10.42.42.6(pid=2454): stdout: | (launched: 2022-12-14_14:40:17.811456) 14:40:19.053595 run osmo-msc_10.42.42.6(pid=2454): stderr: | 20221214144018085 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144018085 DLGLOBAL DEBUG validating counter group 0x7f2787203c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144018085 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144018085 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144018085 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144018085 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144018087 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144018087 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144018088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144018088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:40:19.105644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2447): Terminating (SIGTERM) 14:40:19.147731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2450): Terminating (SIGTERM) 14:40:19.189486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2453): Terminating (SIGTERM) 14:40:19.231291 --- ParallelTerminationStrategy: PID 2447 died... 14:40:19.251275 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2447): Terminated: ok {rc=0} 14:40:19.297473 --- ParallelTerminationStrategy: PID 2450 died... 14:40:19.317096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2450): Terminated: ok {rc=0} 14:40:19.363068 --- ParallelTerminationStrategy: PID 2453 died... 14:40:19.382771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2453): Terminated: ok {rc=0} 14:40:19.471131 bus /sierra_3: Setting Powered False 14:40:20.570565 bus /sierra_3: Setting Powered False 14:40:21.687000 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 14:40:22.831905 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:22.843767 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:40:22.918197 tst mo_mt_call_osmux.py: using LAC 41594 14:40:23.037719 tst mo_mt_call_osmux.py: using RAC 29 14:40:23.161416 tst mo_mt_call_osmux.py: using CellId 41594 14:40:23.290365 tst mo_mt_call_osmux.py: using BVCI 41595 14:40:23.411583 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:23.423527 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:23.435108 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:23.446762 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:23.458649 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:40:23.470348 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:40:23.586909 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:40:23.702279 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:40:24.177707 run create_hlr_db(pid=2456): Launched 14:40:24.295756 bus /sierra_2: Setting Powered False 14:40:25.357405 run create_hlr_db(pid=2456): Terminated: ok {rc=0} 14:40:25.784389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2458): Launched 14:40:26.091803 run osmo-hlr_10.42.42.2(pid=2459): Launched 14:40:26.209205 run osmo-stp_10.42.42.5: Starting osmo-stp 14:40:26.751283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2461): Launched 14:40:27.058578 run osmo-stp_10.42.42.5(pid=2462): Launched 14:40:27.176154 run osmo-msc_10.42.42.6: Starting osmo-msc 14:40:27.729179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2464): Launched 14:40:28.036509 run osmo-msc_10.42.42.6(pid=2465): Launched 14:40:28.208413 run osmo-stp_10.42.42.5(pid=2462): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2462)] 14:40:28.338394 run osmo-stp_10.42.42.5(pid=2462): stdout: | (launched: 2022-12-14_14:40:27.002251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:28.468125 run osmo-stp_10.42.42.5(pid=2462): stderr: | 20221214144027174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144027174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144027174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144027174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144027177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144027177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144027177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:28.595645 run osmo-stp_10.42.42.5(pid=2462): stdout: | (launched: 2022-12-14_14:40:27.002251) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:28.716806 run osmo-stp_10.42.42.5(pid=2462): stderr: | 20221214144027174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144027174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144027174 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144027174 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144027177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144027177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144027177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:28.861871 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2462): Process ended prematurely: osmo-stp_10.42.42.5(pid=2462) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2462)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 14:40:28.870799 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 14:40:28.897181 run osmo-hlr_10.42.42.2(pid=2459): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2459)] 14:40:28.945373 run osmo-hlr_10.42.42.2(pid=2459): stdout: | (launched: 2022-12-14_14:40:26.035471) 14:40:28.994682 run osmo-hlr_10.42.42.2(pid=2459): stderr: | 20221214144026215 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144026215 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144026215 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144026215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144026215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144026216 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144026228 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144026236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144026236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144026236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:40:29.063675 run osmo-msc_10.42.42.6(pid=2465): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2465)] 14:40:29.111146 run osmo-msc_10.42.42.6(pid=2465): stdout: | (launched: 2022-12-14_14:40:27.979372) 14:40:29.160344 run osmo-msc_10.42.42.6(pid=2465): stderr: | 20221214144028251 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144028252 DLGLOBAL DEBUG validating counter group 0x7f0133980c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144028252 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144028252 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144028252 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144028252 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144028254 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144028254 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144028254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144028254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:40:29.209539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2458): Terminating (SIGTERM) 14:40:29.249273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2461): Terminating (SIGTERM) 14:40:29.288998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2464): Terminating (SIGTERM) 14:40:29.328877 --- ParallelTerminationStrategy: PID 2458 died... 14:40:29.348134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2458): Terminated: ok {rc=0} 14:40:29.392094 --- ParallelTerminationStrategy: PID 2461 died... 14:40:29.410891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2461): Terminated: ok {rc=0} 14:40:29.454569 --- ParallelTerminationStrategy: PID 2464 died... 14:40:29.473308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2464): Terminated: ok {rc=0} 14:40:29.557243 bus /sierra_3: Setting Powered False 14:40:30.653595 bus /sierra_3: Setting Powered False 14:40:31.785249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 14:40:33.052214 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:40:33.060123 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 14:40:33.094267 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 14:40:33.120642 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 14:40:33.175086 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 14:40:33.209548 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 14:40:33.236757 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 14:40:33.785932 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 14:40:33.837580 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:33.848557 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:40:33.920208 tst mo_mt_call.py: using LAC 41595 14:40:34.037994 tst mo_mt_call.py: using RAC 30 14:40:34.157729 tst mo_mt_call.py: using CellId 41595 14:40:34.277740 tst mo_mt_call.py: using BVCI 41596 14:40:34.390046 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:34.401044 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:34.411736 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:34.422501 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:34.433811 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:34.444881 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:40:34.560321 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:40:34.681251 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:40:35.188460 run create_hlr_db(pid=2471): Launched 14:40:35.321423 bus /sierra_2: Setting Powered False 14:40:36.386029 run create_hlr_db(pid=2471): Terminated: ok {rc=0} 14:40:36.842197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2473): Launched 14:40:37.172587 run osmo-hlr_10.42.42.2(pid=2474): Launched 14:40:37.297527 run osmo-stp_10.42.42.5: Starting osmo-stp 14:40:37.863518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2476): Launched 14:40:38.193148 run osmo-stp_10.42.42.5(pid=2477): Launched 14:40:38.317249 run osmo-msc_10.42.42.6: Starting osmo-msc 14:40:38.912942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2479): Launched 14:40:39.244913 run osmo-msc_10.42.42.6(pid=2480): Launched 14:40:39.428101 run osmo-stp_10.42.42.5(pid=2477): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2477)] 14:40:39.565747 run osmo-stp_10.42.42.5(pid=2477): stdout: | (launched: 2022-12-14_14:40:38.131883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:39.704512 run osmo-stp_10.42.42.5(pid=2477): stderr: | 20221214144038326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144038326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144038326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144038326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144038327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144038327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144038327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:39.841785 run osmo-stp_10.42.42.5(pid=2477): stdout: | (launched: 2022-12-14_14:40:38.131883) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:39.971694 run osmo-stp_10.42.42.5(pid=2477): stderr: | 20221214144038326 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144038326 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144038326 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144038326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144038327 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144038327 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144038327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:40.127128 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2477): Process ended prematurely: osmo-stp_10.42.42.5(pid=2477) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2477)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 14:40:40.137216 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:40:40.164828 run osmo-hlr_10.42.42.2(pid=2474): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2474)] 14:40:40.214955 run osmo-hlr_10.42.42.2(pid=2474): stdout: | (launched: 2022-12-14_14:40:37.111979) 14:40:40.266725 run osmo-hlr_10.42.42.2(pid=2474): stderr: | 20221214144037310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144037310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144037310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144037310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144037310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144037310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144037323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144037333 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144037333 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144037333 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:40:40.338744 run osmo-msc_10.42.42.6(pid=2480): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2480)] 14:40:40.388567 run osmo-msc_10.42.42.6(pid=2480): stdout: | (launched: 2022-12-14_14:40:39.184145) 14:40:40.440050 run osmo-msc_10.42.42.6(pid=2480): stderr: | 20221214144039506 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144039506 DLGLOBAL DEBUG validating counter group 0x7fb48e5d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144039506 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144039506 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144039506 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144039506 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144039508 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144039508 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144039509 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144039509 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:40:40.491853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2473): Terminating (SIGTERM) 14:40:40.533549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2476): Terminating (SIGTERM) 14:40:40.575557 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2479): Terminating (SIGTERM) 14:40:40.617426 --- ParallelTerminationStrategy: PID 2473 died... 14:40:40.637248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2473): Terminated: ok {rc=0} 14:40:40.683198 --- ParallelTerminationStrategy: PID 2476 died... 14:40:40.702572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2476): Terminated: ok {rc=0} 14:40:40.748189 --- ParallelTerminationStrategy: PID 2479 died... 14:40:40.767686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2479): Terminated: ok {rc=0} 14:40:40.855762 bus /sierra_3: Setting Powered False 14:40:41.954834 bus /sierra_3: Setting Powered False 14:40:43.072054 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 14:40:44.222340 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:44.234795 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:40:44.306293 tst mo_mt_call_osmux.py: using LAC 41596 14:40:44.436900 tst mo_mt_call_osmux.py: using RAC 31 14:40:44.565202 tst mo_mt_call_osmux.py: using CellId 41596 14:40:44.693078 tst mo_mt_call_osmux.py: using BVCI 41597 14:40:44.811676 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:44.823237 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:44.834608 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:44.845995 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:44.857463 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:40:44.868731 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:40:44.988080 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:40:45.105926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:40:45.579703 run create_hlr_db(pid=2482): Launched 14:40:45.697325 bus /sierra_2: Setting Powered False 14:40:46.770505 run create_hlr_db(pid=2482): Terminated: ok {rc=0} 14:40:47.205652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2484): Launched 14:40:47.525184 run osmo-hlr_10.42.42.2(pid=2485): Launched 14:40:47.642092 run osmo-stp_10.42.42.5: Starting osmo-stp 14:40:48.165624 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2487): Launched 14:40:48.471843 run osmo-stp_10.42.42.5(pid=2488): Launched 14:40:48.589219 run osmo-msc_10.42.42.6: Starting osmo-msc 14:40:49.141130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2490): Launched 14:40:49.469984 run osmo-msc_10.42.42.6(pid=2491): Launched 14:40:49.654044 run osmo-stp_10.42.42.5(pid=2488): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2488)] 14:40:49.792446 run osmo-stp_10.42.42.5(pid=2488): stdout: | (launched: 2022-12-14_14:40:48.415123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:49.930957 run osmo-stp_10.42.42.5(pid=2488): stderr: | 20221214144048587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144048587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144048587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144048588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144048588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144048588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144048588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:50.068250 run osmo-stp_10.42.42.5(pid=2488): stdout: | (launched: 2022-12-14_14:40:48.415123) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:40:50.198553 run osmo-stp_10.42.42.5(pid=2488): stderr: | 20221214144048587 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144048587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144048587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144048588 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144048588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144048588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144048588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:40:50.354339 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2488): Process ended prematurely: osmo-stp_10.42.42.5(pid=2488) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2488)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 14:40:50.364129 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:40:50.391819 run osmo-hlr_10.42.42.2(pid=2485): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2485)] 14:40:50.442097 run osmo-hlr_10.42.42.2(pid=2485): stdout: | (launched: 2022-12-14_14:40:47.468617) 14:40:50.493770 run osmo-hlr_10.42.42.2(pid=2485): stderr: | 20221214144047647 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144047648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144047648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144047648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144047648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144047648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144047672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144047682 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144047682 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144047682 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:40:50.565741 run osmo-msc_10.42.42.6(pid=2491): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2491)] 14:40:50.615584 run osmo-msc_10.42.42.6(pid=2491): stdout: | (launched: 2022-12-14_14:40:49.410056) 14:40:50.667190 run osmo-msc_10.42.42.6(pid=2491): stderr: | 20221214144049733 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144049733 DLGLOBAL DEBUG validating counter group 0x7fe8ac4fbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144049733 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144049733 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144049733 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144049733 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144049735 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144049735 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144049737 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144049737 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:40:50.718952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2484): Terminating (SIGTERM) 14:40:50.760706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2487): Terminating (SIGTERM) 14:40:50.802509 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2490): Terminating (SIGTERM) 14:40:50.844331 --- ParallelTerminationStrategy: PID 2484 died... 14:40:50.864560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2484): Terminated: ok {rc=0} 14:40:50.911244 --- ParallelTerminationStrategy: PID 2487 died... 14:40:50.930890 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2487): Terminated: ok {rc=0} 14:40:50.976943 --- ParallelTerminationStrategy: PID 2490 died... 14:40:50.997342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2490): Terminated: ok {rc=0} 14:40:51.085090 bus /sierra_3: Setting Powered False 14:40:52.184001 bus /sierra_3: Setting Powered False 14:40:53.300097 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 14:40:54.552549 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:40:54.559127 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 14:40:54.591560 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 14:40:54.618862 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 14:40:54.671177 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 14:40:54.705231 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 14:40:54.732450 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 14:40:55.279946 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 14:40:55.329372 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:40:55.340399 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:40:55.410192 tst mo_mt_call.py: using LAC 41597 14:40:55.540765 tst mo_mt_call.py: using RAC 32 14:40:55.661145 tst mo_mt_call.py: using CellId 41597 14:40:55.780192 tst mo_mt_call.py: using BVCI 41598 14:40:55.892292 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:40:55.903397 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:40:55.914420 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:40:55.925272 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:40:55.936364 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:40:55.947995 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:40:56.069281 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:40:56.189593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:40:56.699011 run create_hlr_db(pid=2496): Launched 14:40:56.834341 bus /sierra_2: Setting Powered False 14:40:57.898983 run create_hlr_db(pid=2496): Terminated: ok {rc=0} 14:40:58.336559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2498): Launched 14:40:58.643846 run osmo-hlr_10.42.42.2(pid=2499): Launched 14:40:58.762425 run osmo-stp_10.42.42.5: Starting osmo-stp 14:40:59.294970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2501): Launched 14:40:59.602347 run osmo-stp_10.42.42.5(pid=2502): Launched 14:40:59.721062 run osmo-msc_10.42.42.6: Starting osmo-msc 14:41:00.273211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2504): Launched 14:41:00.579214 run osmo-msc_10.42.42.6(pid=2505): Launched 14:41:00.752877 run osmo-stp_10.42.42.5(pid=2502): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2502)] 14:41:00.936171 run osmo-stp_10.42.42.5(pid=2502): stdout: | (launched: 2022-12-14_14:40:59.545830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:01.138121 run osmo-stp_10.42.42.5(pid=2502): stderr: | 20221214144059717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144059717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144059718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144059718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144059719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144059719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144059719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:01.268846 run osmo-stp_10.42.42.5(pid=2502): stdout: | (launched: 2022-12-14_14:40:59.545830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:01.393436 run osmo-stp_10.42.42.5(pid=2502): stderr: | 20221214144059717 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144059717 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144059718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144059718 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144059719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144059719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144059719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:01.542249 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2502): Process ended prematurely: osmo-stp_10.42.42.5(pid=2502) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2502)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 14:41:01.552249 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:41:01.579855 run osmo-hlr_10.42.42.2(pid=2499): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2499)] 14:41:01.630206 run osmo-hlr_10.42.42.2(pid=2499): stdout: | (launched: 2022-12-14_14:40:58.586735) 14:41:01.683360 run osmo-hlr_10.42.42.2(pid=2499): stderr: | 20221214144058768 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144058768 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144058768 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144058768 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144058768 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144058768 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144058784 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144058794 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144058794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144058794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:41:01.755474 run osmo-msc_10.42.42.6(pid=2505): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2505)] 14:41:01.804597 run osmo-msc_10.42.42.6(pid=2505): stdout: | (launched: 2022-12-14_14:41:00.522281) 14:41:01.857589 run osmo-msc_10.42.42.6(pid=2505): stderr: | 20221214144100793 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144100793 DLGLOBAL DEBUG validating counter group 0x7f2da6be2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144100794 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144100794 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144100794 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144100794 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144100796 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144100796 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144100796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144100796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:41:01.910333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2498): Terminating (SIGTERM) 14:41:01.951625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2501): Terminating (SIGTERM) 14:41:01.993620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2504): Terminating (SIGTERM) 14:41:02.035983 --- ParallelTerminationStrategy: PID 2498 died... 14:41:02.057037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2498): Terminated: ok {rc=0} 14:41:02.104262 --- ParallelTerminationStrategy: PID 2501 died... 14:41:02.125067 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2501): Terminated: ok {rc=0} 14:41:02.171500 --- ParallelTerminationStrategy: PID 2504 died... 14:41:02.192276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2504): Terminated: ok {rc=0} 14:41:02.280657 bus /sierra_3: Setting Powered False 14:41:03.383801 bus /sierra_3: Setting Powered False 14:41:04.500754 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 14:41:05.652274 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:41:05.664639 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:41:05.739100 tst mo_mt_call_osmux.py: using LAC 41598 14:41:05.867391 tst mo_mt_call_osmux.py: using RAC 33 14:41:05.994155 tst mo_mt_call_osmux.py: using CellId 41598 14:41:06.120603 tst mo_mt_call_osmux.py: using BVCI 41599 14:41:06.241597 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:41:06.253191 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:41:06.264423 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:41:06.275868 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:41:06.287345 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:41:06.298776 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:41:06.416139 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:41:06.537382 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:41:07.045805 run create_hlr_db(pid=2507): Launched 14:41:07.179286 bus /sierra_2: Setting Powered False 14:41:08.243730 run create_hlr_db(pid=2507): Terminated: ok {rc=0} 14:41:08.681819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2509): Launched 14:41:08.989720 run osmo-hlr_10.42.42.2(pid=2510): Launched 14:41:09.106859 run osmo-stp_10.42.42.5: Starting osmo-stp 14:41:09.650359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2512): Launched 14:41:09.958582 run osmo-stp_10.42.42.5(pid=2513): Launched 14:41:10.075979 run osmo-msc_10.42.42.6: Starting osmo-msc 14:41:10.630642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2515): Launched 14:41:10.938033 run osmo-msc_10.42.42.6(pid=2516): Launched 14:41:11.110601 run osmo-stp_10.42.42.5(pid=2513): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2513)] 14:41:11.241300 run osmo-stp_10.42.42.5(pid=2513): stdout: | (launched: 2022-12-14_14:41:09.901407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:11.371934 run osmo-stp_10.42.42.5(pid=2513): stderr: | 20221214144110072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144110072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144110072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144110072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144110075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144110075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144110075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:11.500026 run osmo-stp_10.42.42.5(pid=2513): stdout: | (launched: 2022-12-14_14:41:09.901407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:11.621558 run osmo-stp_10.42.42.5(pid=2513): stderr: | 20221214144110072 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144110072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144110072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144110072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144110075 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144110075 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144110075 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:11.767225 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2513): Process ended prematurely: osmo-stp_10.42.42.5(pid=2513) [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2513)] [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 14:41:11.776173 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:41:11.802705 run osmo-hlr_10.42.42.2(pid=2510): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2510)] 14:41:11.851291 run osmo-hlr_10.42.42.2(pid=2510): stdout: | (launched: 2022-12-14_14:41:08.932618) 14:41:11.901174 run osmo-hlr_10.42.42.2(pid=2510): stderr: | 20221214144109112 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144109112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144109112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144109112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144109112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144109112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144109125 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144109133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144109134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144109134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:41:11.970580 run osmo-msc_10.42.42.6(pid=2516): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2516)] 14:41:12.018171 run osmo-msc_10.42.42.6(pid=2516): stdout: | (launched: 2022-12-14_14:41:10.880706) 14:41:12.067731 run osmo-msc_10.42.42.6(pid=2516): stderr: | 20221214144111153 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144111153 DLGLOBAL DEBUG validating counter group 0x7fdb3dff3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144111154 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144111154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144111154 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144111154 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144111156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144111156 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144111156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144111156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:41:12.117625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2509): Terminating (SIGTERM) 14:41:12.157867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2512): Terminating (SIGTERM) 14:41:12.197675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2515): Terminating (SIGTERM) 14:41:12.237576 --- ParallelTerminationStrategy: PID 2509 died... 14:41:12.256941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2509): Terminated: ok {rc=0} 14:41:12.301088 --- ParallelTerminationStrategy: PID 2512 died... 14:41:12.319877 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2512): Terminated: ok {rc=0} 14:41:12.363662 --- ParallelTerminationStrategy: PID 2515 died... 14:41:12.382437 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2515): Terminated: ok {rc=0} 14:41:12.468890 bus /sierra_3: Setting Powered False 14:41:13.567072 bus /sierra_3: Setting Powered False 14:41:14.679839 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:41:15.950807 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:41:15.958887 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:41:15.994432 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 14:41:16.023324 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:41:16.077690 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:41:16.123640 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 14:41:16.152232 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:41:16.726642 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 14:41:16.797669 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:16.813474 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:41:16.903550 tst mo_mt_call.py: using LAC 41599 14:41:17.030750 tst mo_mt_call.py: using RAC 34 14:41:17.193101 tst mo_mt_call.py: using CellId 41599 14:41:17.337084 tst mo_mt_call.py: using BVCI 41600 14:41:17.457439 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:17.469304 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:17.480848 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:17.492922 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:17.504630 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:17.516274 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:41:17.633535 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:41:17.750012 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:41:18.225706 run create_hlr_db(pid=2521): Launched 14:41:18.342836 bus /sierra_2: Setting Powered False 14:41:19.404257 run create_hlr_db(pid=2521): Terminated: ok {rc=0} 14:41:19.852195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2523): Launched 14:41:20.181862 run osmo-hlr_10.42.42.2(pid=2524): Launched 14:41:20.307066 run osmo-stp_10.42.42.5: Starting osmo-stp 14:41:20.875801 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2526): Launched 14:41:21.204214 run osmo-stp_10.42.42.5(pid=2527): Launched 14:41:21.330948 run osmo-msc_10.42.42.6: Starting osmo-msc 14:41:21.933725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2529): Launched 14:41:22.246781 run osmo-msc_10.42.42.6(pid=2530): Launched 14:41:22.417516 run osmo-stp_10.42.42.5(pid=2527): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2527)] 14:41:22.548167 run osmo-stp_10.42.42.5(pid=2527): stdout: | (launched: 2022-12-14_14:41:21.143648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:22.678430 run osmo-stp_10.42.42.5(pid=2527): stderr: | 20221214144121335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144121335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144121336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144121336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144121339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144121339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144121339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:22.806455 run osmo-stp_10.42.42.5(pid=2527): stdout: | (launched: 2022-12-14_14:41:21.143648) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:22.927770 run osmo-stp_10.42.42.5(pid=2527): stderr: | 20221214144121335 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144121335 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144121336 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144121336 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144121339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144121339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144121339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:23.072813 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2527): Process ended prematurely: osmo-stp_10.42.42.5(pid=2527) [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2527)] [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 14:41:23.081891 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:41:23.108209 run osmo-hlr_10.42.42.2(pid=2524): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2524)] 14:41:23.156611 run osmo-hlr_10.42.42.2(pid=2524): stdout: | (launched: 2022-12-14_14:41:20.120651) 14:41:23.206381 run osmo-hlr_10.42.42.2(pid=2524): stderr: | 20221214144120319 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144120319 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144120319 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144120319 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144120319 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144120319 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144120333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144120343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144120344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144120344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:41:23.276061 run osmo-msc_10.42.42.6(pid=2530): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2530)] 14:41:23.323422 run osmo-msc_10.42.42.6(pid=2530): stdout: | (launched: 2022-12-14_14:41:22.190189) 14:41:23.373122 run osmo-msc_10.42.42.6(pid=2530): stderr: | 20221214144122464 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144122464 DLGLOBAL DEBUG validating counter group 0x7fd37a750c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144122464 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144122464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144122464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144122464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144122466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144122466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144122467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144122467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:41:23.423476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2523): Terminating (SIGTERM) 14:41:23.463484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2526): Terminating (SIGTERM) 14:41:23.503459 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2529): Terminating (SIGTERM) 14:41:23.543662 --- ParallelTerminationStrategy: PID 2523 died... 14:41:23.563204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2523): Terminated: ok {rc=0} 14:41:23.607879 --- ParallelTerminationStrategy: PID 2526 died... 14:41:23.626843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2526): Terminated: ok {rc=0} 14:41:23.670972 --- ParallelTerminationStrategy: PID 2529 died... 14:41:23.689849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2529): Terminated: ok {rc=0} 14:41:23.776228 bus /sierra_3: Setting Powered False 14:41:24.874381 bus /sierra_3: Setting Powered False 14:41:25.990456 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 14:41:27.136757 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:27.149797 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:41:27.220526 tst mo_mt_call_osmux.py: using LAC 41600 14:41:27.343517 tst mo_mt_call_osmux.py: using RAC 35 14:41:27.472038 tst mo_mt_call_osmux.py: using CellId 41600 14:41:27.598275 tst mo_mt_call_osmux.py: using BVCI 41601 14:41:27.718670 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:27.730679 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:27.742389 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:27.754111 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:27.765907 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:41:27.777451 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:41:27.898062 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:41:28.014242 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:41:28.490140 run create_hlr_db(pid=2532): Launched 14:41:28.609987 bus /sierra_2: Setting Powered False 14:41:29.670843 run create_hlr_db(pid=2532): Terminated: ok {rc=0} 14:41:30.098411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2534): Launched 14:41:30.405512 run osmo-hlr_10.42.42.2(pid=2535): Launched 14:41:30.522591 run osmo-stp_10.42.42.5: Starting osmo-stp 14:41:31.105283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2537): Launched 14:41:31.423031 run osmo-stp_10.42.42.5(pid=2538): Launched 14:41:31.644735 run osmo-msc_10.42.42.6: Starting osmo-msc 14:41:32.351779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2540): Launched 14:41:32.658257 run osmo-msc_10.42.42.6(pid=2541): Launched 14:41:32.832594 run osmo-stp_10.42.42.5(pid=2538): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2538)] 14:41:32.962808 run osmo-stp_10.42.42.5(pid=2538): stdout: | (launched: 2022-12-14_14:41:31.361410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:33.092796 run osmo-stp_10.42.42.5(pid=2538): stderr: | 20221214144131710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144131710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144131710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144131711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144131711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144131711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144131711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:33.220735 run osmo-stp_10.42.42.5(pid=2538): stdout: | (launched: 2022-12-14_14:41:31.361410) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:33.342077 run osmo-stp_10.42.42.5(pid=2538): stderr: | 20221214144131710 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144131710 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144131710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144131711 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144131711 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144131711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144131711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:33.488057 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2538): Process ended prematurely: osmo-stp_10.42.42.5(pid=2538) [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2538)] [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 14:41:33.497198 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 14:41:33.523636 run osmo-hlr_10.42.42.2(pid=2535): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2535)] 14:41:33.571637 run osmo-hlr_10.42.42.2(pid=2535): stdout: | (launched: 2022-12-14_14:41:30.348821) 14:41:33.621350 run osmo-hlr_10.42.42.2(pid=2535): stderr: | 20221214144130525 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144130525 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144130525 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144130525 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144130525 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144130525 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144130539 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144130548 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144130548 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144130548 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:41:33.690687 run osmo-msc_10.42.42.6(pid=2541): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2541)] 14:41:33.737776 run osmo-msc_10.42.42.6(pid=2541): stdout: | (launched: 2022-12-14_14:41:32.601863) 14:41:33.787202 run osmo-msc_10.42.42.6(pid=2541): stderr: | 20221214144132872 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144132872 DLGLOBAL DEBUG validating counter group 0x7fdb039f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144132872 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144132872 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144132872 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144132873 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144132874 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144132875 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144132875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144132875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:41:33.836887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2534): Terminating (SIGTERM) 14:41:33.876542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2537): Terminating (SIGTERM) 14:41:33.916426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2540): Terminating (SIGTERM) 14:41:33.956657 --- ParallelTerminationStrategy: PID 2534 died... 14:41:33.975989 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2534): Terminated: ok {rc=0} 14:41:34.019948 --- ParallelTerminationStrategy: PID 2537 died... 14:41:34.038725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2537): Terminated: ok {rc=0} 14:41:34.082576 --- ParallelTerminationStrategy: PID 2540 died... 14:41:34.101441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2540): Terminated: ok {rc=0} 14:41:34.184215 bus /sierra_3: Setting Powered False 14:41:35.282070 bus /sierra_3: Setting Powered False 14:41:36.399209 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:41:37.647089 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:41:37.653160 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:41:37.686046 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 14:41:37.713836 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 14:41:37.764923 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:41:37.797435 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 14:41:37.823912 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 14:41:38.373472 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 14:41:38.423162 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:38.434123 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:41:38.504163 tst mo_mt_call.py: using LAC 41601 14:41:38.625662 tst mo_mt_call.py: using RAC 36 14:41:38.746935 tst mo_mt_call.py: using CellId 41601 14:41:38.869890 tst mo_mt_call.py: using BVCI 41602 14:41:38.990168 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:39.001719 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:39.013073 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:39.025111 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:39.036769 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:39.048512 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:41:39.168290 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:41:39.287873 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:41:39.798794 run create_hlr_db(pid=2546): Launched 14:41:39.934117 bus /sierra_2: Setting Powered False 14:41:40.998493 run create_hlr_db(pid=2546): Terminated: ok {rc=0} 14:41:41.437701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2548): Launched 14:41:41.746274 run osmo-hlr_10.42.42.2(pid=2549): Launched 14:41:41.862830 run osmo-stp_10.42.42.5: Starting osmo-stp 14:41:42.406497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2551): Launched 14:41:42.715058 run osmo-stp_10.42.42.5(pid=2552): Launched 14:41:42.832317 run osmo-msc_10.42.42.6: Starting osmo-msc 14:41:43.386790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2554): Launched 14:41:43.695698 run osmo-msc_10.42.42.6(pid=2555): Launched 14:41:43.868735 run osmo-stp_10.42.42.5(pid=2552): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2552)] 14:41:43.999344 run osmo-stp_10.42.42.5(pid=2552): stdout: | (launched: 2022-12-14_14:41:42.658296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:44.129909 run osmo-stp_10.42.42.5(pid=2552): stderr: | 20221214144142832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144142832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144142833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144142833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144142834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144142834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144142834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:44.258444 run osmo-stp_10.42.42.5(pid=2552): stdout: | (launched: 2022-12-14_14:41:42.658296) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:44.380100 run osmo-stp_10.42.42.5(pid=2552): stderr: | 20221214144142832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144142832 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144142833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144142833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144142834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144142834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144142834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:44.525913 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2552): Process ended prematurely: osmo-stp_10.42.42.5(pid=2552) [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2552)] [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 14:41:44.534935 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 14:41:44.561640 run osmo-hlr_10.42.42.2(pid=2549): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2549)] 14:41:44.610173 run osmo-hlr_10.42.42.2(pid=2549): stdout: | (launched: 2022-12-14_14:41:41.689927) 14:41:44.660045 run osmo-hlr_10.42.42.2(pid=2549): stderr: | 20221214144141865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144141865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144141865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144141865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144141865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144141865 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144141878 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144141886 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144141887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144141887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:41:44.729687 run osmo-msc_10.42.42.6(pid=2555): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2555)] 14:41:44.777510 run osmo-msc_10.42.42.6(pid=2555): stdout: | (launched: 2022-12-14_14:41:43.638654) 14:41:44.827190 run osmo-msc_10.42.42.6(pid=2555): stderr: | 20221214144143912 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144143912 DLGLOBAL DEBUG validating counter group 0x7f7b77622c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144143912 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144143912 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144143913 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144143913 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144143914 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144143915 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144143915 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144143915 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:41:44.877073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2548): Terminating (SIGTERM) 14:41:44.917333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2551): Terminating (SIGTERM) 14:41:44.957300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2554): Terminating (SIGTERM) 14:41:44.998063 --- ParallelTerminationStrategy: PID 2548 died... 14:41:45.017489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2548): Terminated: ok {rc=0} 14:41:45.061563 --- ParallelTerminationStrategy: PID 2551 died... 14:41:45.080289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2551): Terminated: ok {rc=0} 14:41:45.124845 --- ParallelTerminationStrategy: PID 2554 died... 14:41:45.144234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2554): Terminated: ok {rc=0} 14:41:45.231217 bus /sierra_3: Setting Powered False 14:41:46.337235 bus /sierra_3: Setting Powered False 14:41:47.471143 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 14:41:48.620378 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:48.632065 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:41:48.701880 tst mo_mt_call_osmux.py: using LAC 41602 14:41:48.821643 tst mo_mt_call_osmux.py: using RAC 37 14:41:48.941908 tst mo_mt_call_osmux.py: using CellId 41602 14:41:49.072735 tst mo_mt_call_osmux.py: using BVCI 41603 14:41:49.194604 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:49.206059 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:49.217387 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:49.228916 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:49.240723 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:41:49.252526 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:41:49.370475 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:41:49.492862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:41:50.004357 run create_hlr_db(pid=2557): Launched 14:41:50.138259 bus /sierra_2: Setting Powered False 14:41:51.202592 run create_hlr_db(pid=2557): Terminated: ok {rc=0} 14:41:51.643405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2559): Launched 14:41:51.952011 run osmo-hlr_10.42.42.2(pid=2560): Launched 14:41:52.070758 run osmo-stp_10.42.42.5: Starting osmo-stp 14:41:52.615167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2562): Launched 14:41:52.923379 run osmo-stp_10.42.42.5(pid=2563): Launched 14:41:53.041231 run osmo-msc_10.42.42.6: Starting osmo-msc 14:41:53.597820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2565): Launched 14:41:53.907389 run osmo-msc_10.42.42.6(pid=2566): Launched 14:41:54.078869 run osmo-stp_10.42.42.5(pid=2563): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2563)] 14:41:54.208872 run osmo-stp_10.42.42.5(pid=2563): stdout: | (launched: 2022-12-14_14:41:52.866627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:54.339355 run osmo-stp_10.42.42.5(pid=2563): stderr: | 20221214144153038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144153039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144153039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144153039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144153040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144153040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144153040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:54.467544 run osmo-stp_10.42.42.5(pid=2563): stdout: | (launched: 2022-12-14_14:41:52.866627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:41:54.589255 run osmo-stp_10.42.42.5(pid=2563): stderr: | 20221214144153038 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144153039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144153039 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144153039 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144153040 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144153040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144153040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:41:54.734506 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2563): Process ended prematurely: osmo-stp_10.42.42.5(pid=2563) [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2563)] [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 14:41:54.743522 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:41:54.770025 run osmo-hlr_10.42.42.2(pid=2560): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2560)] 14:41:54.818744 run osmo-hlr_10.42.42.2(pid=2560): stdout: | (launched: 2022-12-14_14:41:51.895590) 14:41:54.870371 run osmo-hlr_10.42.42.2(pid=2560): stderr: | 20221214144152073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144152073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144152073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144152073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144152073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144152074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144152086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144152094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144152094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144152094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:41:54.943142 run osmo-msc_10.42.42.6(pid=2566): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2566)] 14:41:54.994341 run osmo-msc_10.42.42.6(pid=2566): stdout: | (launched: 2022-12-14_14:41:53.850343) 14:41:55.045652 run osmo-msc_10.42.42.6(pid=2566): stderr: | 20221214144154124 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144154124 DLGLOBAL DEBUG validating counter group 0x7f705eb8dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144154124 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144154124 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144154124 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144154124 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144154126 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144154127 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144154127 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144154127 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:41:55.096563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2559): Terminating (SIGTERM) 14:41:55.137582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2562): Terminating (SIGTERM) 14:41:55.178988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2565): Terminating (SIGTERM) 14:41:55.220157 --- ParallelTerminationStrategy: PID 2559 died... 14:41:55.239478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2559): Terminated: ok {rc=0} 14:41:55.283818 --- ParallelTerminationStrategy: PID 2562 died... 14:41:55.302808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2562): Terminated: ok {rc=0} 14:41:55.347179 --- ParallelTerminationStrategy: PID 2565 died... 14:41:55.366191 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2565): Terminated: ok {rc=0} 14:41:55.453871 bus /sierra_3: Setting Powered False 14:41:56.553907 bus /sierra_3: Setting Powered False 14:41:57.669720 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 14:41:58.924336 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:41:58.929304 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 14:41:58.961606 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 14:41:58.989180 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 14:41:59.041380 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 14:41:59.073748 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 14:41:59.100165 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 14:41:59.653348 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 14:41:59.706370 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:41:59.718019 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 14:41:59.769873 tst mo_mt_call.py: using LAC 41603 14:41:59.898806 tst mo_mt_call.py: using RAC 38 14:42:00.027783 tst mo_mt_call.py: using CellId 41603 14:42:00.158889 tst mo_mt_call.py: using BVCI 41604 14:42:00.279523 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:00.291029 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:00.302295 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:00.313629 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:00.325120 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:00.336604 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 14:42:00.455729 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 14:42:00.576114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:42:01.176640 run create_hlr_db(pid=2575): Launched 14:42:01.323294 bus /sierra_2: Setting Powered False 14:42:02.385308 run create_hlr_db(pid=2575): Terminated: ok {rc=0} 14:42:02.813905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2577): Launched 14:42:03.119998 run osmo-hlr_10.42.42.2(pid=2578): Launched 14:42:03.236831 run osmo-stp_10.42.42.5: Starting osmo-stp 14:42:03.776712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2580): Launched 14:42:04.083993 run osmo-stp_10.42.42.5(pid=2581): Launched 14:42:04.201544 run osmo-msc_10.42.42.6: Starting osmo-msc 14:42:04.755075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2583): Launched 14:42:05.062871 run osmo-msc_10.42.42.6(pid=2584): Launched 14:42:05.238573 run osmo-stp_10.42.42.5(pid=2581): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2581)] 14:42:05.369470 run osmo-stp_10.42.42.5(pid=2581): stdout: | (launched: 2022-12-14_14:42:04.027668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:05.499774 run osmo-stp_10.42.42.5(pid=2581): stderr: | 20221214144204201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144204202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144204202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144204202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144204203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144204203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144204203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:05.627460 run osmo-stp_10.42.42.5(pid=2581): stdout: | (launched: 2022-12-14_14:42:04.027668) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:05.749428 run osmo-stp_10.42.42.5(pid=2581): stderr: | 20221214144204201 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144204202 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144204202 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144204202 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144204203 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144204203 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144204203 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:05.895035 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2581): Process ended prematurely: osmo-stp_10.42.42.5(pid=2581) [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2581)] [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 14:42:05.903916 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 14:42:05.930245 run osmo-hlr_10.42.42.2(pid=2578): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2578)] 14:42:05.978496 run osmo-hlr_10.42.42.2(pid=2578): stdout: | (launched: 2022-12-14_14:42:03.063792) 14:42:06.028308 run osmo-hlr_10.42.42.2(pid=2578): stderr: | 20221214144203240 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144203240 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144203240 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144203240 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144203240 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144203240 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144203253 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144203262 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144203262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144203262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:42:06.097878 run osmo-msc_10.42.42.6(pid=2584): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2584)] 14:42:06.145531 run osmo-msc_10.42.42.6(pid=2584): stdout: | (launched: 2022-12-14_14:42:05.006239) 14:42:06.195100 run osmo-msc_10.42.42.6(pid=2584): stderr: | 20221214144205278 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144205279 DLGLOBAL DEBUG validating counter group 0x7f0d81875c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144205279 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144205279 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144205279 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144205279 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144205282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144205283 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144205283 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144205283 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:42:06.245043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2577): Terminating (SIGTERM) 14:42:06.285119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2580): Terminating (SIGTERM) 14:42:06.325233 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2583): Terminating (SIGTERM) 14:42:06.365326 --- ParallelTerminationStrategy: PID 2577 died... 14:42:06.384472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2577): Terminated: ok {rc=0} 14:42:06.428601 --- ParallelTerminationStrategy: PID 2580 died... 14:42:06.447454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2580): Terminated: ok {rc=0} 14:42:06.491317 --- ParallelTerminationStrategy: PID 2583 died... 14:42:06.510257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2583): Terminated: ok {rc=0} 14:42:06.593945 bus /sierra_3: Setting Powered False 14:42:07.691548 bus /sierra_3: Setting Powered False 14:42:08.807602 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 14:42:09.957657 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:09.969776 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 14:42:10.022588 tst mo_mt_call_osmux.py: using LAC 41604 14:42:10.150916 tst mo_mt_call_osmux.py: using RAC 39 14:42:10.279439 tst mo_mt_call_osmux.py: using CellId 41604 14:42:10.406520 tst mo_mt_call_osmux.py: using BVCI 41605 14:42:10.526398 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:10.538096 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:10.549590 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:10.560822 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:10.572060 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 14:42:10.583328 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 14:42:10.703386 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 14:42:10.823792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:42:11.334831 run create_hlr_db(pid=2586): Launched 14:42:11.470835 bus /sierra_2: Setting Powered False 14:42:12.534783 run create_hlr_db(pid=2586): Terminated: ok {rc=0} 14:42:12.972690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2588): Launched 14:42:13.281174 run osmo-hlr_10.42.42.2(pid=2589): Launched 14:42:13.399298 run osmo-stp_10.42.42.5: Starting osmo-stp 14:42:13.926599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2591): Launched 14:42:14.234106 run osmo-stp_10.42.42.5(pid=2592): Launched 14:42:14.351870 run osmo-msc_10.42.42.6: Starting osmo-msc 14:42:14.906261 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2594): Launched 14:42:15.214145 run osmo-msc_10.42.42.6(pid=2595): Launched 14:42:15.389234 run osmo-stp_10.42.42.5(pid=2592): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2592)] 14:42:15.521181 run osmo-stp_10.42.42.5(pid=2592): stdout: | (launched: 2022-12-14_14:42:14.177150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:15.651436 run osmo-stp_10.42.42.5(pid=2592): stderr: | 20221214144214348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144214348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144214348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144214348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144214351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144214351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144214351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:15.779726 run osmo-stp_10.42.42.5(pid=2592): stdout: | (launched: 2022-12-14_14:42:14.177150) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:15.946079 run osmo-stp_10.42.42.5(pid=2592): stderr: | 20221214144214348 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144214348 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144214348 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144214348 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144214351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144214351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144214351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:16.140778 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2592): Process ended prematurely: osmo-stp_10.42.42.5(pid=2592) [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2592)] [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 14:42:16.154991 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:42:16.195414 run osmo-hlr_10.42.42.2(pid=2589): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2589)] 14:42:16.260909 run osmo-hlr_10.42.42.2(pid=2589): stdout: | (launched: 2022-12-14_14:42:13.224523) 14:42:16.329607 run osmo-hlr_10.42.42.2(pid=2589): stderr: | 20221214144213402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144213402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144213402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144213402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144213403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144213403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144213415 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144213423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144213424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144213424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:42:16.422438 run osmo-msc_10.42.42.6(pid=2595): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2595)] 14:42:16.488229 run osmo-msc_10.42.42.6(pid=2595): stdout: | (launched: 2022-12-14_14:42:15.156920) 14:42:16.556276 run osmo-msc_10.42.42.6(pid=2595): stderr: | 20221214144215429 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144215429 DLGLOBAL DEBUG validating counter group 0x7f4f53462c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144215429 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144215429 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144215429 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144215430 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144215431 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144215432 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144215432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144215432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:42:16.613547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2588): Terminating (SIGTERM) 14:42:16.656881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2591): Terminating (SIGTERM) 14:42:16.700788 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2594): Terminating (SIGTERM) 14:42:16.743535 --- ParallelTerminationStrategy: PID 2588 died... 14:42:16.764544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2588): Terminated: ok {rc=0} 14:42:16.811566 --- ParallelTerminationStrategy: PID 2591 died... 14:42:16.832147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2591): Terminated: ok {rc=0} 14:42:16.878833 --- ParallelTerminationStrategy: PID 2594 died... 14:42:16.899588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2594): Terminated: ok {rc=0} 14:42:16.988818 bus /sierra_3: Setting Powered False 14:42:18.086768 bus /sierra_3: Setting Powered False 14:42:19.205595 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 14:42:20.453561 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:42:20.459405 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 14:42:20.491760 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 14:42:20.519133 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 14:42:20.570130 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 14:42:20.602752 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 14:42:20.629164 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 14:42:21.185614 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 14:42:21.238671 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:21.250387 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:42:21.303891 tst mo_mt_call.py: using LAC 41605 14:42:21.432572 tst mo_mt_call.py: using RAC 40 14:42:21.562655 tst mo_mt_call.py: using CellId 41605 14:42:21.693197 tst mo_mt_call.py: using BVCI 41606 14:42:21.813746 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:21.825499 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:21.837041 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:21.848646 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:21.860308 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:21.871849 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:42:21.988882 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:42:22.109139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:42:22.618859 run create_hlr_db(pid=2600): Launched 14:42:22.752261 bus /sierra_2: Setting Powered False 14:42:23.817206 run create_hlr_db(pid=2600): Terminated: ok {rc=0} 14:42:24.257276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2602): Launched 14:42:24.565087 run osmo-hlr_10.42.42.2(pid=2603): Launched 14:42:24.682993 run osmo-stp_10.42.42.5: Starting osmo-stp 14:42:25.217177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2605): Launched 14:42:25.524713 run osmo-stp_10.42.42.5(pid=2606): Launched 14:42:25.642603 run osmo-msc_10.42.42.6: Starting osmo-msc 14:42:26.201616 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2608): Launched 14:42:26.510821 run osmo-msc_10.42.42.6(pid=2609): Launched 14:42:26.683729 run osmo-stp_10.42.42.5(pid=2606): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2606)] 14:42:26.815638 run osmo-stp_10.42.42.5(pid=2606): stdout: | (launched: 2022-12-14_14:42:25.467926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:26.946492 run osmo-stp_10.42.42.5(pid=2606): stderr: | 20221214144225641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144225641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144225641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144225642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144225642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144225642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144225642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:27.074981 run osmo-stp_10.42.42.5(pid=2606): stdout: | (launched: 2022-12-14_14:42:25.467926) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:27.196657 run osmo-stp_10.42.42.5(pid=2606): stderr: | 20221214144225641 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144225641 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144225641 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144225642 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144225642 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144225642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144225642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:27.342820 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2606): Process ended prematurely: osmo-stp_10.42.42.5(pid=2606) [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2606)] [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 14:42:27.351691 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 14:42:27.378383 run osmo-hlr_10.42.42.2(pid=2603): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2603)] 14:42:27.426935 run osmo-hlr_10.42.42.2(pid=2603): stdout: | (launched: 2022-12-14_14:42:24.508176) 14:42:27.477195 run osmo-hlr_10.42.42.2(pid=2603): stderr: | 20221214144224686 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144224686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144224686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144224686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144224686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144224686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144224699 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144224707 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144224707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144224707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:42:27.547357 run osmo-msc_10.42.42.6(pid=2609): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2609)] 14:42:27.595334 run osmo-msc_10.42.42.6(pid=2609): stdout: | (launched: 2022-12-14_14:42:26.453786) 14:42:27.645155 run osmo-msc_10.42.42.6(pid=2609): stderr: | 20221214144226727 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144226727 DLGLOBAL DEBUG validating counter group 0x7f65f9f1bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144226727 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144226727 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144226727 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144226727 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144226729 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144226730 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144226730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144226730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:42:27.695661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2602): Terminating (SIGTERM) 14:42:27.736096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2605): Terminating (SIGTERM) 14:42:27.776524 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2608): Terminating (SIGTERM) 14:42:27.817247 --- ParallelTerminationStrategy: PID 2602 died... 14:42:27.836627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2602): Terminated: ok {rc=0} 14:42:27.881537 --- ParallelTerminationStrategy: PID 2605 died... 14:42:27.900693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2605): Terminated: ok {rc=0} 14:42:27.945464 --- ParallelTerminationStrategy: PID 2608 died... 14:42:27.964516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2608): Terminated: ok {rc=0} 14:42:28.051775 bus /sierra_3: Setting Powered False 14:42:29.151102 bus /sierra_3: Setting Powered False 14:42:30.268169 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 14:42:31.434011 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:31.447426 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:42:31.502538 tst mo_mt_call_osmux.py: using LAC 41606 14:42:31.638687 tst mo_mt_call_osmux.py: using RAC 41 14:42:31.768363 tst mo_mt_call_osmux.py: using CellId 41606 14:42:31.890943 tst mo_mt_call_osmux.py: using BVCI 41607 14:42:32.012266 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:32.024865 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:32.037280 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:32.049683 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:32.062191 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:42:32.075019 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:42:32.192583 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:42:32.318915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:42:32.824538 run create_hlr_db(pid=2611): Launched 14:42:32.956924 bus /sierra_2: Setting Powered False 14:42:34.021186 run create_hlr_db(pid=2611): Terminated: ok {rc=0} 14:42:34.456421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2613): Launched 14:42:34.762711 run osmo-hlr_10.42.42.2(pid=2614): Launched 14:42:34.879133 run osmo-stp_10.42.42.5: Starting osmo-stp 14:42:35.420241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2616): Launched 14:42:35.747212 run osmo-stp_10.42.42.5(pid=2617): Launched 14:42:35.870600 run osmo-msc_10.42.42.6: Starting osmo-msc 14:42:36.459258 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2620): Launched 14:42:36.784037 run osmo-msc_10.42.42.6(pid=2622): Launched 14:42:36.964524 run osmo-stp_10.42.42.5(pid=2617): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2617)] 14:42:37.099985 run osmo-stp_10.42.42.5(pid=2617): stdout: | (launched: 2022-12-14_14:42:35.687491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:37.238296 run osmo-stp_10.42.42.5(pid=2617): stderr: | 20221214144235880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144235880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144235880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144235881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144235881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144235881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144235881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:37.374609 run osmo-stp_10.42.42.5(pid=2617): stdout: | (launched: 2022-12-14_14:42:35.687491) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:37.503858 run osmo-stp_10.42.42.5(pid=2617): stderr: | 20221214144235880 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144235880 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144235880 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144235881 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144235881 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144235881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144235881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:37.657783 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2617): Process ended prematurely: osmo-stp_10.42.42.5(pid=2617) [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2617)] [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 14:42:37.667417 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:42:37.694869 run osmo-hlr_10.42.42.2(pid=2614): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2614)] 14:42:37.745029 run osmo-hlr_10.42.42.2(pid=2614): stdout: | (launched: 2022-12-14_14:42:34.706286) 14:42:37.796597 run osmo-hlr_10.42.42.2(pid=2614): stderr: | 20221214144234885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144234885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144234885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144234885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144234885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144234885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144234897 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144234906 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144234906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144234906 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:42:37.868702 run osmo-msc_10.42.42.6(pid=2622): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2622)] 14:42:37.918693 run osmo-msc_10.42.42.6(pid=2622): stdout: | (launched: 2022-12-14_14:42:36.724372) 14:42:37.970399 run osmo-msc_10.42.42.6(pid=2622): stderr: | 20221214144237046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144237046 DLGLOBAL DEBUG validating counter group 0x7f8b5f24bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144237046 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144237046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144237047 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144237047 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144237048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144237049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144237049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144237049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:42:38.022917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2613): Terminating (SIGTERM) 14:42:38.064488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2616): Terminating (SIGTERM) 14:42:38.106269 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2620): Terminating (SIGTERM) 14:42:38.148146 --- ParallelTerminationStrategy: PID 2613 died... 14:42:38.168101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2613): Terminated: ok {rc=0} 14:42:38.214708 --- ParallelTerminationStrategy: PID 2616 died... 14:42:38.234033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2616): Terminated: ok {rc=0} 14:42:38.280113 --- ParallelTerminationStrategy: PID 2620 died... 14:42:38.299483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2620): Terminated: ok {rc=0} 14:42:38.386858 bus /sierra_3: Setting Powered False 14:42:39.485489 bus /sierra_3: Setting Powered False 14:42:40.604743 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 emergency:trx-b200 --------------------------------------------------------------------- 14:42:41.855388 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:42:41.860108 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 14:42:41.894012 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 14:42:41.921300 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 14:42:42.010982 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 14:42:42.044499 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 14:42:42.070819 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 14:42:42.647953 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2406 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 14:42:42.653224 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:42.663837 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 14:42:42.716320 tst emergency_mo_mt_call.py: using LAC 41607 14:42:42.837051 tst emergency_mo_mt_call.py: using RAC 42 14:42:42.951835 tst emergency_mo_mt_call.py: using CellId 41607 14:42:43.069530 tst emergency_mo_mt_call.py: using BVCI 41608 14:42:43.179808 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:43.190662 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:43.201228 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:43.211737 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:43.222873 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:43.233769 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 14:42:43.352299 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 14:42:43.466937 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:42:43.928459 run create_hlr_db(pid=2628): Launched 14:42:44.043570 bus /sierra_2: Setting Powered False 14:42:45.102888 run create_hlr_db(pid=2628): Terminated: ok {rc=0} 14:42:45.540925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2630): Launched 14:42:45.870727 run osmo-hlr_10.42.42.2(pid=2631): Launched 14:42:46.053506 run osmo-stp_10.42.42.5: Starting osmo-stp 14:42:46.713232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2633): Launched 14:42:47.052331 run osmo-stp_10.42.42.5(pid=2634): Launched 14:42:47.318741 tst emergency_mo_mt_call.py: using MSISDN 8739 14:42:47.524652 run osmo-msc_10.42.42.6: Starting osmo-msc 14:42:48.062639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2636): Launched 14:42:48.361325 run osmo-msc_10.42.42.6(pid=2637): Launched 14:42:48.528315 run osmo-stp_10.42.42.5(pid=2634): ERR: Terminated: ERROR {rc=1} [trial-2406↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2634)] 14:42:48.654794 run osmo-stp_10.42.42.5(pid=2634): stdout: | (launched: 2022-12-14_14:42:46.988765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:48.781607 run osmo-stp_10.42.42.5(pid=2634): stderr: | 20221214144247248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144247248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144247248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144247249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144247249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144247249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144247249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:48.906581 run osmo-stp_10.42.42.5(pid=2634): stdout: | (launched: 2022-12-14_14:42:46.988765) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:49.025627 run osmo-stp_10.42.42.5(pid=2634): stderr: | 20221214144247248 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144247248 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144247248 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144247249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144247249 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144247249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144247249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:49.167919 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2634): Process ended prematurely: osmo-stp_10.42.42.5(pid=2634) [trial-2406↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2634)] [trial-2406↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 14:42:49.176434 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 14:42:49.202405 run osmo-hlr_10.42.42.2(pid=2631): ERR: Terminated: ERROR {rc=237} [trial-2406↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2631)] 14:42:49.251161 run osmo-hlr_10.42.42.2(pid=2631): stdout: | (launched: 2022-12-14_14:42:45.801991) 14:42:49.300732 run osmo-hlr_10.42.42.2(pid=2631): stderr: | 20221214144246135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144246135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144246135 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144246135 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144246135 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144246135 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144246155 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144246171 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144246171 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144246171 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:42:49.370186 run osmo-msc_10.42.42.6(pid=2637): ERR: Terminated: ERROR {rc=2} [trial-2406↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2637)] 14:42:49.417806 run osmo-msc_10.42.42.6(pid=2637): stdout: | (launched: 2022-12-14_14:42:48.306271) 14:42:49.467077 run osmo-msc_10.42.42.6(pid=2637): stderr: | 20221214144248579 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144248579 DLGLOBAL DEBUG validating counter group 0x7f1825da4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144248579 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144248579 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144248579 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144248579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144248581 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144248582 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144248582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144248582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:42:49.517179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2630): Terminating (SIGTERM) 14:42:49.557124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2633): Terminating (SIGTERM) 14:42:49.597094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2636): Terminating (SIGTERM) 14:42:49.637484 --- ParallelTerminationStrategy: PID 2630 died... 14:42:49.656847 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2630): Terminated: ok {rc=0} 14:42:49.701068 --- ParallelTerminationStrategy: PID 2633 died... 14:42:49.719730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2633): Terminated: ok {rc=0} 14:42:49.763745 --- ParallelTerminationStrategy: PID 2636 died... 14:42:49.782656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2636): Terminated: ok {rc=0} 14:42:49.868537 bus /sierra_3: Setting Powered False 14:42:50.967829 bus /sierra_3: Setting Powered False 14:42:52.083165 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 14:42:53.170529 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:53.182093 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 14:42:53.233476 tst emergency_preemptive_call.py: using LAC 41608 14:42:53.362196 tst emergency_preemptive_call.py: using RAC 43 14:42:53.488897 tst emergency_preemptive_call.py: using CellId 41608 14:42:53.610578 tst emergency_preemptive_call.py: using BVCI 41609 14:42:53.724694 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:53.736078 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:53.747244 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:53.758439 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:53.769415 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 14:42:53.780253 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 14:42:53.897108 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 14:42:54.012458 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 14:42:54.130467 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 14:42:54.245097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:42:54.703642 run create_hlr_db(pid=2639): Launched 14:42:54.817455 bus /sierra_2: Setting Powered False 14:42:55.876533 run create_hlr_db(pid=2639): Terminated: ok {rc=0} 14:42:56.311598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2641): Launched 14:42:56.628274 run osmo-hlr_10.42.42.2(pid=2642): Launched 14:42:56.749310 run osmo-stp_10.42.42.5: Starting osmo-stp 14:42:57.294560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2644): Launched 14:42:57.611183 run osmo-stp_10.42.42.5(pid=2645): Launched 14:42:57.740653 tst emergency_preemptive_call.py: using MSISDN 8740 14:42:57.902188 run osmo-msc_10.42.42.6: Starting osmo-msc 14:42:58.471225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2647): Launched 14:42:58.787306 run osmo-msc_10.42.42.6(pid=2648): Launched 14:42:58.964237 run osmo-stp_10.42.42.5(pid=2645): ERR: Terminated: ERROR {rc=1} [trial-2406↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2645)] 14:42:59.097945 run osmo-stp_10.42.42.5(pid=2645): stdout: | (launched: 2022-12-14_14:42:57.553340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:59.232338 run osmo-stp_10.42.42.5(pid=2645): stderr: | 20221214144257746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144257746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144257747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144257747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144257747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144257747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144257748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:59.365808 run osmo-stp_10.42.42.5(pid=2645): stdout: | (launched: 2022-12-14_14:42:57.553340) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:42:59.491879 run osmo-stp_10.42.42.5(pid=2645): stderr: | 20221214144257746 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144257746 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144257747 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144257747 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144257747 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144257747 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144257748 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:42:59.642023 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2645): Process ended prematurely: osmo-stp_10.42.42.5(pid=2645) [trial-2406↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2645)] [trial-2406↪emergency:trx-b200↪emergency_preemptive_call.py:32] 14:42:59.650822 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 14:42:59.678219 run osmo-hlr_10.42.42.2(pid=2642): ERR: Terminated: ERROR {rc=237} [trial-2406↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2642)] 14:42:59.728306 run osmo-hlr_10.42.42.2(pid=2642): stdout: | (launched: 2022-12-14_14:42:56.570314) 14:42:59.780371 run osmo-hlr_10.42.42.2(pid=2642): stderr: | 20221214144256769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144256769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144256769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144256769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144256769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144256769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144256781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144256789 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144256789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144256789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:42:59.852904 run osmo-msc_10.42.42.6(pid=2648): ERR: Terminated: ERROR {rc=2} [trial-2406↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2648)] 14:42:59.902991 run osmo-msc_10.42.42.6(pid=2648): stdout: | (launched: 2022-12-14_14:42:58.729660) 14:42:59.955354 run osmo-msc_10.42.42.6(pid=2648): stderr: | 20221214144259049 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144259050 DLGLOBAL DEBUG validating counter group 0x7fb1c2de9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144259050 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144259050 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144259050 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144259050 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144259052 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144259052 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144259052 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144259053 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:43:00.007394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2641): Terminating (SIGTERM) 14:43:00.049059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2644): Terminating (SIGTERM) 14:43:00.090914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2647): Terminating (SIGTERM) 14:43:00.133745 --- ParallelTerminationStrategy: PID 2641 died... 14:43:00.154050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2641): Terminated: ok {rc=0} 14:43:00.200419 --- ParallelTerminationStrategy: PID 2644 died... 14:43:00.220360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2644): Terminated: ok {rc=0} 14:43:00.266638 --- ParallelTerminationStrategy: PID 2647 died... 14:43:00.286155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2647): Terminated: ok {rc=0} 14:43:00.373966 bus /sierra_9: Setting Powered False 14:43:01.470878 bus /sierra_9: Setting Powered False 14:43:02.587148 bus /sierra_8: Setting Powered False 14:43:03.685794 bus /sierra_8: Setting Powered False 14:43:04.802019 bus /sierra_3: Setting Powered False 14:43:05.900567 bus /sierra_3: Setting Powered False 14:43:07.020628 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:trx-b200 --------------------------------------------------------------------- 14:43:08.301824 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:43:08.306068 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 14:43:08.338070 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 14:43:08.376028 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 14:43:08.459209 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 14:43:08.491300 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 14:43:08.528846 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 14:43:09.119337 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 14:43:09.169302 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:09.179780 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 14:43:09.225654 tst cs_paging_gprs_active.py: using LAC 41609 14:43:09.353299 tst cs_paging_gprs_active.py: using RAC 44 14:43:09.481511 tst cs_paging_gprs_active.py: using CellId 41609 14:43:09.607454 tst cs_paging_gprs_active.py: using BVCI 41610 14:43:09.718662 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:09.729393 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:09.739891 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:09.750363 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:09.761005 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:09.771948 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:09.783105 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:09.793739 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:09.804792 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 14:43:09.925278 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 14:43:10.042185 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:43:10.247600 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:43:10.553514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2653): Launched 14:43:10.820844 run iperf3-srv_10.42.42.10(pid=2654): Launched 14:43:10.936626 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:43:11.139778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:43:11.450623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2655): Launched 14:43:11.715683 run iperf3-srv_10.42.42.10(pid=2656): Launched 14:43:11.830745 tst cs_paging_gprs_active.py:38: start network... 14:43:12.032834 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:43:12.503478 run create_hlr_db(pid=2657): Launched 14:43:12.620214 bus /sierra_2: Setting Powered False 14:43:13.679771 run create_hlr_db(pid=2657): Terminated: ok {rc=0} 14:43:14.100227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2659): Launched 14:43:14.405353 run osmo-hlr_10.42.42.2(pid=2660): Launched 14:43:14.522847 run osmo-stp_10.42.42.5: Starting osmo-stp 14:43:15.057607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2662): Launched 14:43:15.361386 run osmo-stp_10.42.42.5(pid=2663): Launched 14:43:15.478477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:43:16.038078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2665): Launched 14:43:16.178047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:43:16.466750 run patchelf(pid=2666): Launched 14:43:16.663996 run osmo-stp_10.42.42.5(pid=2663): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2663)] 14:43:16.826404 run osmo-stp_10.42.42.5(pid=2663): stdout: | (launched: 2022-12-14_14:43:15.306139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:43:16.974644 run osmo-stp_10.42.42.5(pid=2663): stderr: | 20221214144315477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144315477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144315477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144315477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144315478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144315478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144315478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:43:17.116405 run osmo-stp_10.42.42.5(pid=2663): stdout: | (launched: 2022-12-14_14:43:15.306139) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:43:17.252853 run osmo-stp_10.42.42.5(pid=2663): stderr: | 20221214144315477 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144315477 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144315477 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144315477 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144315478 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144315478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144315478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:43:17.411275 run patchelf(pid=2666): Terminating (SIGINT) 14:43:17.594381 run patchelf(pid=2666): Terminated: ok {rc=0} 14:43:17.725985 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2663): Process ended prematurely: osmo-stp_10.42.42.5(pid=2663) [trial-2406↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2663)] [trial-2406↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 14:43:17.736269 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 14:43:17.765097 run osmo-hlr_10.42.42.2(pid=2660): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2660)] 14:43:17.815228 run osmo-hlr_10.42.42.2(pid=2660): stdout: | (launched: 2022-12-14_14:43:14.349731) 14:43:17.867365 run osmo-hlr_10.42.42.2(pid=2660): stderr: | 20221214144314524 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144314524 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144314524 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144314524 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144314524 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144314524 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144314536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144314545 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144314545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144314545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:43:17.919628 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2653): Terminating (SIGTERM) 14:43:17.961994 run iperf3-srv_10.42.42.10(pid=2654): Terminating (SIGTERM) 14:43:18.004900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2655): Terminating (SIGTERM) 14:43:18.047346 run iperf3-srv_10.42.42.10(pid=2656): Terminating (SIGTERM) 14:43:18.089637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2659): Terminating (SIGTERM) 14:43:18.131984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2662): Terminating (SIGTERM) 14:43:18.174712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2665): Terminating (SIGTERM) 14:43:18.217158 --- ParallelTerminationStrategy: PID 2653 died... 14:43:18.237651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2653): Terminated: ok {rc=0} 14:43:18.284749 --- ParallelTerminationStrategy: PID 2654 died... 14:43:18.304663 run iperf3-srv_10.42.42.10(pid=2654): Terminated {rc=256} 14:43:18.351023 --- ParallelTerminationStrategy: PID 2655 died... 14:43:18.370633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2655): Terminated: ok {rc=0} 14:43:18.416934 --- ParallelTerminationStrategy: PID 2656 died... 14:43:18.436593 run iperf3-srv_10.42.42.10(pid=2656): Terminated {rc=256} 14:43:18.482781 --- ParallelTerminationStrategy: PID 2659 died... 14:43:18.502502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2659): Terminated: ok {rc=0} 14:43:18.549041 --- ParallelTerminationStrategy: PID 2662 died... 14:43:18.568744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2662): Terminated: ok {rc=0} 14:43:18.615200 --- ParallelTerminationStrategy: PID 2665 died... 14:43:18.634792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2665): Terminated: ok {rc=0} 14:43:18.722363 bus /gobi_0: Setting Powered False 14:43:19.821669 bus /gobi_0: Setting Powered False 14:43:20.938007 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200 iperf3.py ---------------------------------------------- 14:43:22.086641 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:22.098531 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 14:43:22.151759 tst iperf3.py: using LAC 41610 14:43:22.280784 tst iperf3.py: using RAC 45 14:43:22.407854 tst iperf3.py: using CellId 41610 14:43:22.534239 tst iperf3.py: using BVCI 41611 14:43:22.651373 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:22.662495 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:22.673790 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:22.684710 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:22.695715 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:22.706668 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:22.717917 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:22.729093 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:22.740305 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 14:43:22.858585 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:43:23.078002 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:43:23.403551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2667): Launched 14:43:23.686668 run iperf3-srv_10.42.42.10(pid=2668): Launched 14:43:23.808871 tst iperf3.py:8: start network... 14:43:24.026475 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:43:24.528315 run create_hlr_db(pid=2669): Launched 14:43:24.660884 bus /gobi_6: Setting Powered False 14:43:25.724472 run create_hlr_db(pid=2669): Terminated: ok {rc=0} 14:43:26.154101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2671): Launched 14:43:26.456620 run osmo-hlr_10.42.42.2(pid=2672): Launched 14:43:26.573437 run osmo-stp_10.42.42.5: Starting osmo-stp 14:43:27.107565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2674): Launched 14:43:27.411410 run osmo-stp_10.42.42.5(pid=2675): Launched 14:43:27.529764 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:43:28.052848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2677): Launched 14:43:28.170092 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:43:28.425195 run patchelf(pid=2678): Launched 14:43:28.595212 run osmo-stp_10.42.42.5(pid=2675): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2675)] 14:43:28.723957 run osmo-stp_10.42.42.5(pid=2675): stdout: | (launched: 2022-12-14_14:43:27.356389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:43:28.853501 run osmo-stp_10.42.42.5(pid=2675): stderr: | 20221214144327525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144327525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144327525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144327526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144327528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144327528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144327528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:43:28.982702 run osmo-stp_10.42.42.5(pid=2675): stdout: | (launched: 2022-12-14_14:43:27.356389) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:43:29.106528 run osmo-stp_10.42.42.5(pid=2675): stderr: | 20221214144327525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144327525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144327525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144327526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144327528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144327528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144327528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:43:29.253252 run patchelf(pid=2678): Terminating (SIGINT) 14:43:29.423646 run patchelf(pid=2678): Terminated: ok {rc=0} 14:43:29.546325 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2675): Process ended prematurely: osmo-stp_10.42.42.5(pid=2675) [trial-2406↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2675)] [trial-2406↪gprs:trx-b200↪iperf3.py:8] 14:43:29.555555 tst iperf3.py:8: Test FAILED (7.5 sec) 14:43:29.583065 run osmo-hlr_10.42.42.2(pid=2672): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2672)] 14:43:29.632249 run osmo-hlr_10.42.42.2(pid=2672): stdout: | (launched: 2022-12-14_14:43:26.401876) 14:43:29.682344 run osmo-hlr_10.42.42.2(pid=2672): stderr: | 20221214144326577 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144326578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144326578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144326578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144326578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144326578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144326590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144326598 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144326599 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144326599 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:43:29.732198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2667): Terminating (SIGTERM) 14:43:29.772284 run iperf3-srv_10.42.42.10(pid=2668): Terminating (SIGTERM) 14:43:29.812349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2671): Terminating (SIGTERM) 14:43:29.852478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2674): Terminating (SIGTERM) 14:43:29.892631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2677): Terminating (SIGTERM) 14:43:29.932878 --- ParallelTerminationStrategy: PID 2667 died... 14:43:29.952032 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2667): Terminated: ok {rc=0} 14:43:29.996320 --- ParallelTerminationStrategy: PID 2668 died... 14:43:30.015256 run iperf3-srv_10.42.42.10(pid=2668): Terminated {rc=256} 14:43:30.059295 --- ParallelTerminationStrategy: PID 2671 died... 14:43:30.078164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2671): Terminated: ok {rc=0} 14:43:30.122181 --- ParallelTerminationStrategy: PID 2674 died... 14:43:30.141123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2674): Terminated: ok {rc=0} 14:43:30.184939 --- ParallelTerminationStrategy: PID 2677 died... 14:43:30.203750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2677): Terminated: ok {rc=0} 14:43:30.289677 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 14:43:31.442434 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:31.455101 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 14:43:31.506597 tst iperf3m4.py: using LAC 41611 14:43:31.665518 tst iperf3m4.py: using RAC 46 14:43:31.823658 tst iperf3m4.py: using CellId 41611 14:43:31.979735 tst iperf3m4.py: using BVCI 41612 14:43:32.117994 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:32.130273 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:32.142251 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:32.154295 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:32.166717 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:32.180420 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:32.192434 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:32.203838 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:32.215334 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 14:43:32.340843 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 14:43:32.461790 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 14:43:32.581824 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 14:43:32.697509 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:43:32.899609 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:43:33.202284 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2679): Launched 14:43:33.466676 run iperf3-srv_10.42.42.10(pid=2680): Launched 14:43:33.581373 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:43:33.782361 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:43:34.085156 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2681): Launched 14:43:34.349605 run iperf3-srv_10.42.42.10(pid=2682): Launched 14:43:34.464491 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:43:34.665961 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:43:34.967941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2683): Launched 14:43:35.232346 run iperf3-srv_10.42.42.10(pid=2684): Launched 14:43:35.346372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:43:35.546892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:43:35.848398 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2685): Launched 14:43:36.111316 run iperf3-srv_10.42.42.10(pid=2686): Launched 14:43:36.225203 tst iperf3m4.py:8: start network... 14:43:36.426823 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:43:36.893553 run create_hlr_db(pid=2687): Launched 14:43:37.009342 bus /gobi_6: Setting Powered False 14:43:38.068213 run create_hlr_db(pid=2687): Terminated: ok {rc=0} 14:43:38.489826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2689): Launched 14:43:38.791179 run osmo-hlr_10.42.42.2(pid=2690): Launched 14:43:38.907444 run osmo-stp_10.42.42.5: Starting osmo-stp 14:43:39.442572 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2692): Launched 14:43:39.745330 run osmo-stp_10.42.42.5(pid=2693): Launched 14:43:39.861900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:43:40.382785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2695): Launched 14:43:40.499707 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:43:40.754379 run patchelf(pid=2696): Launched 14:43:40.924092 run osmo-stp_10.42.42.5(pid=2693): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2693)] 14:43:41.053248 run osmo-stp_10.42.42.5(pid=2693): stdout: | (launched: 2022-12-14_14:43:39.689782) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:43:41.182706 run osmo-stp_10.42.42.5(pid=2693): stderr: | 20221214144339861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144339861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144339861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144339862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144339862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144339862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144339862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:43:41.312078 run osmo-stp_10.42.42.5(pid=2693): stdout: | (launched: 2022-12-14_14:43:39.689782) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:43:41.435813 run osmo-stp_10.42.42.5(pid=2693): stderr: | 20221214144339861 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144339861 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144339861 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144339862 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144339862 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144339862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144339862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:43:41.582631 run patchelf(pid=2696): Terminating (SIGINT) 14:43:41.752863 run patchelf(pid=2696): Terminated: ok {rc=0} 14:43:41.875700 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2693): Process ended prematurely: osmo-stp_10.42.42.5(pid=2693) [trial-2406↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2693)] [trial-2406↪gprs:trx-b200↪iperf3m4.py:8] 14:43:41.885467 tst iperf3m4.py:8: Test FAILED (10.5 sec) 14:43:41.912876 run osmo-hlr_10.42.42.2(pid=2690): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2690)] 14:43:41.961335 run osmo-hlr_10.42.42.2(pid=2690): stdout: | (launched: 2022-12-14_14:43:38.736012) 14:43:42.010914 run osmo-hlr_10.42.42.2(pid=2690): stderr: | 20221214144338912 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144338912 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144338912 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144338912 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144338912 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144338912 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144338924 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144338932 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144338932 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144338932 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:43:42.060557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2679): Terminating (SIGTERM) 14:43:42.100755 run iperf3-srv_10.42.42.10(pid=2680): Terminating (SIGTERM) 14:43:42.140698 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2681): Terminating (SIGTERM) 14:43:42.180546 run iperf3-srv_10.42.42.10(pid=2682): Terminating (SIGTERM) 14:43:42.220267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2683): Terminating (SIGTERM) 14:43:42.260472 run iperf3-srv_10.42.42.10(pid=2684): Terminating (SIGTERM) 14:43:42.300837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2685): Terminating (SIGTERM) 14:43:42.341133 run iperf3-srv_10.42.42.10(pid=2686): Terminating (SIGTERM) 14:43:42.381062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2689): Terminating (SIGTERM) 14:43:42.420810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2692): Terminating (SIGTERM) 14:43:42.460691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2695): Terminating (SIGTERM) 14:43:42.501140 --- ParallelTerminationStrategy: PID 2679 died... 14:43:42.520682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2679): Terminated: ok {rc=0} 14:43:42.564906 --- ParallelTerminationStrategy: PID 2680 died... 14:43:42.584094 run iperf3-srv_10.42.42.10(pid=2680): Terminated {rc=256} 14:43:42.628192 --- ParallelTerminationStrategy: PID 2681 died... 14:43:42.647171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2681): Terminated: ok {rc=0} 14:43:42.691057 --- ParallelTerminationStrategy: PID 2682 died... 14:43:42.710137 run iperf3-srv_10.42.42.10(pid=2682): Terminated {rc=256} 14:43:42.753903 --- ParallelTerminationStrategy: PID 2683 died... 14:43:42.772839 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2683): Terminated: ok {rc=0} 14:43:42.816783 --- ParallelTerminationStrategy: PID 2684 died... 14:43:42.835751 run iperf3-srv_10.42.42.10(pid=2684): Terminated {rc=256} 14:43:42.879598 --- ParallelTerminationStrategy: PID 2685 died... 14:43:42.898497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2685): Terminated: ok {rc=0} 14:43:42.942386 --- ParallelTerminationStrategy: PID 2686 died... 14:43:42.961418 run iperf3-srv_10.42.42.10(pid=2686): Terminated {rc=256} 14:43:43.005289 --- ParallelTerminationStrategy: PID 2689 died... 14:43:43.024233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2689): Terminated: ok {rc=0} 14:43:43.068695 --- ParallelTerminationStrategy: PID 2692 died... 14:43:43.087794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2692): Terminated: ok {rc=0} 14:43:43.131677 --- ParallelTerminationStrategy: PID 2695 died... 14:43:43.150721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2695): Terminated: ok {rc=0} 14:43:43.236691 bus /gobi_4: Setting Powered False 14:43:44.338534 bus /gobi_4: Setting Powered False 14:43:45.456202 bus /gobi_1: Setting Powered False 14:43:46.550552 bus /gobi_1: Setting Powered False 14:43:47.664811 bus /gobi_0: Setting Powered False 14:43:48.762402 bus /gobi_0: Setting Powered False 14:43:49.880494 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200 ping.py ---------------------------------------------- 14:43:50.982851 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:50.994583 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 14:43:51.049342 tst ping.py: using LAC 41612 14:43:51.165555 tst ping.py: using RAC 47 14:43:51.290009 tst ping.py: using CellId 41612 14:43:51.412119 tst ping.py: using BVCI 41613 14:43:51.527659 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:51.538757 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:51.549701 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:51.560508 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:51.571863 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:51.583281 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:51.594708 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:51.606053 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 14:43:51.724573 tst ping.py:19: start network... 14:43:51.939587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:43:52.431150 run create_hlr_db(pid=2697): Launched 14:43:52.560468 bus /gobi_6: Setting Powered False 14:43:53.623941 run create_hlr_db(pid=2697): Terminated: ok {rc=0} 14:43:54.066109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2699): Launched 14:43:54.383792 run osmo-hlr_10.42.42.2(pid=2700): Launched 14:43:54.504754 run osmo-stp_10.42.42.5: Starting osmo-stp 14:43:55.058169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2702): Launched 14:43:55.376840 run osmo-stp_10.42.42.5(pid=2703): Launched 14:43:55.499043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:43:56.047491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2705): Launched 14:43:56.169455 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:43:56.436727 run patchelf(pid=2706): Launched 14:43:56.614310 run osmo-stp_10.42.42.5(pid=2703): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2703)] 14:43:56.748932 run osmo-stp_10.42.42.5(pid=2703): stdout: | (launched: 2022-12-14_14:43:55.319133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:43:56.884760 run osmo-stp_10.42.42.5(pid=2703): stderr: | 20221214144355509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144355509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144355509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144355510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144355510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144355510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144355510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:43:57.021060 run osmo-stp_10.42.42.5(pid=2703): stdout: | (launched: 2022-12-14_14:43:55.319133) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:43:57.150577 run osmo-stp_10.42.42.5(pid=2703): stderr: | 20221214144355509 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144355509 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144355509 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144355510 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144355510 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144355510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144355510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:43:57.305035 run patchelf(pid=2706): Terminating (SIGINT) 14:43:57.483586 run patchelf(pid=2706): Terminated: ok {rc=0} 14:43:57.611903 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2703): Process ended prematurely: osmo-stp_10.42.42.5(pid=2703) [trial-2406↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2703)] [trial-2406↪gprs:trx-b200↪ping.py:22] 14:43:57.621319 tst ping.py:22: Test FAILED (6.6 sec) 14:43:57.649306 run osmo-hlr_10.42.42.2(pid=2700): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2700)] 14:43:57.699052 run osmo-hlr_10.42.42.2(pid=2700): stdout: | (launched: 2022-12-14_14:43:54.326053) 14:43:57.750735 run osmo-hlr_10.42.42.2(pid=2700): stderr: | 20221214144354521 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144354521 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144354521 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144354521 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144354521 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144354521 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144354534 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144354542 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144354542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144354542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:43:57.802523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2699): Terminating (SIGTERM) 14:43:57.844330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2702): Terminating (SIGTERM) 14:43:57.886461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2705): Terminating (SIGTERM) 14:43:57.928663 --- ParallelTerminationStrategy: PID 2699 died... 14:43:57.948608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2699): Terminated: ok {rc=0} 14:43:57.994562 --- ParallelTerminationStrategy: PID 2702 died... 14:43:58.014040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2702): Terminated: ok {rc=0} 14:43:58.059967 --- ParallelTerminationStrategy: PID 2705 died... 14:43:58.079462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2705): Terminated: ok {rc=0} 14:43:58.166824 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 14:43:59.254044 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:59.265702 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 14:43:59.321167 tst ping_idle_ping.py: using LAC 41613 14:43:59.445642 tst ping_idle_ping.py: using RAC 48 14:43:59.562373 tst ping_idle_ping.py: using CellId 41613 14:43:59.680719 tst ping_idle_ping.py: using BVCI 41614 14:43:59.788381 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:59.799082 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:59.809649 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:59.820275 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:59.831138 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:59.842338 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:59.853283 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 14:43:59.863926 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 14:43:59.982882 tst ping_idle_ping.py:24: start network... 14:44:00.197522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:44:00.692800 run create_hlr_db(pid=2707): Launched 14:44:00.823311 bus /gobi_6: Setting Powered False 14:44:01.900482 run create_hlr_db(pid=2707): Terminated: ok {rc=0} 14:44:02.390476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2709): Launched 14:44:02.709339 run osmo-hlr_10.42.42.2(pid=2710): Launched 14:44:02.830002 run osmo-stp_10.42.42.5: Starting osmo-stp 14:44:03.382569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2712): Launched 14:44:03.699896 run osmo-stp_10.42.42.5(pid=2713): Launched 14:44:03.821655 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:44:04.368884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2715): Launched 14:44:04.491209 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:44:04.759900 run patchelf(pid=2716): Launched 14:44:04.938059 run osmo-stp_10.42.42.5(pid=2713): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2713)] 14:44:05.073233 run osmo-stp_10.42.42.5(pid=2713): stdout: | (launched: 2022-12-14_14:44:03.642134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:05.209666 run osmo-stp_10.42.42.5(pid=2713): stderr: | 20221214144403833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144403833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144403833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144403834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144403834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144403834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144403834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:05.347184 run osmo-stp_10.42.42.5(pid=2713): stdout: | (launched: 2022-12-14_14:44:03.642134) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:05.477335 run osmo-stp_10.42.42.5(pid=2713): stderr: | 20221214144403833 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144403833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144403833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144403834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144403834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144403834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144403834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:05.631905 run patchelf(pid=2716): Terminating (SIGINT) 14:44:05.810122 run patchelf(pid=2716): Terminated: ok {rc=0} 14:44:05.938369 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2713): Process ended prematurely: osmo-stp_10.42.42.5(pid=2713) [trial-2406↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2713)] [trial-2406↪gprs:trx-b200↪ping_idle_ping.py:27] 14:44:05.947790 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 14:44:05.975893 run osmo-hlr_10.42.42.2(pid=2710): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2710)] 14:44:06.025538 run osmo-hlr_10.42.42.2(pid=2710): stdout: | (launched: 2022-12-14_14:44:02.650916) 14:44:06.077190 run osmo-hlr_10.42.42.2(pid=2710): stderr: | 20221214144402850 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144402851 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144402851 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144402851 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144402851 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144402851 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144402863 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144402873 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144402873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144402874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:44:06.129448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2709): Terminating (SIGTERM) 14:44:06.170948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2712): Terminating (SIGTERM) 14:44:06.212491 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2715): Terminating (SIGTERM) 14:44:06.254764 --- ParallelTerminationStrategy: PID 2709 died... 14:44:06.274735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2709): Terminated: ok {rc=0} 14:44:06.320650 --- ParallelTerminationStrategy: PID 2712 died... 14:44:06.340081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2712): Terminated: ok {rc=0} 14:44:06.385708 --- ParallelTerminationStrategy: PID 2715 died... 14:44:06.405205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2715): Terminated: ok {rc=0} 14:44:06.491244 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 14:44:07.797655 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:44:07.803316 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 14:44:07.836689 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 14:44:07.875654 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 14:44:07.962997 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 14:44:07.996252 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 14:44:08.035128 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 14:44:08.630742 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 14:44:08.682613 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:08.693820 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:44:08.744837 tst cs_paging_gprs_active.py: using LAC 41614 14:44:08.871503 tst cs_paging_gprs_active.py: using RAC 49 14:44:08.998926 tst cs_paging_gprs_active.py: using CellId 41614 14:44:09.127611 tst cs_paging_gprs_active.py: using BVCI 41615 14:44:09.245129 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:09.256400 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:09.267445 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:09.278490 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:09.289484 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:09.300413 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:09.311551 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:09.322496 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:09.333673 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:44:09.453364 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:44:09.569229 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:44:09.772137 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:44:10.075223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2721): Launched 14:44:10.340194 run iperf3-srv_10.42.42.10(pid=2722): Launched 14:44:10.455253 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:44:10.658274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:44:10.963219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2723): Launched 14:44:11.227757 run iperf3-srv_10.42.42.10(pid=2724): Launched 14:44:11.342112 tst cs_paging_gprs_active.py:38: start network... 14:44:11.543932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:44:12.011860 run create_hlr_db(pid=2725): Launched 14:44:12.129149 bus /gobi_6: Setting Powered False 14:44:13.189844 run create_hlr_db(pid=2725): Terminated: ok {rc=0} 14:44:13.631730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2727): Launched 14:44:13.955462 run osmo-hlr_10.42.42.2(pid=2728): Launched 14:44:14.079604 run osmo-stp_10.42.42.5: Starting osmo-stp 14:44:14.635799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2730): Launched 14:44:14.960239 run osmo-stp_10.42.42.5(pid=2731): Launched 14:44:15.084403 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:44:15.641362 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2733): Launched 14:44:15.766457 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:44:16.065098 run patchelf(pid=2734): Launched 14:44:16.263074 run osmo-stp_10.42.42.5(pid=2731): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2731)] 14:44:16.403491 run osmo-stp_10.42.42.5(pid=2731): stdout: | (launched: 2022-12-14_14:44:14.901725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:16.544245 run osmo-stp_10.42.42.5(pid=2731): stderr: | 20221214144415096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144415096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144415096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144415097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144415097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144415097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144415097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:16.685353 run osmo-stp_10.42.42.5(pid=2731): stdout: | (launched: 2022-12-14_14:44:14.901725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:16.821812 run osmo-stp_10.42.42.5(pid=2731): stderr: | 20221214144415096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144415096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144415096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144415097 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144415097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144415097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144415097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:16.983399 run patchelf(pid=2734): Terminating (SIGINT) 14:44:17.170084 run patchelf(pid=2734): Terminated: ok {rc=0} 14:44:17.303245 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2731): Process ended prematurely: osmo-stp_10.42.42.5(pid=2731) [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2731)] [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 14:44:17.312810 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 14:44:17.340190 run osmo-hlr_10.42.42.2(pid=2728): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2728)] 14:44:17.393381 run osmo-hlr_10.42.42.2(pid=2728): stdout: | (launched: 2022-12-14_14:44:13.897122) 14:44:17.445136 run osmo-hlr_10.42.42.2(pid=2728): stderr: | 20221214144414096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144414096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144414096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144414096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144414096 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144414096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144414109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144414118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144414118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144414118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:44:17.497103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2721): Terminating (SIGTERM) 14:44:17.538902 run iperf3-srv_10.42.42.10(pid=2722): Terminating (SIGTERM) 14:44:17.580566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2723): Terminating (SIGTERM) 14:44:17.622804 run iperf3-srv_10.42.42.10(pid=2724): Terminating (SIGTERM) 14:44:17.664469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2727): Terminating (SIGTERM) 14:44:17.706797 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2730): Terminating (SIGTERM) 14:44:17.748333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2733): Terminating (SIGTERM) 14:44:17.790554 --- ParallelTerminationStrategy: PID 2721 died... 14:44:17.810525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2721): Terminated: ok {rc=0} 14:44:17.856343 --- ParallelTerminationStrategy: PID 2722 died... 14:44:17.875612 run iperf3-srv_10.42.42.10(pid=2722): Terminated {rc=256} 14:44:17.921055 --- ParallelTerminationStrategy: PID 2723 died... 14:44:17.940308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2723): Terminated: ok {rc=0} 14:44:17.985867 --- ParallelTerminationStrategy: PID 2724 died... 14:44:18.005281 run iperf3-srv_10.42.42.10(pid=2724): Terminated {rc=256} 14:44:18.050757 --- ParallelTerminationStrategy: PID 2727 died... 14:44:18.070122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2727): Terminated: ok {rc=0} 14:44:18.115780 --- ParallelTerminationStrategy: PID 2730 died... 14:44:18.135242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2730): Terminated: ok {rc=0} 14:44:18.180873 --- ParallelTerminationStrategy: PID 2733 died... 14:44:18.200690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2733): Terminated: ok {rc=0} 14:44:18.289143 bus /gobi_0: Setting Powered False 14:44:19.388940 bus /gobi_0: Setting Powered False 14:44:20.504178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 14:44:21.653158 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:21.665250 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:44:21.720564 tst iperf3.py: using LAC 41615 14:44:21.848619 tst iperf3.py: using RAC 50 14:44:21.975781 tst iperf3.py: using CellId 41615 14:44:22.103864 tst iperf3.py: using BVCI 41616 14:44:22.220907 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:22.232226 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:22.243242 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:22.254705 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:22.265802 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:22.276712 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:22.287928 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:22.299447 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:22.310646 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:44:22.429455 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:44:22.648022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:44:22.973404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2735): Launched 14:44:23.255628 run iperf3-srv_10.42.42.10(pid=2736): Launched 14:44:23.378306 tst iperf3.py:8: start network... 14:44:23.596526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:44:24.097286 run create_hlr_db(pid=2737): Launched 14:44:24.229701 bus /gobi_6: Setting Powered False 14:44:25.294246 run create_hlr_db(pid=2737): Terminated: ok {rc=0} 14:44:25.744668 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2739): Launched 14:44:26.067511 run osmo-hlr_10.42.42.2(pid=2740): Launched 14:44:26.191176 run osmo-stp_10.42.42.5: Starting osmo-stp 14:44:26.747066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2742): Launched 14:44:27.069731 run osmo-stp_10.42.42.5(pid=2743): Launched 14:44:27.193115 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:44:27.749904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2745): Launched 14:44:27.874242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:44:28.146936 run patchelf(pid=2746): Launched 14:44:28.327571 run osmo-stp_10.42.42.5(pid=2743): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2743)] 14:44:28.465335 run osmo-stp_10.42.42.5(pid=2743): stdout: | (launched: 2022-12-14_14:44:27.011344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:28.603862 run osmo-stp_10.42.42.5(pid=2743): stderr: | 20221214144427204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144427204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144427205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144427205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144427206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144427206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144427206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:28.742536 run osmo-stp_10.42.42.5(pid=2743): stdout: | (launched: 2022-12-14_14:44:27.011344) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:28.875095 run osmo-stp_10.42.42.5(pid=2743): stderr: | 20221214144427204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144427204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144427205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144427205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144427206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144427206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144427206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:29.031820 run patchelf(pid=2746): Terminating (SIGINT) 14:44:29.213615 run patchelf(pid=2746): Terminated: ok {rc=0} 14:44:29.345484 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2743): Process ended prematurely: osmo-stp_10.42.42.5(pid=2743) [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2743)] [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 14:44:29.355566 tst iperf3.py:8: Test FAILED (7.7 sec) 14:44:29.384259 run osmo-hlr_10.42.42.2(pid=2740): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2740)] 14:44:29.434442 run osmo-hlr_10.42.42.2(pid=2740): stdout: | (launched: 2022-12-14_14:44:26.009018) 14:44:29.486566 run osmo-hlr_10.42.42.2(pid=2740): stderr: | 20221214144426208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144426208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144426208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144426208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144426208 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144426208 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144426239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144426248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144426249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144426249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:44:29.538840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2735): Terminating (SIGTERM) 14:44:29.580763 run iperf3-srv_10.42.42.10(pid=2736): Terminating (SIGTERM) 14:44:29.622431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2739): Terminating (SIGTERM) 14:44:29.664211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2742): Terminating (SIGTERM) 14:44:29.706009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2745): Terminating (SIGTERM) 14:44:29.747837 --- ParallelTerminationStrategy: PID 2735 died... 14:44:29.767887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2735): Terminated: ok {rc=0} 14:44:29.814216 --- ParallelTerminationStrategy: PID 2736 died... 14:44:29.833613 run iperf3-srv_10.42.42.10(pid=2736): Terminated {rc=256} 14:44:29.879370 --- ParallelTerminationStrategy: PID 2739 died... 14:44:29.898982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2739): Terminated: ok {rc=0} 14:44:29.944623 --- ParallelTerminationStrategy: PID 2742 died... 14:44:29.964166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2742): Terminated: ok {rc=0} 14:44:30.009848 --- ParallelTerminationStrategy: PID 2745 died... 14:44:30.029228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2745): Terminated: ok {rc=0} 14:44:30.116309 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 14:44:31.277333 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:31.294260 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:44:31.360488 tst iperf3m4.py: using LAC 41616 14:44:31.517206 tst iperf3m4.py: using RAC 51 14:44:31.657341 tst iperf3m4.py: using CellId 41616 14:44:31.787525 tst iperf3m4.py: using BVCI 41617 14:44:31.964508 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:31.977775 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:31.992797 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:32.008650 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:32.025523 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:32.042099 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:32.058533 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:32.074615 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:32.090912 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:44:32.239574 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:44:32.364682 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:44:32.480388 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:44:32.596101 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:44:32.798119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:44:33.100870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2747): Launched 14:44:33.365427 run iperf3-srv_10.42.42.10(pid=2748): Launched 14:44:33.479296 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:44:33.679634 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:44:33.981791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2749): Launched 14:44:34.245162 run iperf3-srv_10.42.42.10(pid=2750): Launched 14:44:34.358995 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:44:34.560112 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:44:34.862179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2751): Launched 14:44:35.125303 run iperf3-srv_10.42.42.10(pid=2752): Launched 14:44:35.238821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:44:35.438911 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:44:35.740811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2753): Launched 14:44:36.004030 run iperf3-srv_10.42.42.10(pid=2754): Launched 14:44:36.118354 tst iperf3m4.py:8: start network... 14:44:36.319397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:44:36.785636 run create_hlr_db(pid=2755): Launched 14:44:36.902341 bus /gobi_6: Setting Powered False 14:44:37.961950 run create_hlr_db(pid=2755): Terminated: ok {rc=0} 14:44:38.404211 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2757): Launched 14:44:38.729311 run osmo-hlr_10.42.42.2(pid=2758): Launched 14:44:38.854995 run osmo-stp_10.42.42.5: Starting osmo-stp 14:44:39.416249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2760): Launched 14:44:39.740880 run osmo-stp_10.42.42.5(pid=2761): Launched 14:44:39.864657 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:44:40.424280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2763): Launched 14:44:40.548255 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:44:40.820435 run patchelf(pid=2764): Launched 14:44:41.001682 run osmo-stp_10.42.42.5(pid=2761): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2761)] 14:44:41.139512 run osmo-stp_10.42.42.5(pid=2761): stdout: | (launched: 2022-12-14_14:44:39.682013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:41.278366 run osmo-stp_10.42.42.5(pid=2761): stderr: | 20221214144439874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144439874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144439875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144439875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144439875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144439875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144439875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:41.416231 run osmo-stp_10.42.42.5(pid=2761): stdout: | (launched: 2022-12-14_14:44:39.682013) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:41.548619 run osmo-stp_10.42.42.5(pid=2761): stderr: | 20221214144439874 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144439874 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144439875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144439875 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144439875 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144439875 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144439875 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:41.705701 run patchelf(pid=2764): Terminating (SIGINT) 14:44:41.887036 run patchelf(pid=2764): Terminated: ok {rc=0} 14:44:42.018068 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2761): Process ended prematurely: osmo-stp_10.42.42.5(pid=2761) [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2761)] [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 14:44:42.028317 tst iperf3m4.py:8: Test FAILED (10.8 sec) 14:44:42.057101 run osmo-hlr_10.42.42.2(pid=2758): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2758)] 14:44:42.106642 run osmo-hlr_10.42.42.2(pid=2758): stdout: | (launched: 2022-12-14_14:44:38.670511) 14:44:42.158205 run osmo-hlr_10.42.42.2(pid=2758): stderr: | 20221214144438868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144438868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144438868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144438868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144438868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144438868 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144438879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144438888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144438888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144438888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:44:42.210092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2747): Terminating (SIGTERM) 14:44:42.251847 run iperf3-srv_10.42.42.10(pid=2748): Terminating (SIGTERM) 14:44:42.293812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2749): Terminating (SIGTERM) 14:44:42.335534 run iperf3-srv_10.42.42.10(pid=2750): Terminating (SIGTERM) 14:44:42.378379 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2751): Terminating (SIGTERM) 14:44:42.420093 run iperf3-srv_10.42.42.10(pid=2752): Terminating (SIGTERM) 14:44:42.461904 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2753): Terminating (SIGTERM) 14:44:42.503736 run iperf3-srv_10.42.42.10(pid=2754): Terminating (SIGTERM) 14:44:42.545408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2757): Terminating (SIGTERM) 14:44:42.586739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2760): Terminating (SIGTERM) 14:44:42.628530 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2763): Terminating (SIGTERM) 14:44:42.670330 --- ParallelTerminationStrategy: PID 2747 died... 14:44:42.689982 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2747): Terminated: ok {rc=0} 14:44:42.735734 --- ParallelTerminationStrategy: PID 2748 died... 14:44:42.755067 run iperf3-srv_10.42.42.10(pid=2748): Terminated {rc=256} 14:44:42.800442 --- ParallelTerminationStrategy: PID 2749 died... 14:44:42.819833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2749): Terminated: ok {rc=0} 14:44:42.865431 --- ParallelTerminationStrategy: PID 2750 died... 14:44:42.884777 run iperf3-srv_10.42.42.10(pid=2750): Terminated {rc=256} 14:44:42.930257 --- ParallelTerminationStrategy: PID 2751 died... 14:44:42.949630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2751): Terminated: ok {rc=0} 14:44:42.995664 --- ParallelTerminationStrategy: PID 2752 died... 14:44:43.014991 run iperf3-srv_10.42.42.10(pid=2752): Terminated {rc=256} 14:44:43.060482 --- ParallelTerminationStrategy: PID 2753 died... 14:44:43.079974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2753): Terminated: ok {rc=0} 14:44:43.125497 --- ParallelTerminationStrategy: PID 2754 died... 14:44:43.144863 run iperf3-srv_10.42.42.10(pid=2754): Terminated {rc=256} 14:44:43.190515 --- ParallelTerminationStrategy: PID 2757 died... 14:44:43.209940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2757): Terminated: ok {rc=0} 14:44:43.255423 --- ParallelTerminationStrategy: PID 2760 died... 14:44:43.275182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2760): Terminated: ok {rc=0} 14:44:43.321040 --- ParallelTerminationStrategy: PID 2763 died... 14:44:43.340579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2763): Terminated: ok {rc=0} 14:44:43.427568 bus /gobi_4: Setting Powered False 14:44:44.525519 bus /gobi_4: Setting Powered False 14:44:45.641641 bus /gobi_1: Setting Powered False 14:44:46.746327 bus /gobi_1: Setting Powered False 14:44:47.876772 bus /gobi_0: Setting Powered False 14:44:48.975296 bus /gobi_0: Setting Powered False 14:44:50.091701 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 14:44:51.195914 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:51.207377 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:44:51.257434 tst ping.py: using LAC 41617 14:44:51.383824 tst ping.py: using RAC 52 14:44:51.510744 tst ping.py: using CellId 41617 14:44:51.636462 tst ping.py: using BVCI 41618 14:44:51.751416 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:51.762936 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:51.774254 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:51.785395 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:51.796483 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:51.807562 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:51.818835 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:51.829897 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:44:51.947961 tst ping.py:19: start network... 14:44:52.161145 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:44:52.651537 run create_hlr_db(pid=2765): Launched 14:44:52.780527 bus /gobi_6: Setting Powered False 14:44:53.842596 run create_hlr_db(pid=2765): Terminated: ok {rc=0} 14:44:54.267948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2767): Launched 14:44:54.565392 run osmo-hlr_10.42.42.2(pid=2768): Launched 14:44:54.679911 run osmo-stp_10.42.42.5: Starting osmo-stp 14:44:55.207201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2770): Launched 14:44:55.502591 run osmo-stp_10.42.42.5(pid=2771): Launched 14:44:55.615358 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:44:56.125781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2773): Launched 14:44:56.239783 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:44:56.489660 run patchelf(pid=2774): Launched 14:44:56.655884 run osmo-stp_10.42.42.5(pid=2771): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2771)] 14:44:56.782024 run osmo-stp_10.42.42.5(pid=2771): stdout: | (launched: 2022-12-14_14:44:55.448761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:56.909245 run osmo-stp_10.42.42.5(pid=2771): stderr: | 20221214144455619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144455619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144455619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144455620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144455620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144455620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144455620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:57.037243 run osmo-stp_10.42.42.5(pid=2771): stdout: | (launched: 2022-12-14_14:44:55.448761) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:44:57.158896 run osmo-stp_10.42.42.5(pid=2771): stderr: | 20221214144455619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144455619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144455619 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144455620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144455620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144455620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144455620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:44:57.302867 run patchelf(pid=2774): Terminating (SIGINT) 14:44:57.470137 run patchelf(pid=2774): Terminated: ok {rc=0} 14:44:57.590943 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2771): Process ended prematurely: osmo-stp_10.42.42.5(pid=2771) [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2771)] [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 14:44:57.599775 tst ping.py:22: Test FAILED (6.4 sec) 14:44:57.626731 run osmo-hlr_10.42.42.2(pid=2768): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2768)] 14:44:57.675063 run osmo-hlr_10.42.42.2(pid=2768): stdout: | (launched: 2022-12-14_14:44:54.510862) 14:44:57.725051 run osmo-hlr_10.42.42.2(pid=2768): stderr: | 20221214144454687 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144454688 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144454688 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144454688 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144454688 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144454688 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144454705 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144454714 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144454715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144454715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:44:57.775323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2767): Terminating (SIGTERM) 14:44:57.816064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2770): Terminating (SIGTERM) 14:44:57.856603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2773): Terminating (SIGTERM) 14:44:57.897498 --- ParallelTerminationStrategy: PID 2767 died... 14:44:57.917067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2767): Terminated: ok {rc=0} 14:44:57.961647 --- ParallelTerminationStrategy: PID 2770 died... 14:44:57.980519 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2770): Terminated: ok {rc=0} 14:44:58.025151 --- ParallelTerminationStrategy: PID 2773 died... 14:44:58.043950 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2773): Terminated: ok {rc=0} 14:44:58.131585 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 14:44:59.219779 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:59.231287 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:44:59.281617 tst ping_idle_ping.py: using LAC 41618 14:44:59.397633 tst ping_idle_ping.py: using RAC 53 14:44:59.522312 tst ping_idle_ping.py: using CellId 41618 14:44:59.641759 tst ping_idle_ping.py: using BVCI 41619 14:44:59.759080 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:59.770697 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:59.782052 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:59.793416 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:59.804771 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:59.816237 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:59.827814 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:44:59.838984 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:44:59.953546 tst ping_idle_ping.py:24: start network... 14:45:00.152733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:45:00.614081 run create_hlr_db(pid=2775): Launched 14:45:00.727813 bus /gobi_6: Setting Powered False 14:45:01.786791 run create_hlr_db(pid=2775): Terminated: ok {rc=0} 14:45:02.217994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2780): Launched 14:45:02.525587 run osmo-hlr_10.42.42.2(pid=2781): Launched 14:45:02.640218 run osmo-stp_10.42.42.5: Starting osmo-stp 14:45:03.165139 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2783): Launched 14:45:03.463488 run osmo-stp_10.42.42.5(pid=2784): Launched 14:45:03.577595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:45:04.092467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2786): Launched 14:45:04.207370 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:45:04.457870 run patchelf(pid=2787): Launched 14:45:04.624296 run osmo-stp_10.42.42.5(pid=2784): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2784)] 14:45:04.750811 run osmo-stp_10.42.42.5(pid=2784): stdout: | (launched: 2022-12-14_14:45:03.409236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:04.878185 run osmo-stp_10.42.42.5(pid=2784): stderr: | 20221214144503579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144503579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144503580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144503580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144503580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144503581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144503581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:05.006271 run osmo-stp_10.42.42.5(pid=2784): stdout: | (launched: 2022-12-14_14:45:03.409236) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:05.128048 run osmo-stp_10.42.42.5(pid=2784): stderr: | 20221214144503579 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144503579 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144503580 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144503580 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144503580 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144503581 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144503581 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:05.273320 run patchelf(pid=2787): Terminating (SIGINT) 14:45:05.441517 run patchelf(pid=2787): Terminated: ok {rc=0} 14:45:05.562571 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2784): Process ended prematurely: osmo-stp_10.42.42.5(pid=2784) [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2784)] [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 14:45:05.571404 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 14:45:05.598418 run osmo-hlr_10.42.42.2(pid=2781): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2781)] 14:45:05.646989 run osmo-hlr_10.42.42.2(pid=2781): stdout: | (launched: 2022-12-14_14:45:02.470830) 14:45:05.697373 run osmo-hlr_10.42.42.2(pid=2781): stderr: | 20221214144502645 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144502645 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144502645 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144502645 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144502645 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144502645 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144502657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144502666 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144502666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144502666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:45:05.747629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2780): Terminating (SIGTERM) 14:45:05.788129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2783): Terminating (SIGTERM) 14:45:05.828728 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2786): Terminating (SIGTERM) 14:45:05.869145 --- ParallelTerminationStrategy: PID 2780 died... 14:45:05.888776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2780): Terminated: ok {rc=0} 14:45:05.933112 --- ParallelTerminationStrategy: PID 2783 died... 14:45:05.952038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2783): Terminated: ok {rc=0} 14:45:05.996418 --- ParallelTerminationStrategy: PID 2786 died... 14:45:06.015392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2786): Terminated: ok {rc=0} 14:45:06.100247 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 14:45:07.409349 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:45:07.415848 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 14:45:07.449605 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 14:45:07.489123 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 14:45:07.579285 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 14:45:07.613174 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 14:45:07.651616 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 14:45:08.245450 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 14:45:08.298510 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:08.309980 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:45:08.385587 tst cs_paging_gprs_active.py: using LAC 41619 14:45:08.511168 tst cs_paging_gprs_active.py: using RAC 54 14:45:08.631665 tst cs_paging_gprs_active.py: using CellId 41619 14:45:08.749325 tst cs_paging_gprs_active.py: using BVCI 41620 14:45:08.859872 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:08.870803 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:08.881401 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:08.892057 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:08.903618 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:08.915091 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:08.926645 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:08.937933 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:08.949443 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:45:09.066812 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:45:09.182382 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:45:09.385771 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:45:09.688907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2792): Launched 14:45:09.953801 run iperf3-srv_10.42.42.10(pid=2793): Launched 14:45:10.068771 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:45:10.271147 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:45:10.574504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2794): Launched 14:45:10.839545 run iperf3-srv_10.42.42.10(pid=2795): Launched 14:45:10.954204 tst cs_paging_gprs_active.py:38: start network... 14:45:11.155612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:45:11.625098 run create_hlr_db(pid=2796): Launched 14:45:11.741604 bus /gobi_6: Setting Powered False 14:45:12.801540 run create_hlr_db(pid=2796): Terminated: ok {rc=0} 14:45:13.245658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2798): Launched 14:45:13.571993 run osmo-hlr_10.42.42.2(pid=2799): Launched 14:45:13.697644 run osmo-stp_10.42.42.5: Starting osmo-stp 14:45:14.261040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2801): Launched 14:45:14.587369 run osmo-stp_10.42.42.5(pid=2802): Launched 14:45:14.714232 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:45:15.273698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2804): Launched 14:45:15.399191 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:45:15.673004 run patchelf(pid=2805): Launched 14:45:15.867764 run osmo-stp_10.42.42.5(pid=2802): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2802)] 14:45:16.010204 run osmo-stp_10.42.42.5(pid=2802): stdout: | (launched: 2022-12-14_14:45:14.528264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:16.143969 run osmo-stp_10.42.42.5(pid=2802): stderr: | 20221214144514720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144514720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144514720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144514721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144514721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144514721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144514721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:16.280124 run osmo-stp_10.42.42.5(pid=2802): stdout: | (launched: 2022-12-14_14:45:14.528264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:16.410906 run osmo-stp_10.42.42.5(pid=2802): stderr: | 20221214144514720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144514720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144514720 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144514721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144514721 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144514721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144514721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:16.564548 run patchelf(pid=2805): Terminating (SIGINT) 14:45:16.742834 run patchelf(pid=2805): Terminated: ok {rc=0} 14:45:16.872413 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2802): Process ended prematurely: osmo-stp_10.42.42.5(pid=2802) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2802)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 14:45:16.882964 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 14:45:16.911826 run osmo-hlr_10.42.42.2(pid=2799): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2799)] 14:45:16.964896 run osmo-hlr_10.42.42.2(pid=2799): stdout: | (launched: 2022-12-14_14:45:13.513138) 14:45:17.018550 run osmo-hlr_10.42.42.2(pid=2799): stderr: | 20221214144513714 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144513714 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144513714 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144513714 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144513714 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144513714 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144513726 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144513735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144513735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144513735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:45:17.072231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2792): Terminating (SIGTERM) 14:45:17.114287 run iperf3-srv_10.42.42.10(pid=2793): Terminating (SIGTERM) 14:45:17.157066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2794): Terminating (SIGTERM) 14:45:17.201237 run iperf3-srv_10.42.42.10(pid=2795): Terminating (SIGTERM) 14:45:17.242789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2798): Terminating (SIGTERM) 14:45:17.284329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2801): Terminating (SIGTERM) 14:45:17.325647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2804): Terminating (SIGTERM) 14:45:17.368338 --- ParallelTerminationStrategy: PID 2792 died... 14:45:17.387744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2792): Terminated: ok {rc=0} 14:45:17.432684 --- ParallelTerminationStrategy: PID 2793 died... 14:45:17.451851 run iperf3-srv_10.42.42.10(pid=2793): Terminated {rc=256} 14:45:17.496434 --- ParallelTerminationStrategy: PID 2794 died... 14:45:17.515581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2794): Terminated: ok {rc=0} 14:45:17.560337 --- ParallelTerminationStrategy: PID 2795 died... 14:45:17.579574 run iperf3-srv_10.42.42.10(pid=2795): Terminated {rc=256} 14:45:17.624131 --- ParallelTerminationStrategy: PID 2798 died... 14:45:17.643132 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2798): Terminated: ok {rc=0} 14:45:17.687792 --- ParallelTerminationStrategy: PID 2801 died... 14:45:17.706986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2801): Terminated: ok {rc=0} 14:45:17.751384 --- ParallelTerminationStrategy: PID 2804 died... 14:45:17.770523 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2804): Terminated: ok {rc=0} 14:45:17.855645 bus /gobi_0: Setting Powered False 14:45:18.954057 bus /gobi_0: Setting Powered False 14:45:20.071984 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 14:45:21.218635 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:21.230371 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:45:21.302796 tst iperf3.py: using LAC 41620 14:45:21.421473 tst iperf3.py: using RAC 55 14:45:21.548441 tst iperf3.py: using CellId 41620 14:45:21.676594 tst iperf3.py: using BVCI 41621 14:45:21.793576 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:21.804908 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:21.816111 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:21.827293 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:21.838393 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:21.849543 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:21.860742 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:21.871670 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:21.883032 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:45:21.999091 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:45:22.201877 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:45:22.505400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2806): Launched 14:45:22.769260 run iperf3-srv_10.42.42.10(pid=2807): Launched 14:45:22.883310 tst iperf3.py:8: start network... 14:45:23.084606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:45:23.551756 run create_hlr_db(pid=2808): Launched 14:45:23.669487 bus /gobi_6: Setting Powered False 14:45:24.729563 run create_hlr_db(pid=2808): Terminated: ok {rc=0} 14:45:25.172306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2810): Launched 14:45:25.496272 run osmo-hlr_10.42.42.2(pid=2811): Launched 14:45:25.620686 run osmo-stp_10.42.42.5: Starting osmo-stp 14:45:26.177267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2813): Launched 14:45:26.501549 run osmo-stp_10.42.42.5(pid=2814): Launched 14:45:26.626367 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:45:27.185293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2816): Launched 14:45:27.310359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:45:27.584171 run patchelf(pid=2817): Launched 14:45:27.764589 run osmo-stp_10.42.42.5(pid=2814): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2814)] 14:45:27.901556 run osmo-stp_10.42.42.5(pid=2814): stdout: | (launched: 2022-12-14_14:45:26.442917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:28.039159 run osmo-stp_10.42.42.5(pid=2814): stderr: | 20221214144526635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144526635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144526635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144526635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144526636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144526636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144526636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:28.176725 run osmo-stp_10.42.42.5(pid=2814): stdout: | (launched: 2022-12-14_14:45:26.442917) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:28.309100 run osmo-stp_10.42.42.5(pid=2814): stderr: | 20221214144526635 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144526635 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144526635 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144526635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144526636 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144526636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144526636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:28.466009 run patchelf(pid=2817): Terminating (SIGINT) 14:45:28.647237 run patchelf(pid=2817): Terminated: ok {rc=0} 14:45:28.777790 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2814): Process ended prematurely: osmo-stp_10.42.42.5(pid=2814) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2814)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 14:45:28.787748 tst iperf3.py:8: Test FAILED (7.6 sec) 14:45:28.816462 run osmo-hlr_10.42.42.2(pid=2811): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2811)] 14:45:28.866685 run osmo-hlr_10.42.42.2(pid=2811): stdout: | (launched: 2022-12-14_14:45:25.438077) 14:45:28.918992 run osmo-hlr_10.42.42.2(pid=2811): stderr: | 20221214144525635 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144525635 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144525635 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144525636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144525636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144525636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144525648 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144525657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144525658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144525658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:45:28.971238 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2806): Terminating (SIGTERM) 14:45:29.013218 run iperf3-srv_10.42.42.10(pid=2807): Terminating (SIGTERM) 14:45:29.055323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2810): Terminating (SIGTERM) 14:45:29.097325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2813): Terminating (SIGTERM) 14:45:29.139184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2816): Terminating (SIGTERM) 14:45:29.181409 --- ParallelTerminationStrategy: PID 2806 died... 14:45:29.201448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2806): Terminated: ok {rc=0} 14:45:29.247721 --- ParallelTerminationStrategy: PID 2807 died... 14:45:29.267321 run iperf3-srv_10.42.42.10(pid=2807): Terminated {rc=256} 14:45:29.313618 --- ParallelTerminationStrategy: PID 2810 died... 14:45:29.333579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2810): Terminated: ok {rc=0} 14:45:29.379777 --- ParallelTerminationStrategy: PID 2813 died... 14:45:29.399444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2813): Terminated: ok {rc=0} 14:45:29.445417 --- ParallelTerminationStrategy: PID 2816 died... 14:45:29.465044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2816): Terminated: ok {rc=0} 14:45:29.552062 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 14:45:30.702685 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:30.714953 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:45:30.787271 tst iperf3m4.py: using LAC 41621 14:45:30.931291 tst iperf3m4.py: using RAC 56 14:45:31.061739 tst iperf3m4.py: using CellId 41621 14:45:31.189273 tst iperf3m4.py: using BVCI 41622 14:45:31.309979 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:31.321982 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:31.333976 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:31.346881 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:31.359494 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:31.372690 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:31.385298 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:31.398426 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:31.411005 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:45:31.549467 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:45:31.674029 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:45:31.795574 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:45:31.939310 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:45:32.164125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:45:32.491345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2818): Launched 14:45:32.774127 run iperf3-srv_10.42.42.10(pid=2819): Launched 14:45:32.896505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:45:33.115980 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:45:33.442102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2820): Launched 14:45:33.725053 run iperf3-srv_10.42.42.10(pid=2821): Launched 14:45:33.847223 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:45:34.065290 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:45:34.390665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2822): Launched 14:45:34.673118 run iperf3-srv_10.42.42.10(pid=2823): Launched 14:45:34.794729 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:45:35.012700 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:45:35.338132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2824): Launched 14:45:35.621737 run iperf3-srv_10.42.42.10(pid=2825): Launched 14:45:35.743358 tst iperf3m4.py:8: start network... 14:45:35.960660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:45:36.462851 run create_hlr_db(pid=2826): Launched 14:45:36.595008 bus /gobi_6: Setting Powered False 14:45:37.659118 run create_hlr_db(pid=2826): Terminated: ok {rc=0} 14:45:38.090806 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2828): Launched 14:45:38.394183 run osmo-hlr_10.42.42.2(pid=2829): Launched 14:45:38.510467 run osmo-stp_10.42.42.5: Starting osmo-stp 14:45:39.045639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2831): Launched 14:45:39.349368 run osmo-stp_10.42.42.5(pid=2832): Launched 14:45:39.466056 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:45:39.987947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2834): Launched 14:45:40.105201 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:45:40.360616 run patchelf(pid=2835): Launched 14:45:40.530357 run osmo-stp_10.42.42.5(pid=2832): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2832)] 14:45:40.658820 run osmo-stp_10.42.42.5(pid=2832): stdout: | (launched: 2022-12-14_14:45:39.293411) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:40.788751 run osmo-stp_10.42.42.5(pid=2832): stderr: | 20221214144539467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144539467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144539467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144539467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144539468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144539468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144539468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:40.918361 run osmo-stp_10.42.42.5(pid=2832): stdout: | (launched: 2022-12-14_14:45:39.293411) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:41.042707 run osmo-stp_10.42.42.5(pid=2832): stderr: | 20221214144539467 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144539467 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144539467 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144539467 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144539468 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144539468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144539468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:41.189364 run patchelf(pid=2835): Terminating (SIGINT) 14:45:41.360099 run patchelf(pid=2835): Terminated: ok {rc=0} 14:45:41.484015 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2832): Process ended prematurely: osmo-stp_10.42.42.5(pid=2832) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2832)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 14:45:41.493561 tst iperf3m4.py:8: Test FAILED (10.8 sec) 14:45:41.521236 run osmo-hlr_10.42.42.2(pid=2829): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2829)] 14:45:41.570359 run osmo-hlr_10.42.42.2(pid=2829): stdout: | (launched: 2022-12-14_14:45:38.338987) 14:45:41.620511 run osmo-hlr_10.42.42.2(pid=2829): stderr: | 20221214144538515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144538515 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144538515 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144538515 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144538515 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144538515 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144538527 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144538535 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144538536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144538536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:45:41.671054 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2818): Terminating (SIGTERM) 14:45:41.711727 run iperf3-srv_10.42.42.10(pid=2819): Terminating (SIGTERM) 14:45:41.752140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2820): Terminating (SIGTERM) 14:45:41.792372 run iperf3-srv_10.42.42.10(pid=2821): Terminating (SIGTERM) 14:45:41.834547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2822): Terminating (SIGTERM) 14:45:41.875951 run iperf3-srv_10.42.42.10(pid=2823): Terminating (SIGTERM) 14:45:41.921142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2824): Terminating (SIGTERM) 14:45:41.962403 run iperf3-srv_10.42.42.10(pid=2825): Terminating (SIGTERM) 14:45:42.002920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2828): Terminating (SIGTERM) 14:45:42.043215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2831): Terminating (SIGTERM) 14:45:42.083526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2834): Terminating (SIGTERM) 14:45:42.123899 --- ParallelTerminationStrategy: PID 2818 died... 14:45:42.143509 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2818): Terminated: ok {rc=0} 14:45:42.187856 --- ParallelTerminationStrategy: PID 2819 died... 14:45:42.206614 run iperf3-srv_10.42.42.10(pid=2819): Terminated {rc=256} 14:45:42.250832 --- ParallelTerminationStrategy: PID 2820 died... 14:45:42.269676 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2820): Terminated: ok {rc=0} 14:45:42.313811 --- ParallelTerminationStrategy: PID 2821 died... 14:45:42.332653 run iperf3-srv_10.42.42.10(pid=2821): Terminated {rc=256} 14:45:42.376680 --- ParallelTerminationStrategy: PID 2822 died... 14:45:42.395552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2822): Terminated: ok {rc=0} 14:45:42.439671 --- ParallelTerminationStrategy: PID 2823 died... 14:45:42.458532 run iperf3-srv_10.42.42.10(pid=2823): Terminated {rc=256} 14:45:42.502216 --- ParallelTerminationStrategy: PID 2824 died... 14:45:42.520984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2824): Terminated: ok {rc=0} 14:45:42.565104 --- ParallelTerminationStrategy: PID 2825 died... 14:45:42.584004 run iperf3-srv_10.42.42.10(pid=2825): Terminated {rc=256} 14:45:42.627840 --- ParallelTerminationStrategy: PID 2828 died... 14:45:42.646651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2828): Terminated: ok {rc=0} 14:45:42.690850 --- ParallelTerminationStrategy: PID 2831 died... 14:45:42.709770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2831): Terminated: ok {rc=0} 14:45:42.753714 --- ParallelTerminationStrategy: PID 2834 died... 14:45:42.772770 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2834): Terminated: ok {rc=0} 14:45:42.857311 bus /gobi_4: Setting Powered False 14:45:43.955262 bus /gobi_4: Setting Powered False 14:45:45.073122 bus /gobi_1: Setting Powered False 14:45:46.177747 bus /gobi_1: Setting Powered False 14:45:47.294729 bus /gobi_0: Setting Powered False 14:45:48.391653 bus /gobi_0: Setting Powered False 14:45:49.508725 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 14:45:50.612241 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:50.623739 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:45:50.693466 tst ping.py: using LAC 41622 14:45:50.811430 tst ping.py: using RAC 57 14:45:50.929488 tst ping.py: using CellId 41622 14:45:51.046919 tst ping.py: using BVCI 41623 14:45:51.156070 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:51.166879 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:51.177561 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:51.188318 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:51.199294 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:51.210509 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:51.221632 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:51.232602 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:45:51.347076 tst ping.py:19: start network... 14:45:51.546817 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:45:52.006634 run create_hlr_db(pid=2837): Launched 14:45:52.139979 bus /gobi_6: Setting Powered False 14:45:53.198810 run create_hlr_db(pid=2837): Terminated: ok {rc=0} 14:45:53.635964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2845): Launched 14:45:53.953695 run osmo-hlr_10.42.42.2(pid=2846): Launched 14:45:54.074687 run osmo-stp_10.42.42.5: Starting osmo-stp 14:45:54.628343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2848): Launched 14:45:54.945694 run osmo-stp_10.42.42.5(pid=2849): Launched 14:45:55.066987 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:45:55.616563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2851): Launched 14:45:55.734177 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:45:55.984525 run patchelf(pid=2852): Launched 14:45:56.150731 run osmo-stp_10.42.42.5(pid=2849): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2849)] 14:45:56.276673 run osmo-stp_10.42.42.5(pid=2849): stdout: | (launched: 2022-12-14_14:45:54.888192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:56.404039 run osmo-stp_10.42.42.5(pid=2849): stderr: | 20221214144555081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144555082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144555082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144555082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144555083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144555083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144555083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:56.532124 run osmo-stp_10.42.42.5(pid=2849): stdout: | (launched: 2022-12-14_14:45:54.888192) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:45:56.653429 run osmo-stp_10.42.42.5(pid=2849): stderr: | 20221214144555081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144555082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144555082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144555082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144555083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144555083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144555083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:45:56.797670 run patchelf(pid=2852): Terminating (SIGINT) 14:45:56.964914 run patchelf(pid=2852): Terminated: ok {rc=0} 14:45:57.085750 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2849): Process ended prematurely: osmo-stp_10.42.42.5(pid=2849) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2849)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 14:45:57.094669 tst ping.py:22: Test FAILED (6.5 sec) 14:45:57.121640 run osmo-hlr_10.42.42.2(pid=2846): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2846)] 14:45:57.169998 run osmo-hlr_10.42.42.2(pid=2846): stdout: | (launched: 2022-12-14_14:45:53.896253) 14:45:57.219821 run osmo-hlr_10.42.42.2(pid=2846): stderr: | 20221214144554095 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144554095 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144554095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144554095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144554095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144554095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144554108 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144554116 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144554116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144554117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:45:57.270044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2845): Terminating (SIGTERM) 14:45:57.310159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2848): Terminating (SIGTERM) 14:45:57.350247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2851): Terminating (SIGTERM) 14:45:57.390495 --- ParallelTerminationStrategy: PID 2845 died... 14:45:57.409968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2845): Terminated: ok {rc=0} 14:45:57.454492 --- ParallelTerminationStrategy: PID 2848 died... 14:45:57.473480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2848): Terminated: ok {rc=0} 14:45:57.517859 --- ParallelTerminationStrategy: PID 2851 died... 14:45:57.536990 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2851): Terminated: ok {rc=0} 14:45:57.624446 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 14:45:58.712426 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:58.723920 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:45:58.795423 tst ping_idle_ping.py: using LAC 41623 14:45:58.922349 tst ping_idle_ping.py: using RAC 58 14:45:59.049288 tst ping_idle_ping.py: using CellId 41623 14:45:59.173695 tst ping_idle_ping.py: using BVCI 41624 14:45:59.291060 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:59.303071 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:59.314488 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:59.325680 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:59.336893 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:59.348406 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:59.359739 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:45:59.370866 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:45:59.485322 tst ping_idle_ping.py:24: start network... 14:45:59.686341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:46:00.153692 run create_hlr_db(pid=2853): Launched 14:46:00.268807 bus /gobi_6: Setting Powered False 14:46:01.343550 run create_hlr_db(pid=2853): Terminated: ok {rc=0} 14:46:01.819517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2855): Launched 14:46:02.135941 run osmo-hlr_10.42.42.2(pid=2856): Launched 14:46:02.310775 run osmo-stp_10.42.42.5: Starting osmo-stp 14:46:02.837438 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2858): Launched 14:46:03.134636 run osmo-stp_10.42.42.5(pid=2859): Launched 14:46:03.248273 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:46:03.762318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2861): Launched 14:46:03.877150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:46:04.127580 run patchelf(pid=2862): Launched 14:46:04.293975 run osmo-stp_10.42.42.5(pid=2859): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2859)] 14:46:04.420761 run osmo-stp_10.42.42.5(pid=2859): stdout: | (launched: 2022-12-14_14:46:03.080527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:04.548360 run osmo-stp_10.42.42.5(pid=2859): stderr: | 20221214144603249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144603249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144603249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144603250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144603252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144603252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144603252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:04.675928 run osmo-stp_10.42.42.5(pid=2859): stdout: | (launched: 2022-12-14_14:46:03.080527) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:04.797628 run osmo-stp_10.42.42.5(pid=2859): stderr: | 20221214144603249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144603249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144603249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144603250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144603252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144603252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144603252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:04.941800 run patchelf(pid=2862): Terminating (SIGINT) 14:46:05.108539 run patchelf(pid=2862): Terminated: ok {rc=0} 14:46:05.229197 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2859): Process ended prematurely: osmo-stp_10.42.42.5(pid=2859) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2859)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 14:46:05.237985 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 14:46:05.264438 run osmo-hlr_10.42.42.2(pid=2856): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2856)] 14:46:05.313105 run osmo-hlr_10.42.42.2(pid=2856): stdout: | (launched: 2022-12-14_14:46:02.072841) 14:46:05.363131 run osmo-hlr_10.42.42.2(pid=2856): stderr: | 20221214144602322 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144602322 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144602322 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144602322 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144602322 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144602322 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144602335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144602343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144602343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144602343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:46:05.413259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2855): Terminating (SIGTERM) 14:46:05.453648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2858): Terminating (SIGTERM) 14:46:05.493922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2861): Terminating (SIGTERM) 14:46:05.534367 --- ParallelTerminationStrategy: PID 2855 died... 14:46:05.553818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2855): Terminated: ok {rc=0} 14:46:05.598080 --- ParallelTerminationStrategy: PID 2858 died... 14:46:05.617152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2858): Terminated: ok {rc=0} 14:46:05.661201 --- ParallelTerminationStrategy: PID 2861 died... 14:46:05.679947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2861): Terminated: ok {rc=0} 14:46:05.764145 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:46:07.071654 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:46:07.078771 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:46:07.112924 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 14:46:07.151912 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 14:46:07.240412 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:46:07.274009 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 14:46:07.313413 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 14:46:07.908725 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 14:46:07.960667 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:07.971921 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:46:08.042906 tst cs_paging_gprs_active.py: using LAC 41624 14:46:08.173773 tst cs_paging_gprs_active.py: using RAC 59 14:46:08.300643 tst cs_paging_gprs_active.py: using CellId 41624 14:46:08.426508 tst cs_paging_gprs_active.py: using BVCI 41625 14:46:08.544323 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:08.555627 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:08.566798 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:08.577881 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:08.589404 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:08.600396 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:08.611544 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:08.622532 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:08.633885 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:46:08.751747 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:46:08.869622 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:46:09.088221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:46:09.413575 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2866): Launched 14:46:09.696345 run iperf3-srv_10.42.42.10(pid=2867): Launched 14:46:09.818866 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:46:10.036816 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:46:10.361445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2868): Launched 14:46:10.643416 run iperf3-srv_10.42.42.10(pid=2869): Launched 14:46:10.765114 tst cs_paging_gprs_active.py:38: start network... 14:46:10.982116 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:46:11.485405 run create_hlr_db(pid=2870): Launched 14:46:11.617923 bus /gobi_6: Setting Powered False 14:46:12.681663 run create_hlr_db(pid=2870): Terminated: ok {rc=0} 14:46:13.131147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Launched 14:46:13.455954 run osmo-hlr_10.42.42.2(pid=2873): Launched 14:46:13.580305 run osmo-stp_10.42.42.5: Starting osmo-stp 14:46:14.140148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Launched 14:46:14.465440 run osmo-stp_10.42.42.5(pid=2876): Launched 14:46:14.590044 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:46:15.149227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2878): Launched 14:46:15.273702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:46:15.547909 run patchelf(pid=2879): Launched 14:46:15.730662 run osmo-stp_10.42.42.5(pid=2876): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] 14:46:15.873983 run osmo-stp_10.42.42.5(pid=2876): stdout: | (launched: 2022-12-14_14:46:14.406512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:16.027785 run osmo-stp_10.42.42.5(pid=2876): stderr: | 20221214144614600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144614600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144614601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144614601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144614601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144614602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144614602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:16.178830 run osmo-stp_10.42.42.5(pid=2876): stdout: | (launched: 2022-12-14_14:46:14.406512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:16.308033 run osmo-stp_10.42.42.5(pid=2876): stderr: | 20221214144614600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144614600 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144614601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144614601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144614601 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144614602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144614602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:16.463425 run patchelf(pid=2879): Terminating (SIGINT) 14:46:16.642937 run patchelf(pid=2879): Terminated: ok {rc=0} 14:46:16.771944 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2876): Process ended prematurely: osmo-stp_10.42.42.5(pid=2876) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2876)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 14:46:16.783657 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 14:46:16.812326 run osmo-hlr_10.42.42.2(pid=2873): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2873)] 14:46:16.865013 run osmo-hlr_10.42.42.2(pid=2873): stdout: | (launched: 2022-12-14_14:46:13.397315) 14:46:16.917891 run osmo-hlr_10.42.42.2(pid=2873): stderr: | 20221214144613598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144613598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144613599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144613599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144613599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144613599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144613611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144613619 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144613619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144613619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:46:16.970878 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2866): Terminating (SIGTERM) 14:46:17.014140 run iperf3-srv_10.42.42.10(pid=2867): Terminating (SIGTERM) 14:46:17.060488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2868): Terminating (SIGTERM) 14:46:17.103928 run iperf3-srv_10.42.42.10(pid=2869): Terminating (SIGTERM) 14:46:17.148256 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Terminating (SIGTERM) 14:46:17.192714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Terminating (SIGTERM) 14:46:17.237067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2878): Terminating (SIGTERM) 14:46:17.281843 --- ParallelTerminationStrategy: PID 2866 died... 14:46:17.303799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2866): Terminated: ok {rc=0} 14:46:17.349836 --- ParallelTerminationStrategy: PID 2867 died... 14:46:17.369329 run iperf3-srv_10.42.42.10(pid=2867): Terminated {rc=256} 14:46:17.414832 --- ParallelTerminationStrategy: PID 2868 died... 14:46:17.434286 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2868): Terminated: ok {rc=0} 14:46:17.479761 --- ParallelTerminationStrategy: PID 2869 died... 14:46:17.499091 run iperf3-srv_10.42.42.10(pid=2869): Terminated {rc=256} 14:46:17.544521 --- ParallelTerminationStrategy: PID 2872 died... 14:46:17.563941 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2872): Terminated: ok {rc=0} 14:46:17.609346 --- ParallelTerminationStrategy: PID 2875 died... 14:46:17.628673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2875): Terminated: ok {rc=0} 14:46:17.674320 --- ParallelTerminationStrategy: PID 2878 died... 14:46:17.693740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2878): Terminated: ok {rc=0} 14:46:17.781716 bus /gobi_0: Setting Powered False 14:46:18.880419 bus /gobi_0: Setting Powered False 14:46:19.995441 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 14:46:21.143717 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:21.155820 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:46:21.232265 tst iperf3.py: using LAC 41625 14:46:21.363969 tst iperf3.py: using RAC 60 14:46:21.489768 tst iperf3.py: using CellId 41625 14:46:21.617855 tst iperf3.py: using BVCI 41626 14:46:21.736666 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:21.748278 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:21.759539 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:21.770739 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:21.781871 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:21.792878 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:21.804181 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:21.815219 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:21.826538 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:46:21.942066 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:46:22.144576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:46:22.448216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2880): Launched 14:46:22.713561 run iperf3-srv_10.42.42.10(pid=2881): Launched 14:46:22.827853 tst iperf3.py:8: start network... 14:46:23.029860 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:46:23.497104 run create_hlr_db(pid=2882): Launched 14:46:23.614109 bus /gobi_6: Setting Powered False 14:46:24.678380 run create_hlr_db(pid=2882): Terminated: ok {rc=0} 14:46:25.125812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2884): Launched 14:46:25.449015 run osmo-hlr_10.42.42.2(pid=2885): Launched 14:46:25.573937 run osmo-stp_10.42.42.5: Starting osmo-stp 14:46:26.136732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2887): Launched 14:46:26.461286 run osmo-stp_10.42.42.5(pid=2888): Launched 14:46:26.585638 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:46:27.143086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2890): Launched 14:46:27.267464 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:46:27.541490 run patchelf(pid=2891): Launched 14:46:27.721824 run osmo-stp_10.42.42.5(pid=2888): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2888)] 14:46:27.859295 run osmo-stp_10.42.42.5(pid=2888): stdout: | (launched: 2022-12-14_14:46:26.402729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:27.997340 run osmo-stp_10.42.42.5(pid=2888): stderr: | 20221214144626597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144626597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144626597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144626598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144626598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144626598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144626598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:28.135809 run osmo-stp_10.42.42.5(pid=2888): stdout: | (launched: 2022-12-14_14:46:26.402729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:28.267779 run osmo-stp_10.42.42.5(pid=2888): stderr: | 20221214144626597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144626597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144626597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144626598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144626598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144626598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144626598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:28.425594 run patchelf(pid=2891): Terminating (SIGINT) 14:46:28.607220 run patchelf(pid=2891): Terminated: ok {rc=0} 14:46:28.738182 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2888): Process ended prematurely: osmo-stp_10.42.42.5(pid=2888) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2888)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 14:46:28.748225 tst iperf3.py:8: Test FAILED (7.6 sec) 14:46:28.776779 run osmo-hlr_10.42.42.2(pid=2885): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2885)] 14:46:28.826713 run osmo-hlr_10.42.42.2(pid=2885): stdout: | (launched: 2022-12-14_14:46:25.390566) 14:46:28.878727 run osmo-hlr_10.42.42.2(pid=2885): stderr: | 20221214144625587 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144625587 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144625587 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144625587 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144625587 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144625588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144625603 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144625612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144625613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144625613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:46:28.930900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2880): Terminating (SIGTERM) 14:46:28.972549 run iperf3-srv_10.42.42.10(pid=2881): Terminating (SIGTERM) 14:46:29.014194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2884): Terminating (SIGTERM) 14:46:29.056304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2887): Terminating (SIGTERM) 14:46:29.098192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2890): Terminating (SIGTERM) 14:46:29.141062 --- ParallelTerminationStrategy: PID 2880 died... 14:46:29.161278 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2880): Terminated: ok {rc=0} 14:46:29.207619 --- ParallelTerminationStrategy: PID 2881 died... 14:46:29.227161 run iperf3-srv_10.42.42.10(pid=2881): Terminated {rc=256} 14:46:29.273063 --- ParallelTerminationStrategy: PID 2884 died... 14:46:29.292485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2884): Terminated: ok {rc=0} 14:46:29.339001 --- ParallelTerminationStrategy: PID 2887 died... 14:46:29.358613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2887): Terminated: ok {rc=0} 14:46:29.404711 --- ParallelTerminationStrategy: PID 2890 died... 14:46:29.424304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2890): Terminated: ok {rc=0} 14:46:29.512078 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 14:46:30.659993 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:30.672076 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:46:30.744582 tst iperf3m4.py: using LAC 41626 14:46:30.880281 tst iperf3m4.py: using RAC 61 14:46:31.011043 tst iperf3m4.py: using CellId 41626 14:46:31.139997 tst iperf3m4.py: using BVCI 41627 14:46:31.261900 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:31.274548 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:31.287005 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:31.299293 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:31.312080 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:31.324594 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:31.336634 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:31.348829 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:31.361676 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:46:31.483923 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:46:31.608048 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:46:31.739058 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:46:31.885683 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:46:32.122128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:46:32.450527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2892): Launched 14:46:32.733409 run iperf3-srv_10.42.42.10(pid=2893): Launched 14:46:32.855022 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:46:33.072522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:46:33.396900 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2894): Launched 14:46:33.679079 run iperf3-srv_10.42.42.10(pid=2895): Launched 14:46:33.800644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:46:34.018758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:46:34.343554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2896): Launched 14:46:34.625513 run iperf3-srv_10.42.42.10(pid=2897): Launched 14:46:34.747269 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:46:34.964421 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:46:35.288381 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2898): Launched 14:46:35.570286 run iperf3-srv_10.42.42.10(pid=2899): Launched 14:46:35.691137 tst iperf3m4.py:8: start network... 14:46:35.908423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:46:36.410227 run create_hlr_db(pid=2900): Launched 14:46:36.542531 bus /gobi_6: Setting Powered False 14:46:37.606241 run create_hlr_db(pid=2900): Terminated: ok {rc=0} 14:46:38.037742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2902): Launched 14:46:38.340923 run osmo-hlr_10.42.42.2(pid=2903): Launched 14:46:38.458371 run osmo-stp_10.42.42.5: Starting osmo-stp 14:46:38.992483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2905): Launched 14:46:39.294269 run osmo-stp_10.42.42.5(pid=2906): Launched 14:46:39.409666 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:46:39.930134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2908): Launched 14:46:40.047058 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:46:40.301757 run patchelf(pid=2909): Launched 14:46:40.471960 run osmo-stp_10.42.42.5(pid=2906): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2906)] 14:46:40.600883 run osmo-stp_10.42.42.5(pid=2906): stdout: | (launched: 2022-12-14_14:46:39.239202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:40.729902 run osmo-stp_10.42.42.5(pid=2906): stderr: | 20221214144639409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144639409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144639409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144639410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144639410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144639410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144639410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:40.859021 run osmo-stp_10.42.42.5(pid=2906): stdout: | (launched: 2022-12-14_14:46:39.239202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:40.982416 run osmo-stp_10.42.42.5(pid=2906): stderr: | 20221214144639409 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144639409 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144639409 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144639410 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144639410 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144639410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144639410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:41.129110 run patchelf(pid=2909): Terminating (SIGINT) 14:46:41.298810 run patchelf(pid=2909): Terminated: ok {rc=0} 14:46:41.421432 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2906): Process ended prematurely: osmo-stp_10.42.42.5(pid=2906) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2906)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 14:46:41.430775 tst iperf3m4.py:8: Test FAILED (10.8 sec) 14:46:41.458358 run osmo-hlr_10.42.42.2(pid=2903): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2903)] 14:46:41.506385 run osmo-hlr_10.42.42.2(pid=2903): stdout: | (launched: 2022-12-14_14:46:38.285985) 14:46:41.555726 run osmo-hlr_10.42.42.2(pid=2903): stderr: | 20221214144638463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144638463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144638463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144638463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144638463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144638463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144638480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144638489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144638490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144638490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:46:41.605984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2892): Terminating (SIGTERM) 14:46:41.646201 run iperf3-srv_10.42.42.10(pid=2893): Terminating (SIGTERM) 14:46:41.686274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2894): Terminating (SIGTERM) 14:46:41.726272 run iperf3-srv_10.42.42.10(pid=2895): Terminating (SIGTERM) 14:46:41.766155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2896): Terminating (SIGTERM) 14:46:41.806030 run iperf3-srv_10.42.42.10(pid=2897): Terminating (SIGTERM) 14:46:41.845865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2898): Terminating (SIGTERM) 14:46:41.885973 run iperf3-srv_10.42.42.10(pid=2899): Terminating (SIGTERM) 14:46:41.926009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2902): Terminating (SIGTERM) 14:46:41.965885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2905): Terminating (SIGTERM) 14:46:42.005774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2908): Terminating (SIGTERM) 14:46:42.045781 --- ParallelTerminationStrategy: PID 2892 died... 14:46:42.065142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2892): Terminated: ok {rc=0} 14:46:42.109551 --- ParallelTerminationStrategy: PID 2893 died... 14:46:42.128278 run iperf3-srv_10.42.42.10(pid=2893): Terminated {rc=256} 14:46:42.172741 --- ParallelTerminationStrategy: PID 2894 died... 14:46:42.191802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2894): Terminated: ok {rc=0} 14:46:42.236134 --- ParallelTerminationStrategy: PID 2895 died... 14:46:42.255087 run iperf3-srv_10.42.42.10(pid=2895): Terminated {rc=256} 14:46:42.299120 --- ParallelTerminationStrategy: PID 2896 died... 14:46:42.318087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2896): Terminated: ok {rc=0} 14:46:42.362363 --- ParallelTerminationStrategy: PID 2897 died... 14:46:42.381311 run iperf3-srv_10.42.42.10(pid=2897): Terminated {rc=256} 14:46:42.425416 --- ParallelTerminationStrategy: PID 2898 died... 14:46:42.444452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2898): Terminated: ok {rc=0} 14:46:42.489012 --- ParallelTerminationStrategy: PID 2899 died... 14:46:42.508453 run iperf3-srv_10.42.42.10(pid=2899): Terminated {rc=256} 14:46:42.553158 --- ParallelTerminationStrategy: PID 2902 died... 14:46:42.572007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2902): Terminated: ok {rc=0} 14:46:42.616382 --- ParallelTerminationStrategy: PID 2905 died... 14:46:42.635388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2905): Terminated: ok {rc=0} 14:46:42.679612 --- ParallelTerminationStrategy: PID 2908 died... 14:46:42.698569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2908): Terminated: ok {rc=0} 14:46:42.785609 bus /gobi_4: Setting Powered False 14:46:43.885649 bus /gobi_4: Setting Powered False 14:46:45.000621 bus /gobi_1: Setting Powered False 14:46:46.102942 bus /gobi_1: Setting Powered False 14:46:47.232293 bus /gobi_0: Setting Powered False 14:46:48.332274 bus /gobi_0: Setting Powered False 14:46:49.447552 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 14:46:50.550957 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:50.562939 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:46:50.634479 tst ping.py: using LAC 41627 14:46:50.760213 tst ping.py: using RAC 62 14:46:50.884558 tst ping.py: using CellId 41627 14:46:51.010384 tst ping.py: using BVCI 41628 14:46:51.127597 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:51.139179 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:51.150448 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:51.161653 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:51.172785 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:51.184032 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:51.195419 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:51.206576 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:46:51.323623 tst ping.py:19: start network... 14:46:51.523882 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:46:51.983577 run create_hlr_db(pid=2910): Launched 14:46:52.099192 bus /gobi_6: Setting Powered False 14:46:53.158420 run create_hlr_db(pid=2910): Terminated: ok {rc=0} 14:46:53.573737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2912): Launched 14:46:53.871113 run osmo-hlr_10.42.42.2(pid=2913): Launched 14:46:53.985308 run osmo-stp_10.42.42.5: Starting osmo-stp 14:46:54.515533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2915): Launched 14:46:54.813177 run osmo-stp_10.42.42.5(pid=2916): Launched 14:46:54.927719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:46:55.439426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2918): Launched 14:46:55.553310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:46:55.803171 run patchelf(pid=2919): Launched 14:46:55.970517 run osmo-stp_10.42.42.5(pid=2916): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2916)] 14:46:56.096688 run osmo-stp_10.42.42.5(pid=2916): stdout: | (launched: 2022-12-14_14:46:54.758542) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:56.223472 run osmo-stp_10.42.42.5(pid=2916): stderr: | 20221214144654926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144654927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144654927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144654927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144654930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144654930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144654930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:56.350110 run osmo-stp_10.42.42.5(pid=2916): stdout: | (launched: 2022-12-14_14:46:54.758542) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:46:56.471386 run osmo-stp_10.42.42.5(pid=2916): stderr: | 20221214144654926 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144654927 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144654927 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144654927 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144654930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144654930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144654930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:46:56.614768 run patchelf(pid=2919): Terminating (SIGINT) 14:46:56.781836 run patchelf(pid=2919): Terminated: ok {rc=0} 14:46:56.902458 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2916): Process ended prematurely: osmo-stp_10.42.42.5(pid=2916) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2916)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 14:46:56.911151 tst ping.py:22: Test FAILED (6.4 sec) 14:46:56.937964 run osmo-hlr_10.42.42.2(pid=2913): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2913)] 14:46:56.986275 run osmo-hlr_10.42.42.2(pid=2913): stdout: | (launched: 2022-12-14_14:46:53.816780) 14:46:57.035835 run osmo-hlr_10.42.42.2(pid=2913): stderr: | 20221214144653991 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144653991 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144653991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144653991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144653991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144653991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144654003 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144654011 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144654012 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144654012 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:46:57.085689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2912): Terminating (SIGTERM) 14:46:57.125918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2915): Terminating (SIGTERM) 14:46:57.165685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2918): Terminating (SIGTERM) 14:46:57.206000 --- ParallelTerminationStrategy: PID 2912 died... 14:46:57.225473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2912): Terminated: ok {rc=0} 14:46:57.269491 --- ParallelTerminationStrategy: PID 2915 died... 14:46:57.288338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2915): Terminated: ok {rc=0} 14:46:57.332452 --- ParallelTerminationStrategy: PID 2918 died... 14:46:57.351369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2918): Terminated: ok {rc=0} 14:46:57.438129 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 14:46:58.524886 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:58.536397 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:46:58.607239 tst ping_idle_ping.py: using LAC 41628 14:46:58.725037 tst ping_idle_ping.py: using RAC 63 14:46:58.840749 tst ping_idle_ping.py: using CellId 41628 14:46:58.961373 tst ping_idle_ping.py: using BVCI 41629 14:46:59.069058 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:59.079750 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:59.090381 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:59.100991 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:59.111908 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:59.122943 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:59.133993 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:46:59.144779 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:46:59.260054 tst ping_idle_ping.py:24: start network... 14:46:59.475850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:46:59.969423 run create_hlr_db(pid=2920): Launched 14:47:00.099555 bus /gobi_6: Setting Powered False 14:47:01.178827 run create_hlr_db(pid=2920): Terminated: ok {rc=0} 14:47:01.641687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2922): Launched 14:47:01.970362 run osmo-hlr_10.42.42.2(pid=2923): Launched 14:47:02.221966 run osmo-stp_10.42.42.5: Starting osmo-stp 14:47:02.747483 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2925): Launched 14:47:03.044456 run osmo-stp_10.42.42.5(pid=2926): Launched 14:47:03.159094 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:47:03.671885 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2928): Launched 14:47:03.787385 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:47:04.037267 run patchelf(pid=2929): Launched 14:47:04.204292 run osmo-stp_10.42.42.5(pid=2926): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2926)] 14:47:04.330741 run osmo-stp_10.42.42.5(pid=2926): stdout: | (launched: 2022-12-14_14:47:02.990175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:04.458862 run osmo-stp_10.42.42.5(pid=2926): stderr: | 20221214144703161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144703162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144703162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144703162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144703163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144703163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144703163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:04.586576 run osmo-stp_10.42.42.5(pid=2926): stdout: | (launched: 2022-12-14_14:47:02.990175) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:04.708163 run osmo-stp_10.42.42.5(pid=2926): stderr: | 20221214144703161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144703162 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144703162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144703162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144703163 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144703163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144703163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:04.852631 run patchelf(pid=2929): Terminating (SIGINT) 14:47:05.019537 run patchelf(pid=2929): Terminated: ok {rc=0} 14:47:05.140044 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2926): Process ended prematurely: osmo-stp_10.42.42.5(pid=2926) [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2926)] [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 14:47:05.148835 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 14:47:05.175481 run osmo-hlr_10.42.42.2(pid=2923): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2923)] 14:47:05.223528 run osmo-hlr_10.42.42.2(pid=2923): stdout: | (launched: 2022-12-14_14:47:01.906438) 14:47:05.272707 run osmo-hlr_10.42.42.2(pid=2923): stderr: | 20221214144702185 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144702185 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144702185 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144702185 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144702185 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144702185 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144702199 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144702215 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144702215 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144702215 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:47:05.322324 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2922): Terminating (SIGTERM) 14:47:05.362229 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2925): Terminating (SIGTERM) 14:47:05.401997 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2928): Terminating (SIGTERM) 14:47:05.441916 --- ParallelTerminationStrategy: PID 2922 died... 14:47:05.461285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2922): Terminated: ok {rc=0} 14:47:05.505330 --- ParallelTerminationStrategy: PID 2925 died... 14:47:05.523954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2925): Terminated: ok {rc=0} 14:47:05.567489 --- ParallelTerminationStrategy: PID 2928 died... 14:47:05.586150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2928): Terminated: ok {rc=0} 14:47:05.668888 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 14:47:06.974435 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:47:06.981283 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 14:47:07.014767 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 14:47:07.053886 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 14:47:07.142121 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 14:47:07.175556 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 14:47:07.214355 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 14:47:07.816301 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 14:47:07.868139 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:07.879774 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:47:07.933310 tst cs_paging_gprs_active.py: using LAC 41629 14:47:08.061219 tst cs_paging_gprs_active.py: using RAC 64 14:47:08.189400 tst cs_paging_gprs_active.py: using CellId 41629 14:47:08.318624 tst cs_paging_gprs_active.py: using BVCI 41630 14:47:08.430713 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:08.441893 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:08.452799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:08.463941 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:08.475609 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:08.487388 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:08.499310 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:08.511120 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:08.523076 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:47:08.643690 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:47:08.762957 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:47:08.982669 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:47:09.309620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2934): Launched 14:47:09.594836 run iperf3-srv_10.42.42.10(pid=2935): Launched 14:47:09.717610 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:47:09.936569 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:47:10.263926 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2936): Launched 14:47:10.548091 run iperf3-srv_10.42.42.10(pid=2937): Launched 14:47:10.671242 tst cs_paging_gprs_active.py:38: start network... 14:47:10.889914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:47:11.392645 run create_hlr_db(pid=2938): Launched 14:47:11.525991 bus /gobi_6: Setting Powered False 14:47:12.589756 run create_hlr_db(pid=2938): Terminated: ok {rc=0} 14:47:13.020216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2940): Launched 14:47:13.323963 run osmo-hlr_10.42.42.2(pid=2941): Launched 14:47:13.441365 run osmo-stp_10.42.42.5: Starting osmo-stp 14:47:13.964598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2943): Launched 14:47:14.269127 run osmo-stp_10.42.42.5(pid=2944): Launched 14:47:14.387156 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:47:14.909284 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2946): Launched 14:47:15.026155 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:47:15.281767 run patchelf(pid=2947): Launched 14:47:15.452026 run osmo-stp_10.42.42.5(pid=2944): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2944)] 14:47:15.580629 run osmo-stp_10.42.42.5(pid=2944): stdout: | (launched: 2022-12-14_14:47:14.213653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:15.710124 run osmo-stp_10.42.42.5(pid=2944): stderr: | 20221214144714384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144714384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144714384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144714385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144714385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144714385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144714386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:15.846048 run osmo-stp_10.42.42.5(pid=2944): stdout: | (launched: 2022-12-14_14:47:14.213653) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:15.973108 run osmo-stp_10.42.42.5(pid=2944): stderr: | 20221214144714384 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144714384 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144714384 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144714385 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144714385 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144714385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144714386 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:16.123113 run patchelf(pid=2947): Terminating (SIGINT) 14:47:16.296838 run patchelf(pid=2947): Terminated: ok {rc=0} 14:47:16.423923 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2944): Process ended prematurely: osmo-stp_10.42.42.5(pid=2944) [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2944)] [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 14:47:16.434548 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 14:47:16.463348 run osmo-hlr_10.42.42.2(pid=2941): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2941)] 14:47:16.514580 run osmo-hlr_10.42.42.2(pid=2941): stdout: | (launched: 2022-12-14_14:47:13.268839) 14:47:16.566409 run osmo-hlr_10.42.42.2(pid=2941): stderr: | 20221214144713447 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144713447 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144713448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144713448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144713448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144713448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144713460 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144713468 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144713468 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144713468 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:47:16.620421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2934): Terminating (SIGTERM) 14:47:16.662395 run iperf3-srv_10.42.42.10(pid=2935): Terminating (SIGTERM) 14:47:16.707712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2936): Terminating (SIGTERM) 14:47:16.750811 run iperf3-srv_10.42.42.10(pid=2937): Terminating (SIGTERM) 14:47:16.795983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2940): Terminating (SIGTERM) 14:47:16.839092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2943): Terminating (SIGTERM) 14:47:16.882797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2946): Terminating (SIGTERM) 14:47:16.924939 --- ParallelTerminationStrategy: PID 2934 died... 14:47:16.945802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2934): Terminated: ok {rc=0} 14:47:16.991898 --- ParallelTerminationStrategy: PID 2935 died... 14:47:17.012590 run iperf3-srv_10.42.42.10(pid=2935): Terminated {rc=256} 14:47:17.058792 --- ParallelTerminationStrategy: PID 2936 died... 14:47:17.079631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2936): Terminated: ok {rc=0} 14:47:17.125495 --- ParallelTerminationStrategy: PID 2937 died... 14:47:17.145887 run iperf3-srv_10.42.42.10(pid=2937): Terminated {rc=256} 14:47:17.191752 --- ParallelTerminationStrategy: PID 2940 died... 14:47:17.213149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2940): Terminated: ok {rc=0} 14:47:17.257403 --- ParallelTerminationStrategy: PID 2943 died... 14:47:17.276305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2943): Terminated: ok {rc=0} 14:47:17.320308 --- ParallelTerminationStrategy: PID 2946 died... 14:47:17.339293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2946): Terminated: ok {rc=0} 14:47:17.426222 bus /gobi_0: Setting Powered False 14:47:18.524921 bus /gobi_0: Setting Powered False 14:47:19.637069 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 14:47:20.785714 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:20.798065 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:47:20.854827 tst iperf3.py: using LAC 41630 14:47:20.983234 tst iperf3.py: using RAC 65 14:47:21.109376 tst iperf3.py: using CellId 41630 14:47:21.236246 tst iperf3.py: using BVCI 41631 14:47:21.354567 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:21.366310 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:21.377784 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:21.389308 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:21.400762 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:21.412193 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:21.423692 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:21.435085 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:21.446722 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:47:21.563877 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:47:21.783072 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:47:22.109664 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2948): Launched 14:47:22.394463 run iperf3-srv_10.42.42.10(pid=2949): Launched 14:47:22.516326 tst iperf3.py:8: start network... 14:47:22.734989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:47:23.238462 run create_hlr_db(pid=2950): Launched 14:47:23.370769 bus /gobi_6: Setting Powered False 14:47:24.430915 run create_hlr_db(pid=2950): Terminated: ok {rc=0} 14:47:24.882905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2952): Launched 14:47:25.207698 run osmo-hlr_10.42.42.2(pid=2953): Launched 14:47:25.332337 run osmo-stp_10.42.42.5: Starting osmo-stp 14:47:25.892751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2955): Launched 14:47:26.217137 run osmo-stp_10.42.42.5(pid=2956): Launched 14:47:26.341645 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:47:26.902128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2958): Launched 14:47:27.027489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:47:27.302430 run patchelf(pid=2959): Launched 14:47:27.484764 run osmo-stp_10.42.42.5(pid=2956): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2956)] 14:47:27.623234 run osmo-stp_10.42.42.5(pid=2956): stdout: | (launched: 2022-12-14_14:47:26.158151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:27.762497 run osmo-stp_10.42.42.5(pid=2956): stderr: | 20221214144726350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144726350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144726351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144726351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144726351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144726352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144726352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:27.902010 run osmo-stp_10.42.42.5(pid=2956): stdout: | (launched: 2022-12-14_14:47:26.158151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:28.035303 run osmo-stp_10.42.42.5(pid=2956): stderr: | 20221214144726350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144726350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144726351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144726351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144726351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144726352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144726352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:28.192942 run patchelf(pid=2959): Terminating (SIGINT) 14:47:28.376545 run patchelf(pid=2959): Terminated: ok {rc=0} 14:47:28.508493 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2956): Process ended prematurely: osmo-stp_10.42.42.5(pid=2956) [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2956)] [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 14:47:28.518663 tst iperf3.py:8: Test FAILED (7.8 sec) 14:47:28.547680 run osmo-hlr_10.42.42.2(pid=2953): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2953)] 14:47:28.598232 run osmo-hlr_10.42.42.2(pid=2953): stdout: | (launched: 2022-12-14_14:47:25.148638) 14:47:28.650639 run osmo-hlr_10.42.42.2(pid=2953): stderr: | 20221214144725349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144725349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144725349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144725349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144725349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144725349 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144725361 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144725369 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144725369 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144725369 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:47:28.703138 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2948): Terminating (SIGTERM) 14:47:28.745193 run iperf3-srv_10.42.42.10(pid=2949): Terminating (SIGTERM) 14:47:28.787183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2952): Terminating (SIGTERM) 14:47:28.829243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2955): Terminating (SIGTERM) 14:47:28.871255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2958): Terminating (SIGTERM) 14:47:28.913589 --- ParallelTerminationStrategy: PID 2948 died... 14:47:28.933617 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2948): Terminated: ok {rc=0} 14:47:28.979943 --- ParallelTerminationStrategy: PID 2949 died... 14:47:28.999435 run iperf3-srv_10.42.42.10(pid=2949): Terminated {rc=256} 14:47:29.045408 --- ParallelTerminationStrategy: PID 2952 died... 14:47:29.064918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2952): Terminated: ok {rc=0} 14:47:29.111003 --- ParallelTerminationStrategy: PID 2955 died... 14:47:29.130710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2955): Terminated: ok {rc=0} 14:47:29.176940 --- ParallelTerminationStrategy: PID 2958 died... 14:47:29.196637 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2958): Terminated: ok {rc=0} 14:47:29.287923 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 14:47:30.436378 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:30.448767 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:47:30.507639 tst iperf3m4.py: using LAC 41631 14:47:30.634297 tst iperf3m4.py: using RAC 66 14:47:30.759063 tst iperf3m4.py: using CellId 41631 14:47:30.898305 tst iperf3m4.py: using BVCI 41632 14:47:31.031236 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:31.044092 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:31.056883 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:31.069644 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:31.082503 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:31.095138 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:31.108905 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:31.121609 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:31.133925 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:47:31.271811 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:47:31.395799 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:47:31.538433 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:47:31.662112 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:47:31.869903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:47:32.187181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2961): Launched 14:47:32.490323 run iperf3-srv_10.42.42.10(pid=2962): Launched 14:47:32.605513 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:47:32.807534 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:47:33.110294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2963): Launched 14:47:33.373809 run iperf3-srv_10.42.42.10(pid=2964): Launched 14:47:33.487913 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:47:33.689217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:47:33.991153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2965): Launched 14:47:34.255032 run iperf3-srv_10.42.42.10(pid=2966): Launched 14:47:34.369511 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:47:34.571154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:47:34.873889 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2967): Launched 14:47:35.137324 run iperf3-srv_10.42.42.10(pid=2968): Launched 14:47:35.251203 tst iperf3m4.py:8: start network... 14:47:35.453557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:47:35.920642 run create_hlr_db(pid=2969): Launched 14:47:36.036678 bus /gobi_6: Setting Powered False 14:47:37.096916 run create_hlr_db(pid=2969): Terminated: ok {rc=0} 14:47:37.517183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2971): Launched 14:47:37.820608 run osmo-hlr_10.42.42.2(pid=2972): Launched 14:47:37.937231 run osmo-stp_10.42.42.5: Starting osmo-stp 14:47:38.476274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2974): Launched 14:47:38.780116 run osmo-stp_10.42.42.5(pid=2975): Launched 14:47:38.895998 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:47:39.417153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2977): Launched 14:47:39.533572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:47:39.788375 run patchelf(pid=2978): Launched 14:47:39.957777 run osmo-stp_10.42.42.5(pid=2975): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2975)] 14:47:40.086002 run osmo-stp_10.42.42.5(pid=2975): stdout: | (launched: 2022-12-14_14:47:38.723762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:40.215753 run osmo-stp_10.42.42.5(pid=2975): stderr: | 20221214144738893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144738893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144738893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144738894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144738894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144738894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144738894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:40.345512 run osmo-stp_10.42.42.5(pid=2975): stdout: | (launched: 2022-12-14_14:47:38.723762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:40.469646 run osmo-stp_10.42.42.5(pid=2975): stderr: | 20221214144738893 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144738893 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144738893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144738894 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144738894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144738894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144738894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:40.617244 run patchelf(pid=2978): Terminating (SIGINT) 14:47:40.787366 run patchelf(pid=2978): Terminated: ok {rc=0} 14:47:40.909949 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2975): Process ended prematurely: osmo-stp_10.42.42.5(pid=2975) [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2975)] [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 14:47:40.919491 tst iperf3m4.py:8: Test FAILED (10.5 sec) 14:47:40.947024 run osmo-hlr_10.42.42.2(pid=2972): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2972)] 14:47:40.995354 run osmo-hlr_10.42.42.2(pid=2972): stdout: | (launched: 2022-12-14_14:47:37.765435) 14:47:41.044749 run osmo-hlr_10.42.42.2(pid=2972): stderr: | 20221214144737942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144737942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144737942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144737942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144737942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144737942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144737954 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144737964 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144737965 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144737965 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:47:41.094448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2961): Terminating (SIGTERM) 14:47:41.134464 run iperf3-srv_10.42.42.10(pid=2962): Terminating (SIGTERM) 14:47:41.174194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2963): Terminating (SIGTERM) 14:47:41.213853 run iperf3-srv_10.42.42.10(pid=2964): Terminating (SIGTERM) 14:47:41.253777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2965): Terminating (SIGTERM) 14:47:41.293450 run iperf3-srv_10.42.42.10(pid=2966): Terminating (SIGTERM) 14:47:41.333212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2967): Terminating (SIGTERM) 14:47:41.372870 run iperf3-srv_10.42.42.10(pid=2968): Terminating (SIGTERM) 14:47:41.412425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2971): Terminating (SIGTERM) 14:47:41.452226 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2974): Terminating (SIGTERM) 14:47:41.492066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2977): Terminating (SIGTERM) 14:47:41.532238 --- ParallelTerminationStrategy: PID 2961 died... 14:47:41.551757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2961): Terminated: ok {rc=0} 14:47:41.596240 --- ParallelTerminationStrategy: PID 2962 died... 14:47:41.615041 run iperf3-srv_10.42.42.10(pid=2962): Terminated {rc=256} 14:47:41.658690 --- ParallelTerminationStrategy: PID 2963 died... 14:47:41.677408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2963): Terminated: ok {rc=0} 14:47:41.721290 --- ParallelTerminationStrategy: PID 2964 died... 14:47:41.740013 run iperf3-srv_10.42.42.10(pid=2964): Terminated {rc=256} 14:47:41.783667 --- ParallelTerminationStrategy: PID 2965 died... 14:47:41.802560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2965): Terminated: ok {rc=0} 14:47:41.846278 --- ParallelTerminationStrategy: PID 2966 died... 14:47:41.864943 run iperf3-srv_10.42.42.10(pid=2966): Terminated {rc=256} 14:47:41.908937 --- ParallelTerminationStrategy: PID 2967 died... 14:47:41.927775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2967): Terminated: ok {rc=0} 14:47:41.971466 --- ParallelTerminationStrategy: PID 2968 died... 14:47:41.990177 run iperf3-srv_10.42.42.10(pid=2968): Terminated {rc=256} 14:47:42.033948 --- ParallelTerminationStrategy: PID 2971 died... 14:47:42.052764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2971): Terminated: ok {rc=0} 14:47:42.096873 --- ParallelTerminationStrategy: PID 2974 died... 14:47:42.116160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2974): Terminated: ok {rc=0} 14:47:42.159829 --- ParallelTerminationStrategy: PID 2977 died... 14:47:42.178628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2977): Terminated: ok {rc=0} 14:47:42.264449 bus /gobi_4: Setting Powered False 14:47:43.364217 bus /gobi_4: Setting Powered False 14:47:44.477259 bus /gobi_1: Setting Powered False 14:47:45.574806 bus /gobi_1: Setting Powered False 14:47:46.699949 bus /gobi_0: Setting Powered False 14:47:47.798235 bus /gobi_0: Setting Powered False 14:47:48.912550 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 14:47:50.015802 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:50.027658 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:47:50.081020 tst ping.py: using LAC 41632 14:47:50.202042 tst ping.py: using RAC 67 14:47:50.318113 tst ping.py: using CellId 41632 14:47:50.433303 tst ping.py: using BVCI 41633 14:47:50.540608 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:50.551927 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:50.562885 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:50.573894 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:50.585583 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:50.596812 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:50.608205 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:50.619500 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:47:50.737458 tst ping.py:19: start network... 14:47:50.952737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:47:51.445233 run create_hlr_db(pid=2979): Launched 14:47:51.567356 bus /gobi_6: Setting Powered False 14:47:52.629964 run create_hlr_db(pid=2979): Terminated: ok {rc=0} 14:47:53.054207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2981): Launched 14:47:53.352567 run osmo-hlr_10.42.42.2(pid=2982): Launched 14:47:53.466705 run osmo-stp_10.42.42.5: Starting osmo-stp 14:47:53.995628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2984): Launched 14:47:54.293233 run osmo-stp_10.42.42.5(pid=2985): Launched 14:47:54.406982 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:47:54.918970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2987): Launched 14:47:55.033271 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:47:55.283340 run patchelf(pid=2988): Launched 14:47:55.449543 run osmo-stp_10.42.42.5(pid=2985): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2985)] 14:47:55.575642 run osmo-stp_10.42.42.5(pid=2985): stdout: | (launched: 2022-12-14_14:47:54.239031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:55.703448 run osmo-stp_10.42.42.5(pid=2985): stderr: | 20221214144754411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144754411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144754411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144754412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144754412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144754412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144754412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:55.831152 run osmo-stp_10.42.42.5(pid=2985): stdout: | (launched: 2022-12-14_14:47:54.239031) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:47:55.952873 run osmo-stp_10.42.42.5(pid=2985): stderr: | 20221214144754411 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144754411 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144754411 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144754412 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144754412 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144754412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144754412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:47:56.097137 run patchelf(pid=2988): Terminating (SIGINT) 14:47:56.264447 run patchelf(pid=2988): Terminated: ok {rc=0} 14:47:56.385381 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2985): Process ended prematurely: osmo-stp_10.42.42.5(pid=2985) [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2985)] [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 14:47:56.394240 tst ping.py:22: Test FAILED (6.4 sec) 14:47:56.421188 run osmo-hlr_10.42.42.2(pid=2982): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2982)] 14:47:56.469522 run osmo-hlr_10.42.42.2(pid=2982): stdout: | (launched: 2022-12-14_14:47:53.297852) 14:47:56.519468 run osmo-hlr_10.42.42.2(pid=2982): stderr: | 20221214144753474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144753474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144753474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144753474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144753474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144753474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144753487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144753495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144753496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144753496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:47:56.569627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2981): Terminating (SIGTERM) 14:47:56.610448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2984): Terminating (SIGTERM) 14:47:56.650426 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2987): Terminating (SIGTERM) 14:47:56.691167 --- ParallelTerminationStrategy: PID 2981 died... 14:47:56.710577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2981): Terminated: ok {rc=0} 14:47:56.754615 --- ParallelTerminationStrategy: PID 2984 died... 14:47:56.773528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2984): Terminated: ok {rc=0} 14:47:56.817938 --- ParallelTerminationStrategy: PID 2987 died... 14:47:56.836999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2987): Terminated: ok {rc=0} 14:47:56.923705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 14:47:58.012498 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:58.024347 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:47:58.077897 tst ping_idle_ping.py: using LAC 41633 14:47:58.197159 tst ping_idle_ping.py: using RAC 68 14:47:58.323153 tst ping_idle_ping.py: using CellId 41633 14:47:58.450979 tst ping_idle_ping.py: using BVCI 41634 14:47:58.568087 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:58.580195 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:58.591982 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:58.603761 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:58.615427 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:58.627048 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:58.638822 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 14:47:58.650438 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 14:47:58.766192 tst ping_idle_ping.py:24: start network... 14:47:58.982127 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:47:59.480422 run create_hlr_db(pid=2989): Launched 14:47:59.611578 bus /gobi_6: Setting Powered False 14:48:00.674535 run create_hlr_db(pid=2989): Terminated: ok {rc=0} 14:48:01.155100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2991): Launched 14:48:01.487120 run osmo-hlr_10.42.42.2(pid=2992): Launched 14:48:01.746358 run osmo-stp_10.42.42.5: Starting osmo-stp 14:48:02.379233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2994): Launched 14:48:02.679414 run osmo-stp_10.42.42.5(pid=2995): Launched 14:48:02.794116 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:48:03.308688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2997): Launched 14:48:03.423679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:48:03.676145 run patchelf(pid=2998): Launched 14:48:03.843493 run osmo-stp_10.42.42.5(pid=2995): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2995)] 14:48:03.970162 run osmo-stp_10.42.42.5(pid=2995): stdout: | (launched: 2022-12-14_14:48:02.624596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:04.098273 run osmo-stp_10.42.42.5(pid=2995): stderr: | 20221214144802797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144802797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144802797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144802798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144802798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144802798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144802798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:48:04.227083 run osmo-stp_10.42.42.5(pid=2995): stdout: | (launched: 2022-12-14_14:48:02.624596) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:04.349435 run osmo-stp_10.42.42.5(pid=2995): stderr: | 20221214144802797 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144802797 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144802797 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144802798 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144802798 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144802798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144802798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:48:04.494425 run patchelf(pid=2998): Terminating (SIGINT) 14:48:04.663256 run patchelf(pid=2998): Terminated: ok {rc=0} 14:48:04.784410 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2995): Process ended prematurely: osmo-stp_10.42.42.5(pid=2995) [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2995)] [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 14:48:04.793517 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 14:48:04.820471 run osmo-hlr_10.42.42.2(pid=2992): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2992)] 14:48:04.868418 run osmo-hlr_10.42.42.2(pid=2992): stdout: | (launched: 2022-12-14_14:48:01.420867) 14:48:04.918178 run osmo-hlr_10.42.42.2(pid=2992): stderr: | 20221214144801670 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144801670 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144801670 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144801670 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144801670 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144801670 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144801687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144801703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144801703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144801703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:48:04.968108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2991): Terminating (SIGTERM) 14:48:05.008383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2994): Terminating (SIGTERM) 14:48:05.048404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2997): Terminating (SIGTERM) 14:48:05.088673 --- ParallelTerminationStrategy: PID 2991 died... 14:48:05.108298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2991): Terminated: ok {rc=0} 14:48:05.152415 --- ParallelTerminationStrategy: PID 2994 died... 14:48:05.171494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2994): Terminated: ok {rc=0} 14:48:05.215606 --- ParallelTerminationStrategy: PID 2997 died... 14:48:05.234531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2997): Terminated: ok {rc=0} 14:48:05.320620 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:48:06.627307 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:48:06.633791 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:48:06.665913 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 14:48:06.700365 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:48:06.754875 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:48:06.789873 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 14:48:06.825087 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:48:07.380868 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2406 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 14:48:07.386351 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:48:07.397976 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:48:07.472294 tst switch_tch_pdch.py: using LAC 41634 14:48:07.598793 tst switch_tch_pdch.py: using RAC 69 14:48:07.723079 tst switch_tch_pdch.py: using CellId 41634 14:48:07.847829 tst switch_tch_pdch.py: using BVCI 41635 14:48:07.963444 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:48:07.975181 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:48:07.986700 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:48:07.998357 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:48:08.010597 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:48:08.022649 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:48:08.034917 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:48:08.046983 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:48:08.168874 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:48:08.285564 tst switch_tch_pdch.py:51: start network... 14:48:08.485341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:48:08.946384 run create_hlr_db(pid=3002): Launched 14:48:09.060550 bus /gobi_6: Setting Powered False 14:48:10.120528 run create_hlr_db(pid=3002): Terminated: ok {rc=0} 14:48:10.557398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3004): Launched 14:48:10.875900 run osmo-hlr_10.42.42.2(pid=3005): Launched 14:48:10.997091 run osmo-stp_10.42.42.5: Starting osmo-stp 14:48:11.545382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3007): Launched 14:48:11.863418 run osmo-stp_10.42.42.5(pid=3008): Launched 14:48:11.984428 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:48:12.532800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3010): Launched 14:48:12.654442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:48:12.921679 run patchelf(pid=3011): Launched 14:48:13.098631 run osmo-stp_10.42.42.5(pid=3008): ERR: Terminated: ERROR {rc=1} [trial-2406↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3008)] 14:48:13.233486 run osmo-stp_10.42.42.5(pid=3008): stdout: | (launched: 2022-12-14_14:48:11.805609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:13.370232 run osmo-stp_10.42.42.5(pid=3008): stderr: | 20221214144812000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144812000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144812000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144812001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144812001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144812001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144812001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:48:13.506771 run osmo-stp_10.42.42.5(pid=3008): stdout: | (launched: 2022-12-14_14:48:11.805609) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:13.636753 run osmo-stp_10.42.42.5(pid=3008): stderr: | 20221214144812000 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144812000 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144812000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144812001 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144812001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144812001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144812001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:48:13.791665 run patchelf(pid=3011): Terminating (SIGINT) 14:48:13.970337 run patchelf(pid=3011): Terminated: ok {rc=0} 14:48:14.099088 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3008): Process ended prematurely: osmo-stp_10.42.42.5(pid=3008) [trial-2406↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3008)] [trial-2406↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 14:48:14.108714 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 14:48:14.137072 run osmo-hlr_10.42.42.2(pid=3005): ERR: Terminated: ERROR {rc=237} [trial-2406↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3005)] 14:48:14.187094 run osmo-hlr_10.42.42.2(pid=3005): stdout: | (launched: 2022-12-14_14:48:10.818320) 14:48:14.238703 run osmo-hlr_10.42.42.2(pid=3005): stderr: | 20221214144811015 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144811015 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144811016 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144811016 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144811016 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144811016 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144811031 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144811040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144811041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144811041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:48:14.290504 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3004): Terminating (SIGTERM) 14:48:14.332311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3007): Terminating (SIGTERM) 14:48:14.374781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3010): Terminating (SIGTERM) 14:48:14.416676 --- ParallelTerminationStrategy: PID 3004 died... 14:48:14.436823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3004): Terminated: ok {rc=0} 14:48:14.482790 --- ParallelTerminationStrategy: PID 3007 died... 14:48:14.502413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3007): Terminated: ok {rc=0} 14:48:14.548494 --- ParallelTerminationStrategy: PID 3010 died... 14:48:14.568098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3010): Terminated: ok {rc=0} 14:48:14.655535 bus /gobi_0: Setting Powered False 14:48:15.754363 bus /gobi_0: Setting Powered False 14:48:16.867837 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 14:48:18.122631 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:48:18.128755 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 14:48:18.161948 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 14:48:18.196894 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 14:48:18.252274 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 14:48:18.285269 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 14:48:18.319729 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 14:48:18.876388 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2406 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 14:48:18.881647 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:48:18.892747 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 14:48:18.964252 tst switch_tch_pdch.py: using LAC 41635 14:48:19.100303 tst switch_tch_pdch.py: using RAC 70 14:48:19.224349 tst switch_tch_pdch.py: using CellId 41635 14:48:19.347169 tst switch_tch_pdch.py: using BVCI 41636 14:48:19.462788 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:48:19.474215 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:48:19.485489 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:48:19.496628 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:48:19.507817 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:48:19.519070 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:48:19.530470 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:48:19.541708 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:48:19.657214 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:48:19.771223 tst switch_tch_pdch.py:51: start network... 14:48:19.970888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:48:20.404938 run create_hlr_db(pid=3015): Launched 14:48:20.519415 bus /gobi_6: Setting Powered False 14:48:21.579223 run create_hlr_db(pid=3015): Terminated: ok {rc=0} 14:48:21.987335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3017): Launched 14:48:22.306003 run osmo-hlr_10.42.42.2(pid=3018): Launched 14:48:22.428346 run osmo-stp_10.42.42.5: Starting osmo-stp 14:48:22.953473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3020): Launched 14:48:23.270698 run osmo-stp_10.42.42.5(pid=3021): Launched 14:48:23.392709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:48:23.913590 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3023): Launched 14:48:24.035142 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:48:24.302673 run patchelf(pid=3024): Launched 14:48:24.480478 run osmo-stp_10.42.42.5(pid=3021): ERR: Terminated: ERROR {rc=1} [trial-2406↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3021)] 14:48:24.615086 run osmo-stp_10.42.42.5(pid=3021): stdout: | (launched: 2022-12-14_14:48:23.213098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:24.751201 run osmo-stp_10.42.42.5(pid=3021): stderr: | 20221214144823404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144823404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144823404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144823404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144823405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144823405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144823405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:48:24.886795 run osmo-stp_10.42.42.5(pid=3021): stdout: | (launched: 2022-12-14_14:48:23.213098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:25.016280 run osmo-stp_10.42.42.5(pid=3021): stderr: | 20221214144823404 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144823404 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144823404 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144823404 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144823405 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144823405 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144823405 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:48:25.170340 run patchelf(pid=3024): Terminating (SIGINT) 14:48:25.348431 run patchelf(pid=3024): Terminated: ok {rc=0} 14:48:25.477043 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3021): Process ended prematurely: osmo-stp_10.42.42.5(pid=3021) [trial-2406↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3021)] [trial-2406↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 14:48:25.486532 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 14:48:25.514304 run osmo-hlr_10.42.42.2(pid=3018): ERR: Terminated: ERROR {rc=237} [trial-2406↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3018)] 14:48:25.563764 run osmo-hlr_10.42.42.2(pid=3018): stdout: | (launched: 2022-12-14_14:48:22.248385) 14:48:25.615175 run osmo-hlr_10.42.42.2(pid=3018): stderr: | 20221214144822445 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144822445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144822445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144822445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144822445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144822445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144822457 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144822465 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144822466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144822466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:48:25.666944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3017): Terminating (SIGTERM) 14:48:25.708428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3020): Terminating (SIGTERM) 14:48:25.750348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3023): Terminating (SIGTERM) 14:48:25.792164 --- ParallelTerminationStrategy: PID 3017 died... 14:48:25.812225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3017): Terminated: ok {rc=0} 14:48:25.858041 --- ParallelTerminationStrategy: PID 3020 died... 14:48:25.877560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3020): Terminated: ok {rc=0} 14:48:25.923546 --- ParallelTerminationStrategy: PID 3023 died... 14:48:25.943235 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3023): Terminated: ok {rc=0} 14:48:26.030951 bus /gobi_0: Setting Powered False 14:48:27.129464 bus /gobi_0: Setting Powered False 14:48:28.244129 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 14:48:29.491096 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:48:29.494995 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 14:48:29.527644 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 14:48:29.535070 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:48:29.586079 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 14:48:29.619023 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 14:48:29.625599 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:48:30.163431 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 14:48:30.168463 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 14:48:30.179465 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:48:30.231958 tst mo_mt_sms.py: using LAC 41636 14:48:30.361842 tst mo_mt_sms.py: using RAC 71 14:48:30.487061 tst mo_mt_sms.py: using CellId 41636 14:48:30.610645 tst mo_mt_sms.py: using BVCI 41637 14:48:30.725988 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:48:30.853282 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:48:30.975575 tst mo_mt_sms.py:9: start nitb and bts... 14:48:31.202304 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:48:31.868447 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3028): Launched 14:48:32.200865 run osmo-nitb_10.42.42.2(pid=3029): Launched 14:48:32.366232 run osmo-nitb_10.42.42.2(pid=3029): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3029)] 14:48:32.499741 run osmo-nitb_10.42.42.2(pid=3029): stdout: | (launched: 2022-12-14_14:48:32.145684) 14:48:32.635200 run osmo-nitb_10.42.42.2(pid=3029): stderr: | (launched: 2022-12-14_14:48:32.190534) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:48:32.770067 run osmo-nitb_10.42.42.2(pid=3029): stdout: | (launched: 2022-12-14_14:48:32.145684) 14:48:32.899668 run osmo-nitb_10.42.42.2(pid=3029): stderr: | (launched: 2022-12-14_14:48:32.190534) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3029): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3029) [trial-2406↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3029)] 14:48:33.313603 tst osmo-nitb_10.42.42.2(pid=3029): stdout: | (launched: 2022-12-14_14:48:32.145684) 14:48:33.432252 tst osmo-nitb_10.42.42.2(pid=3029): stderr: | (launched: 2022-12-14_14:48:32.190534) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:48:33.572381 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3029): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3029) [trial-2406↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3029)] [trial-2406↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 14:48:33.581209 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 14:48:33.587914 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3028): Terminating (SIGTERM) 14:48:33.797106 --- ParallelTerminationStrategy: PID 3028 died... 14:48:33.817611 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3028): Terminated: ok {rc=0} 14:48:33.904228 bus /sierra_3: Setting Powered False 14:48:35.004247 bus /sierra_3: Setting Powered False 14:48:36.119007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 sms:trx-sysmocell5000 --------------------------------------------------------------------- 14:48:37.319361 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:48:37.323755 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 14:48:37.357976 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:48:37.385881 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 14:48:37.440137 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 14:48:37.473272 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:48:37.504341 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 14:48:38.048136 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 14:48:38.053578 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:38.064583 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:48:38.113513 tst mo_mt_sms.py: using LAC 41637 14:48:38.238276 tst mo_mt_sms.py: using RAC 72 14:48:38.369827 tst mo_mt_sms.py: using CellId 41637 14:48:38.494636 tst mo_mt_sms.py: using BVCI 41638 14:48:38.611595 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:38.622739 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:38.633751 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:38.644578 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:38.655759 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:38.666999 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:48:38.782465 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 14:48:38.895856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:48:39.355815 run create_hlr_db(pid=3033): Launched 14:48:39.471134 bus /sierra_2: Setting Powered False 14:48:40.532648 run create_hlr_db(pid=3033): Terminated: ok {rc=0} 14:48:40.960800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3035): Launched 14:48:41.256863 run osmo-hlr_10.42.42.2(pid=3036): Launched 14:48:41.370220 run osmo-stp_10.42.42.5: Starting osmo-stp 14:48:41.892887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3038): Launched 14:48:42.189682 run osmo-stp_10.42.42.5(pid=3039): Launched 14:48:42.302958 run osmo-msc_10.42.42.6: Starting osmo-msc 14:48:42.839111 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3041): Launched 14:48:43.136137 run osmo-msc_10.42.42.6(pid=3042): Launched 14:48:43.303599 run osmo-stp_10.42.42.5(pid=3039): ERR: Terminated: ERROR {rc=1} [trial-2406↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3039)] 14:48:43.429769 run osmo-stp_10.42.42.5(pid=3039): stdout: | (launched: 2022-12-14_14:48:42.135346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:43.556047 run osmo-stp_10.42.42.5(pid=3039): stderr: | 20221214144842302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144842302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144842302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144842302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144842305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144842305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144842305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:48:43.679906 run osmo-stp_10.42.42.5(pid=3039): stdout: | (launched: 2022-12-14_14:48:42.135346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:43.797705 run osmo-stp_10.42.42.5(pid=3039): stderr: | 20221214144842302 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144842302 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144842302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144842302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144842305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144842305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144842305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:48:43.938783 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3039): Process ended prematurely: osmo-stp_10.42.42.5(pid=3039) [trial-2406↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3039)] [trial-2406↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 14:48:43.947222 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 14:48:43.973304 run osmo-hlr_10.42.42.2(pid=3036): ERR: Terminated: ERROR {rc=237} [trial-2406↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3036)] 14:48:44.021099 run osmo-hlr_10.42.42.2(pid=3036): stdout: | (launched: 2022-12-14_14:48:41.202510) 14:48:44.070447 run osmo-hlr_10.42.42.2(pid=3036): stderr: | 20221214144841380 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144841380 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144841380 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144841380 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144841380 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144841380 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144841393 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144841403 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144841403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144841403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:48:44.139538 run osmo-msc_10.42.42.6(pid=3042): ERR: Terminated: ERROR {rc=2} [trial-2406↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3042)] 14:48:44.186729 run osmo-msc_10.42.42.6(pid=3042): stdout: | (launched: 2022-12-14_14:48:43.081644) 14:48:44.235969 run osmo-msc_10.42.42.6(pid=3042): stderr: | 20221214144843352 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144843352 DLGLOBAL DEBUG validating counter group 0x7f9a78956c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144843352 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144843352 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144843352 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144843353 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144843354 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144843355 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144843355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144843355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:48:44.285632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3035): Terminating (SIGTERM) 14:48:44.325460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3038): Terminating (SIGTERM) 14:48:44.365414 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3041): Terminating (SIGTERM) 14:48:44.405946 --- ParallelTerminationStrategy: PID 3035 died... 14:48:44.425618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3035): Terminated: ok {rc=0} 14:48:44.470054 --- ParallelTerminationStrategy: PID 3038 died... 14:48:44.489132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3038): Terminated: ok {rc=0} 14:48:44.532941 --- ParallelTerminationStrategy: PID 3041 died... 14:48:44.551911 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3041): Terminated: ok {rc=0} 14:48:44.638386 bus /sierra_3: Setting Powered False 14:48:45.736815 bus /sierra_3: Setting Powered False 14:48:46.847418 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 14:48:48.076466 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:48:48.080388 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 14:48:48.113273 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 14:48:48.121077 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 14:48:48.162367 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 14:48:48.195942 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 14:48:48.202657 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 14:48:48.715179 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2406 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 14:48:48.719936 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 14:48:48.730700 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:48:48.779066 tst assert_extension.py: using LAC 41638 14:48:48.893778 tst assert_extension.py: using RAC 73 14:48:49.019096 tst assert_extension.py: using CellId 41638 14:48:49.141761 tst assert_extension.py: using BVCI 41639 14:48:49.256318 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 14:48:49.372158 tst assert_extension.py:10: start nitb and bts... 14:48:49.587193 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:48:50.238073 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3047): Launched 14:48:50.558062 run osmo-nitb_10.42.42.2(pid=3048): Launched 14:48:50.735531 run osmo-nitb_10.42.42.2(pid=3048): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3048)] 14:48:50.878281 run osmo-nitb_10.42.42.2(pid=3048): stdout: | (launched: 2022-12-14_14:48:50.500267) 14:48:51.023429 run osmo-nitb_10.42.42.2(pid=3048): stderr: | (launched: 2022-12-14_14:48:50.547508) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:48:51.167788 run osmo-nitb_10.42.42.2(pid=3048): stdout: | (launched: 2022-12-14_14:48:50.500267) 14:48:51.306315 run osmo-nitb_10.42.42.2(pid=3048): stderr: | (launched: 2022-12-14_14:48:50.547508) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3048) [trial-2406↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3048)] 14:48:51.678286 tst osmo-nitb_10.42.42.2(pid=3048): stdout: | (launched: 2022-12-14_14:48:50.500267) 14:48:51.807260 tst osmo-nitb_10.42.42.2(pid=3048): stderr: | (launched: 2022-12-14_14:48:50.547508) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:48:51.958931 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3048): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3048) [trial-2406↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3048)] [trial-2406↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 14:48:51.967814 tst assert_extension.py:12: Test FAILED (3.2 sec) 14:48:51.975084 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3047): Terminating (SIGTERM) 14:48:52.186036 --- ParallelTerminationStrategy: PID 3047 died... 14:48:52.208294 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3047): Terminated: ok {rc=0} 14:48:52.296466 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 14:48:53.474412 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:48:53.478287 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 14:48:53.510946 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:48:53.538268 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 14:48:53.573659 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 14:48:53.607309 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:48:53.633654 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 14:48:54.165317 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2406 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 14:48:54.172550 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:54.184404 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:48:54.235470 tst assert_extension.py: using LAC 41639 14:48:54.362334 tst assert_extension.py: using RAC 74 14:48:54.487636 tst assert_extension.py: using CellId 41639 14:48:54.605645 tst assert_extension.py: using BVCI 41640 14:48:54.721785 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:54.733206 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:54.744385 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:54.755538 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:54.766897 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:48:54.778299 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 14:48:54.896867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:48:55.389725 run create_hlr_db(pid=3052): Launched 14:48:55.519939 bus /sierra_2: Setting Powered False 14:48:56.583746 run create_hlr_db(pid=3052): Terminated: ok {rc=0} 14:48:57.009919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3054): Launched 14:48:57.307320 run osmo-hlr_10.42.42.2(pid=3055): Launched 14:48:57.421901 run osmo-stp_10.42.42.5: Starting osmo-stp 14:48:58.047416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3057): Launched 14:48:58.339616 run osmo-stp_10.42.42.5(pid=3058): Launched 14:48:58.451713 run osmo-msc_10.42.42.6: Starting osmo-msc 14:48:58.980486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3060): Launched 14:48:59.273409 run osmo-msc_10.42.42.6(pid=3061): Launched 14:48:59.439209 run osmo-stp_10.42.42.5(pid=3058): ERR: Terminated: ERROR {rc=1} [trial-2406↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3058)] 14:48:59.564433 run osmo-stp_10.42.42.5(pid=3058): stdout: | (launched: 2022-12-14_14:48:58.286078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:59.689209 run osmo-stp_10.42.42.5(pid=3058): stderr: | 20221214144858454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144858454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144858454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144858455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144858457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144858457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144858457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:48:59.811663 run osmo-stp_10.42.42.5(pid=3058): stdout: | (launched: 2022-12-14_14:48:58.286078) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:48:59.927940 run osmo-stp_10.42.42.5(pid=3058): stderr: | 20221214144858454 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144858454 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144858454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144858455 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144858457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144858457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144858457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:00.067905 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3058): Process ended prematurely: osmo-stp_10.42.42.5(pid=3058) [trial-2406↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3058)] [trial-2406↪ussd:trx-sysmocell5000↪assert_extension.py:17] 14:49:00.076169 tst assert_extension.py:17: Test FAILED (5.9 sec) 14:49:00.102091 run osmo-hlr_10.42.42.2(pid=3055): ERR: Terminated: ERROR {rc=237} [trial-2406↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3055)] 14:49:00.150397 run osmo-hlr_10.42.42.2(pid=3055): stdout: | (launched: 2022-12-14_14:48:57.252886) 14:49:00.199643 run osmo-hlr_10.42.42.2(pid=3055): stderr: | 20221214144857429 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144857429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144857429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144857429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144857429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144857430 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144857442 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144857450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144857450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144857450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:49:00.268613 run osmo-msc_10.42.42.6(pid=3061): ERR: Terminated: ERROR {rc=2} [trial-2406↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3061)] 14:49:00.315792 run osmo-msc_10.42.42.6(pid=3061): stdout: | (launched: 2022-12-14_14:48:59.220315) 14:49:00.365161 run osmo-msc_10.42.42.6(pid=3061): stderr: | 20221214144859489 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144859489 DLGLOBAL DEBUG validating counter group 0x7f244463bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144859489 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144859489 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144859489 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144859490 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144859491 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144859492 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144859492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144859492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:49:00.415311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3054): Terminating (SIGTERM) 14:49:00.455596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3057): Terminating (SIGTERM) 14:49:00.495813 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3060): Terminating (SIGTERM) 14:49:00.536254 --- ParallelTerminationStrategy: PID 3054 died... 14:49:00.555656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3054): Terminated: ok {rc=0} 14:49:00.599673 --- ParallelTerminationStrategy: PID 3057 died... 14:49:00.618348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3057): Terminated: ok {rc=0} 14:49:00.662622 --- ParallelTerminationStrategy: PID 3060 died... 14:49:00.682193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3060): Terminated: ok {rc=0} 14:49:00.766232 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 14:49:01.996611 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:49:02.005324 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 14:49:02.042919 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 14:49:02.072363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 14:49:02.127628 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 14:49:02.161528 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 14:49:02.190076 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 14:49:02.741722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 14:49:02.793504 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:02.805217 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:49:02.876503 tst mo_mt_call.py: using LAC 41640 14:49:03.001619 tst mo_mt_call.py: using RAC 75 14:49:03.126829 tst mo_mt_call.py: using CellId 41640 14:49:03.252646 tst mo_mt_call.py: using BVCI 41641 14:49:03.367855 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:03.379428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:03.391684 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:03.403260 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:03.414886 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:03.426517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:49:03.541958 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:49:03.661448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:49:04.155504 run create_hlr_db(pid=3066): Launched 14:49:04.286414 bus /sierra_2: Setting Powered False 14:49:05.350527 run create_hlr_db(pid=3066): Terminated: ok {rc=0} 14:49:05.780425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3068): Launched 14:49:06.080927 run osmo-hlr_10.42.42.2(pid=3069): Launched 14:49:06.195167 run osmo-stp_10.42.42.5: Starting osmo-stp 14:49:06.723717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3071): Launched 14:49:07.023073 run osmo-stp_10.42.42.5(pid=3072): Launched 14:49:07.138270 run osmo-msc_10.42.42.6: Starting osmo-msc 14:49:07.677393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3074): Launched 14:49:07.977040 run osmo-msc_10.42.42.6(pid=3075): Launched 14:49:08.146096 run osmo-stp_10.42.42.5(pid=3072): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3072)] 14:49:08.273719 run osmo-stp_10.42.42.5(pid=3072): stdout: | (launched: 2022-12-14_14:49:06.968442) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:08.400728 run osmo-stp_10.42.42.5(pid=3072): stderr: | 20221214144907137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144907137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144907137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144907138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144907138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144907138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144907138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:08.525461 run osmo-stp_10.42.42.5(pid=3072): stdout: | (launched: 2022-12-14_14:49:06.968442) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:08.643947 run osmo-stp_10.42.42.5(pid=3072): stderr: | 20221214144907137 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144907137 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144907137 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144907138 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144907138 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144907138 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144907138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:08.786177 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3072): Process ended prematurely: osmo-stp_10.42.42.5(pid=3072) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3072)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 14:49:08.794999 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 14:49:08.821504 run osmo-hlr_10.42.42.2(pid=3069): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3069)] 14:49:08.869453 run osmo-hlr_10.42.42.2(pid=3069): stdout: | (launched: 2022-12-14_14:49:06.026333) 14:49:08.918983 run osmo-hlr_10.42.42.2(pid=3069): stderr: | 20221214144906202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144906202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144906202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144906202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144906202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144906202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144906218 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144906227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144906228 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144906228 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:49:08.988646 run osmo-msc_10.42.42.6(pid=3075): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3075)] 14:49:09.036180 run osmo-msc_10.42.42.6(pid=3075): stdout: | (launched: 2022-12-14_14:49:07.922278) 14:49:09.086084 run osmo-msc_10.42.42.6(pid=3075): stderr: | 20221214144908193 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144908193 DLGLOBAL DEBUG validating counter group 0x7f69cddc4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144908193 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144908193 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144908194 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144908194 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144908195 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144908196 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144908196 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144908196 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:49:09.135887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3068): Terminating (SIGTERM) 14:49:09.175878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3071): Terminating (SIGTERM) 14:49:09.215786 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3074): Terminating (SIGTERM) 14:49:09.255816 --- ParallelTerminationStrategy: PID 3068 died... 14:49:09.275179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3068): Terminated: ok {rc=0} 14:49:09.319117 --- ParallelTerminationStrategy: PID 3071 died... 14:49:09.337959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3071): Terminated: ok {rc=0} 14:49:09.381651 --- ParallelTerminationStrategy: PID 3074 died... 14:49:09.400505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3074): Terminated: ok {rc=0} 14:49:09.486817 bus /sierra_3: Setting Powered False 14:49:10.585728 bus /sierra_3: Setting Powered False 14:49:11.700715 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 14:49:12.845983 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:12.857743 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:49:12.926960 tst mo_mt_call_osmux.py: using LAC 41641 14:49:13.046162 tst mo_mt_call_osmux.py: using RAC 76 14:49:13.163512 tst mo_mt_call_osmux.py: using CellId 41641 14:49:13.290877 tst mo_mt_call_osmux.py: using BVCI 41642 14:49:13.407389 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:13.419278 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:13.430951 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:13.442773 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:13.454594 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:49:13.466137 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:49:13.581289 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:49:13.699655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:49:14.195087 run create_hlr_db(pid=3077): Launched 14:49:14.325414 bus /sierra_2: Setting Powered False 14:49:15.388375 run create_hlr_db(pid=3077): Terminated: ok {rc=0} 14:49:15.843800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3079): Launched 14:49:16.188135 run osmo-hlr_10.42.42.2(pid=3080): Launched 14:49:16.474025 run osmo-stp_10.42.42.5: Starting osmo-stp 14:49:17.132426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3082): Launched 14:49:17.460401 run osmo-stp_10.42.42.5(pid=3083): Launched 14:49:17.583169 run osmo-msc_10.42.42.6: Starting osmo-msc 14:49:18.160434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3085): Launched 14:49:18.480355 run osmo-msc_10.42.42.6(pid=3086): Launched 14:49:18.658909 run osmo-stp_10.42.42.5(pid=3083): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3083)] 14:49:18.793170 run osmo-stp_10.42.42.5(pid=3083): stdout: | (launched: 2022-12-14_14:49:17.402333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:18.928193 run osmo-stp_10.42.42.5(pid=3083): stderr: | 20221214144917597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144917597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144917597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144917598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144917598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144917598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144917598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:19.062604 run osmo-stp_10.42.42.5(pid=3083): stdout: | (launched: 2022-12-14_14:49:17.402333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:19.189864 run osmo-stp_10.42.42.5(pid=3083): stderr: | 20221214144917597 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144917597 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144917597 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144917598 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144917598 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144917598 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144917598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:19.341530 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3083): Process ended prematurely: osmo-stp_10.42.42.5(pid=3083) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3083)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 14:49:19.351135 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 14:49:19.378631 run osmo-hlr_10.42.42.2(pid=3080): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3080)] 14:49:19.428637 run osmo-hlr_10.42.42.2(pid=3080): stdout: | (launched: 2022-12-14_14:49:16.127328) 14:49:19.480114 run osmo-hlr_10.42.42.2(pid=3080): stderr: | 20221214144916366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144916366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144916366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144916366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144916366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144916366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144916383 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144916400 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144916400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144916401 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:49:19.551500 run osmo-msc_10.42.42.6(pid=3086): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3086)] 14:49:19.600717 run osmo-msc_10.42.42.6(pid=3086): stdout: | (launched: 2022-12-14_14:49:18.422235) 14:49:19.651509 run osmo-msc_10.42.42.6(pid=3086): stderr: | 20221214144918746 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144918746 DLGLOBAL DEBUG validating counter group 0x7fd43d30cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144918746 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144918746 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144918746 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144918746 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144918748 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144918749 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144918749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144918749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:49:19.703007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3079): Terminating (SIGTERM) 14:49:19.744389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3082): Terminating (SIGTERM) 14:49:19.785966 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3085): Terminating (SIGTERM) 14:49:19.827404 --- ParallelTerminationStrategy: PID 3079 died... 14:49:19.847152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3079): Terminated: ok {rc=0} 14:49:19.892642 --- ParallelTerminationStrategy: PID 3082 died... 14:49:19.911950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3082): Terminated: ok {rc=0} 14:49:19.957391 --- ParallelTerminationStrategy: PID 3085 died... 14:49:19.976518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3085): Terminated: ok {rc=0} 14:49:20.063964 bus /sierra_3: Setting Powered False 14:49:21.161116 bus /sierra_3: Setting Powered False 14:49:22.274838 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 14:49:23.530363 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:49:23.537666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 14:49:23.571868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 14:49:23.599420 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 14:49:23.654741 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 14:49:23.689272 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 14:49:23.716109 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 14:49:24.265823 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 14:49:24.317756 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:24.329474 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:49:24.405080 tst mo_mt_call.py: using LAC 41642 14:49:24.529223 tst mo_mt_call.py: using RAC 77 14:49:24.653193 tst mo_mt_call.py: using CellId 41642 14:49:24.776651 tst mo_mt_call.py: using BVCI 41643 14:49:24.892728 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:24.904296 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:24.915663 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:24.927059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:24.939093 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:24.950917 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:49:25.067237 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:49:25.188429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:49:25.689726 run create_hlr_db(pid=3092): Launched 14:49:25.820143 bus /sierra_2: Setting Powered False 14:49:26.883787 run create_hlr_db(pid=3092): Terminated: ok {rc=0} 14:49:27.330433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3094): Launched 14:49:27.651507 run osmo-hlr_10.42.42.2(pid=3095): Launched 14:49:27.773682 run osmo-stp_10.42.42.5: Starting osmo-stp 14:49:28.324505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3097): Launched 14:49:28.645690 run osmo-stp_10.42.42.5(pid=3098): Launched 14:49:28.768268 run osmo-msc_10.42.42.6: Starting osmo-msc 14:49:29.353533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3100): Launched 14:49:29.674513 run osmo-msc_10.42.42.6(pid=3101): Launched 14:49:29.853366 run osmo-stp_10.42.42.5(pid=3098): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3098)] 14:49:29.988326 run osmo-stp_10.42.42.5(pid=3098): stdout: | (launched: 2022-12-14_14:49:28.587615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:30.124078 run osmo-stp_10.42.42.5(pid=3098): stderr: | 20221214144928778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144928779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144928780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144928780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144928782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144928782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144928782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:30.259000 run osmo-stp_10.42.42.5(pid=3098): stdout: | (launched: 2022-12-14_14:49:28.587615) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:30.386436 run osmo-stp_10.42.42.5(pid=3098): stderr: | 20221214144928778 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144928779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144928780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144928780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144928782 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144928782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144928782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:30.539392 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3098): Process ended prematurely: osmo-stp_10.42.42.5(pid=3098) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3098)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 14:49:30.548656 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:49:30.576281 run osmo-hlr_10.42.42.2(pid=3095): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3095)] 14:49:30.626209 run osmo-hlr_10.42.42.2(pid=3095): stdout: | (launched: 2022-12-14_14:49:27.593511) 14:49:30.678069 run osmo-hlr_10.42.42.2(pid=3095): stderr: | 20221214144927791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144927791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144927791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144927791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144927791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144927791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144927803 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144927811 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144927812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144927812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:49:30.750125 run osmo-msc_10.42.42.6(pid=3101): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3101)] 14:49:30.800095 run osmo-msc_10.42.42.6(pid=3101): stdout: | (launched: 2022-12-14_14:49:29.616395) 14:49:30.864162 run osmo-msc_10.42.42.6(pid=3101): stderr: | 20221214144929937 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144929937 DLGLOBAL DEBUG validating counter group 0x7f3fb38c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144929937 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144929937 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144929937 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144929937 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144929939 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144929939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144929940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144929940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:49:30.917333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3094): Terminating (SIGTERM) 14:49:30.959711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3097): Terminating (SIGTERM) 14:49:31.002526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3100): Terminating (SIGTERM) 14:49:31.046620 --- ParallelTerminationStrategy: PID 3094 died... 14:49:31.066808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3094): Terminated: ok {rc=0} 14:49:31.113243 --- ParallelTerminationStrategy: PID 3097 died... 14:49:31.133412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3097): Terminated: ok {rc=0} 14:49:31.179686 --- ParallelTerminationStrategy: PID 3100 died... 14:49:31.199680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3100): Terminated: ok {rc=0} 14:49:31.288802 bus /sierra_3: Setting Powered False 14:49:32.388816 bus /sierra_3: Setting Powered False 14:49:33.512317 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 14:49:34.657339 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:34.669168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:49:34.738570 tst mo_mt_call_osmux.py: using LAC 41643 14:49:34.855136 tst mo_mt_call_osmux.py: using RAC 78 14:49:34.973861 tst mo_mt_call_osmux.py: using CellId 41643 14:49:35.093385 tst mo_mt_call_osmux.py: using BVCI 41644 14:49:35.201680 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:35.212891 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:35.223867 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:35.234849 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:35.246193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:49:35.257515 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:49:35.373598 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:49:35.492397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:49:35.987800 run create_hlr_db(pid=3103): Launched 14:49:36.118631 bus /sierra_2: Setting Powered False 14:49:37.182054 run create_hlr_db(pid=3103): Terminated: ok {rc=0} 14:49:37.608398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3105): Launched 14:49:37.907623 run osmo-hlr_10.42.42.2(pid=3106): Launched 14:49:38.021113 run osmo-stp_10.42.42.5: Starting osmo-stp 14:49:38.550454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3108): Launched 14:49:38.849732 run osmo-stp_10.42.42.5(pid=3109): Launched 14:49:38.964321 run osmo-msc_10.42.42.6: Starting osmo-msc 14:49:39.508910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3111): Launched 14:49:39.808560 run osmo-msc_10.42.42.6(pid=3112): Launched 14:49:39.977556 run osmo-stp_10.42.42.5(pid=3109): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3109)] 14:49:40.112481 run osmo-stp_10.42.42.5(pid=3109): stdout: | (launched: 2022-12-14_14:49:38.795203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:40.250121 run osmo-stp_10.42.42.5(pid=3109): stderr: | 20221214144938966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144938966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144938966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144938967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144938967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144938967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144938967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:40.383746 run osmo-stp_10.42.42.5(pid=3109): stdout: | (launched: 2022-12-14_14:49:38.795203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:40.510685 run osmo-stp_10.42.42.5(pid=3109): stderr: | 20221214144938966 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144938966 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144938966 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144938967 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144938967 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144938967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144938967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:40.663454 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3109): Process ended prematurely: osmo-stp_10.42.42.5(pid=3109) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3109)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 14:49:40.673033 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 14:49:40.700582 run osmo-hlr_10.42.42.2(pid=3106): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3106)] 14:49:40.750463 run osmo-hlr_10.42.42.2(pid=3106): stdout: | (launched: 2022-12-14_14:49:37.853553) 14:49:40.801906 run osmo-hlr_10.42.42.2(pid=3106): stderr: | 20221214144938028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144938028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144938028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144938028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144938028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144938028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144938041 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144938050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144938050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144938050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:49:40.873729 run osmo-msc_10.42.42.6(pid=3112): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3112)] 14:49:40.923726 run osmo-msc_10.42.42.6(pid=3112): stdout: | (launched: 2022-12-14_14:49:39.753704) 14:49:40.975073 run osmo-msc_10.42.42.6(pid=3112): stderr: | 20221214144940025 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144940025 DLGLOBAL DEBUG validating counter group 0x7fb38095fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144940025 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144940026 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144940026 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144940026 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144940027 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144940028 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144940028 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144940028 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:49:41.026896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3105): Terminating (SIGTERM) 14:49:41.068384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3108): Terminating (SIGTERM) 14:49:41.110154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3111): Terminating (SIGTERM) 14:49:41.151939 --- ParallelTerminationStrategy: PID 3105 died... 14:49:41.171452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3105): Terminated: ok {rc=0} 14:49:41.217324 --- ParallelTerminationStrategy: PID 3108 died... 14:49:41.236497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3108): Terminated: ok {rc=0} 14:49:41.282347 --- ParallelTerminationStrategy: PID 3111 died... 14:49:41.301934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3111): Terminated: ok {rc=0} 14:49:41.390228 bus /sierra_3: Setting Powered False 14:49:42.489366 bus /sierra_3: Setting Powered False 14:49:43.605712 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 14:49:44.858718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:49:44.866044 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 14:49:44.900100 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 14:49:44.927519 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 14:49:44.980060 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 14:49:45.014770 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 14:49:45.041718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 14:49:45.592269 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 14:49:45.645383 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:45.657133 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:49:45.728860 tst mo_mt_call.py: using LAC 41644 14:49:45.857959 tst mo_mt_call.py: using RAC 79 14:49:45.996249 tst mo_mt_call.py: using CellId 41644 14:49:46.127921 tst mo_mt_call.py: using BVCI 41645 14:49:46.247083 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:46.259434 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:46.271432 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:46.283484 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:46.296818 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:46.310174 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:49:46.452059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:49:46.595950 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:49:47.074867 run create_hlr_db(pid=3118): Launched 14:49:47.229338 bus /sierra_2: Setting Powered False 14:49:48.288922 run create_hlr_db(pid=3118): Terminated: ok {rc=0} 14:49:48.706658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3120): Launched 14:49:49.005772 run osmo-hlr_10.42.42.2(pid=3121): Launched 14:49:49.120457 run osmo-stp_10.42.42.5: Starting osmo-stp 14:49:49.651582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3123): Launched 14:49:49.952718 run osmo-stp_10.42.42.5(pid=3124): Launched 14:49:50.068374 run osmo-msc_10.42.42.6: Starting osmo-msc 14:49:50.611350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3126): Launched 14:49:50.911878 run osmo-msc_10.42.42.6(pid=3127): Launched 14:49:51.081369 run osmo-stp_10.42.42.5(pid=3124): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3124)] 14:49:51.209775 run osmo-stp_10.42.42.5(pid=3124): stdout: | (launched: 2022-12-14_14:49:49.897887) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:51.337818 run osmo-stp_10.42.42.5(pid=3124): stderr: | 20221214144950068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144950068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144950069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144950069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144950070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144950070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144950070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:51.463942 run osmo-stp_10.42.42.5(pid=3124): stdout: | (launched: 2022-12-14_14:49:49.897887) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:49:51.583199 run osmo-stp_10.42.42.5(pid=3124): stderr: | 20221214144950068 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214144950068 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214144950069 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214144950069 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214144950070 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214144950070 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214144950070 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:49:51.726159 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3124): Process ended prematurely: osmo-stp_10.42.42.5(pid=3124) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3124)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 14:49:51.735141 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 14:49:51.761530 run osmo-hlr_10.42.42.2(pid=3121): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3121)] 14:49:51.809403 run osmo-hlr_10.42.42.2(pid=3121): stdout: | (launched: 2022-12-14_14:49:48.950997) 14:49:51.859086 run osmo-hlr_10.42.42.2(pid=3121): stderr: | 20221214144949127 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144949127 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144949127 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144949127 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144949127 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144949127 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144949143 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144949152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144949152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144949152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:49:51.928668 run osmo-msc_10.42.42.6(pid=3127): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3127)] 14:49:51.976062 run osmo-msc_10.42.42.6(pid=3127): stdout: | (launched: 2022-12-14_14:49:50.857238) 14:49:52.025203 run osmo-msc_10.42.42.6(pid=3127): stderr: | 20221214144951127 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214144951127 DLGLOBAL DEBUG validating counter group 0x7f4f5ba86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214144951127 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214144951127 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214144951127 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214144951128 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214144951131 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214144951131 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214144951132 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214144951132 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:49:52.074436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3120): Terminating (SIGTERM) 14:49:52.114331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3123): Terminating (SIGTERM) 14:49:52.154128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3126): Terminating (SIGTERM) 14:49:52.194083 --- ParallelTerminationStrategy: PID 3120 died... 14:49:52.213710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3120): Terminated: ok {rc=0} 14:49:52.257788 --- ParallelTerminationStrategy: PID 3123 died... 14:49:52.276594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3123): Terminated: ok {rc=0} 14:49:52.320591 --- ParallelTerminationStrategy: PID 3126 died... 14:49:52.339516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3126): Terminated: ok {rc=0} 14:49:52.425814 bus /sierra_3: Setting Powered False 14:49:53.525581 bus /sierra_3: Setting Powered False 14:49:54.637808 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 14:49:55.785676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:55.797976 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:49:55.871742 tst mo_mt_call_osmux.py: using LAC 41645 14:49:55.989669 tst mo_mt_call_osmux.py: using RAC 80 14:49:56.108257 tst mo_mt_call_osmux.py: using CellId 41645 14:49:56.226832 tst mo_mt_call_osmux.py: using BVCI 41646 14:49:56.335024 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:56.346304 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:56.357442 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:56.368203 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:56.379771 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:49:56.390920 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:49:56.510517 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:49:56.628150 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:49:57.094504 run create_hlr_db(pid=3129): Launched 14:49:57.209749 bus /sierra_2: Setting Powered False 14:49:58.269808 run create_hlr_db(pid=3129): Terminated: ok {rc=0} 14:49:58.711670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3131): Launched 14:49:59.033401 run osmo-hlr_10.42.42.2(pid=3132): Launched 14:49:59.156658 run osmo-stp_10.42.42.5: Starting osmo-stp 14:49:59.708025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3134): Launched 14:50:00.028517 run osmo-stp_10.42.42.5(pid=3135): Launched 14:50:00.151775 run osmo-msc_10.42.42.6: Starting osmo-msc 14:50:00.737371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3137): Launched 14:50:01.068671 run osmo-msc_10.42.42.6(pid=3138): Launched 14:50:01.310179 run osmo-stp_10.42.42.5(pid=3135): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3135)] 14:50:01.468937 run osmo-stp_10.42.42.5(pid=3135): stdout: | (launched: 2022-12-14_14:49:59.970253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:01.791627 run osmo-stp_10.42.42.5(pid=3135): stderr: | 20221214145000163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145000163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145000163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145000164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145000164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145000164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145000164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:02.083496 run osmo-stp_10.42.42.5(pid=3135): stdout: | (launched: 2022-12-14_14:49:59.970253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:02.254942 run osmo-stp_10.42.42.5(pid=3135): stderr: | 20221214145000163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145000163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145000163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145000164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145000164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145000164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145000164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:02.439252 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3135): Process ended prematurely: osmo-stp_10.42.42.5(pid=3135) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3135)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 14:50:02.449589 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 14:50:02.484789 run osmo-hlr_10.42.42.2(pid=3132): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3132)] 14:50:02.541895 run osmo-hlr_10.42.42.2(pid=3132): stdout: | (launched: 2022-12-14_14:49:58.974990) 14:50:02.594575 run osmo-hlr_10.42.42.2(pid=3132): stderr: | 20221214144959172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214144959172 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214144959172 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214144959172 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214144959172 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214144959172 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214144959184 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214144959192 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214144959192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214144959193 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:50:02.666659 run osmo-msc_10.42.42.6(pid=3138): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3138)] 14:50:02.716414 run osmo-msc_10.42.42.6(pid=3138): stdout: | (launched: 2022-12-14_14:50:01.002891) 14:50:02.767918 run osmo-msc_10.42.42.6(pid=3138): stderr: | 20221214145001698 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145001699 DLGLOBAL DEBUG validating counter group 0x7f8718cd0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145001700 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145001701 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145001701 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145001703 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145001711 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145001714 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145001714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145001715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:50:02.819810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3131): Terminating (SIGTERM) 14:50:02.861408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3134): Terminating (SIGTERM) 14:50:02.902838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3137): Terminating (SIGTERM) 14:50:02.945252 --- ParallelTerminationStrategy: PID 3131 died... 14:50:02.965080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3131): Terminated: ok {rc=0} 14:50:03.011079 --- ParallelTerminationStrategy: PID 3134 died... 14:50:03.030706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3134): Terminated: ok {rc=0} 14:50:03.076659 --- ParallelTerminationStrategy: PID 3137 died... 14:50:03.096157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3137): Terminated: ok {rc=0} 14:50:03.183536 bus /sierra_3: Setting Powered False 14:50:04.281521 bus /sierra_3: Setting Powered False 14:50:05.396900 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 14:50:06.651219 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:50:06.658251 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 14:50:06.692465 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 14:50:06.719508 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 14:50:06.771735 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 14:50:06.805804 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 14:50:06.832740 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 14:50:07.390847 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 14:50:07.442070 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:07.453672 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:50:07.525363 tst mo_mt_call.py: using LAC 41646 14:50:07.651682 tst mo_mt_call.py: using RAC 81 14:50:07.776924 tst mo_mt_call.py: using CellId 41646 14:50:07.901730 tst mo_mt_call.py: using BVCI 41647 14:50:08.019729 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:08.031372 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:08.042884 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:08.054369 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:08.065945 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:08.077414 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:50:08.192447 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:50:08.311601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:50:08.810008 run create_hlr_db(pid=3146): Launched 14:50:08.940774 bus /sierra_2: Setting Powered False 14:50:10.004121 run create_hlr_db(pid=3146): Terminated: ok {rc=0} 14:50:10.431538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3148): Launched 14:50:10.731283 run osmo-hlr_10.42.42.2(pid=3149): Launched 14:50:10.846115 run osmo-stp_10.42.42.5: Starting osmo-stp 14:50:11.376672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3151): Launched 14:50:11.677381 run osmo-stp_10.42.42.5(pid=3152): Launched 14:50:11.792235 run osmo-msc_10.42.42.6: Starting osmo-msc 14:50:12.335855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3154): Launched 14:50:12.637714 run osmo-msc_10.42.42.6(pid=3155): Launched 14:50:12.807284 run osmo-stp_10.42.42.5(pid=3152): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3152)] 14:50:12.935703 run osmo-stp_10.42.42.5(pid=3152): stdout: | (launched: 2022-12-14_14:50:11.622872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:13.063781 run osmo-stp_10.42.42.5(pid=3152): stderr: | 20221214145011794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145011794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145011794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145011795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145011795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145011795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145011795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:13.189335 run osmo-stp_10.42.42.5(pid=3152): stdout: | (launched: 2022-12-14_14:50:11.622872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:13.308617 run osmo-stp_10.42.42.5(pid=3152): stderr: | 20221214145011794 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145011794 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145011794 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145011795 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145011795 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145011795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145011795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:13.451725 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3152): Process ended prematurely: osmo-stp_10.42.42.5(pid=3152) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3152)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 14:50:13.460475 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 14:50:13.487182 run osmo-hlr_10.42.42.2(pid=3149): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3149)] 14:50:13.535393 run osmo-hlr_10.42.42.2(pid=3149): stdout: | (launched: 2022-12-14_14:50:10.676688) 14:50:13.585465 run osmo-hlr_10.42.42.2(pid=3149): stderr: | 20221214145010852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145010852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145010852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145010852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145010852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145010852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145010870 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145010878 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145010879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145010879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:50:13.655049 run osmo-msc_10.42.42.6(pid=3155): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3155)] 14:50:13.702631 run osmo-msc_10.42.42.6(pid=3155): stdout: | (launched: 2022-12-14_14:50:12.582931) 14:50:13.751964 run osmo-msc_10.42.42.6(pid=3155): stderr: | 20221214145012854 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145012854 DLGLOBAL DEBUG validating counter group 0x7feda709ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145012854 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145012854 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145012854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145012855 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145012858 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145012859 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145012859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145012859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:50:13.801856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3148): Terminating (SIGTERM) 14:50:13.841840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3151): Terminating (SIGTERM) 14:50:13.881777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3154): Terminating (SIGTERM) 14:50:13.922266 --- ParallelTerminationStrategy: PID 3148 died... 14:50:13.941918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3148): Terminated: ok {rc=0} 14:50:13.986042 --- ParallelTerminationStrategy: PID 3151 died... 14:50:14.004897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3151): Terminated: ok {rc=0} 14:50:14.049188 --- ParallelTerminationStrategy: PID 3154 died... 14:50:14.068113 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3154): Terminated: ok {rc=0} 14:50:14.152597 bus /sierra_3: Setting Powered False 14:50:15.250507 bus /sierra_3: Setting Powered False 14:50:16.365621 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 14:50:17.517699 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:17.529861 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:50:17.601620 tst mo_mt_call_osmux.py: using LAC 41647 14:50:17.728123 tst mo_mt_call_osmux.py: using RAC 82 14:50:17.855156 tst mo_mt_call_osmux.py: using CellId 41647 14:50:17.980511 tst mo_mt_call_osmux.py: using BVCI 41648 14:50:18.096378 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:18.108078 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:18.119463 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:18.130825 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:18.142327 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:50:18.153772 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:50:18.270821 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:50:18.387189 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:50:18.853156 run create_hlr_db(pid=3157): Launched 14:50:18.969122 bus /sierra_2: Setting Powered False 14:50:20.033121 run create_hlr_db(pid=3157): Terminated: ok {rc=0} 14:50:20.461080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3159): Launched 14:50:20.761209 run osmo-hlr_10.42.42.2(pid=3160): Launched 14:50:20.876512 run osmo-stp_10.42.42.5: Starting osmo-stp 14:50:21.407511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3162): Launched 14:50:21.709464 run osmo-stp_10.42.42.5(pid=3163): Launched 14:50:21.825012 run osmo-msc_10.42.42.6: Starting osmo-msc 14:50:22.367884 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3165): Launched 14:50:22.669567 run osmo-msc_10.42.42.6(pid=3166): Launched 14:50:22.839104 run osmo-stp_10.42.42.5(pid=3163): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3163)] 14:50:22.966287 run osmo-stp_10.42.42.5(pid=3163): stdout: | (launched: 2022-12-14_14:50:21.654229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:23.093959 run osmo-stp_10.42.42.5(pid=3163): stderr: | 20221214145021824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145021824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145021824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145021825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145021827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145021827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145021827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:23.219253 run osmo-stp_10.42.42.5(pid=3163): stdout: | (launched: 2022-12-14_14:50:21.654229) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:23.338204 run osmo-stp_10.42.42.5(pid=3163): stderr: | 20221214145021824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145021824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145021824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145021825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145021827 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145021827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145021827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:23.480719 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3163): Process ended prematurely: osmo-stp_10.42.42.5(pid=3163) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3163)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 14:50:23.489823 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 14:50:23.516077 run osmo-hlr_10.42.42.2(pid=3160): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3160)] 14:50:23.563987 run osmo-hlr_10.42.42.2(pid=3160): stdout: | (launched: 2022-12-14_14:50:20.706535) 14:50:23.613397 run osmo-hlr_10.42.42.2(pid=3160): stderr: | 20221214145020884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145020884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145020884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145020885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145020885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145020885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145020901 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145020911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145020911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145020911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:50:23.682819 run osmo-msc_10.42.42.6(pid=3166): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3166)] 14:50:23.730025 run osmo-msc_10.42.42.6(pid=3166): stdout: | (launched: 2022-12-14_14:50:22.614325) 14:50:23.779122 run osmo-msc_10.42.42.6(pid=3166): stderr: | 20221214145022885 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145022886 DLGLOBAL DEBUG validating counter group 0x7ff5ce7c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145022886 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145022886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145022886 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145022886 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145022888 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145022888 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145022888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145022888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:50:23.829040 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3159): Terminating (SIGTERM) 14:50:23.868576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3162): Terminating (SIGTERM) 14:50:23.908263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3165): Terminating (SIGTERM) 14:50:23.948092 --- ParallelTerminationStrategy: PID 3159 died... 14:50:23.967539 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3159): Terminated: ok {rc=0} 14:50:24.011376 --- ParallelTerminationStrategy: PID 3162 died... 14:50:24.030031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3162): Terminated: ok {rc=0} 14:50:24.073632 --- ParallelTerminationStrategy: PID 3165 died... 14:50:24.092398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3165): Terminated: ok {rc=0} 14:50:24.176080 bus /sierra_3: Setting Powered False 14:50:25.270348 bus /sierra_3: Setting Powered False 14:50:26.384250 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 14:50:27.632930 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:50:27.639406 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 14:50:27.672267 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 14:50:27.699382 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 14:50:27.751311 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 14:50:27.785932 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 14:50:27.813899 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 14:50:28.361065 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 14:50:28.410117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:28.421274 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:50:28.490899 tst mo_mt_call.py: using LAC 41648 14:50:28.608146 tst mo_mt_call.py: using RAC 83 14:50:28.727154 tst mo_mt_call.py: using CellId 41648 14:50:28.845868 tst mo_mt_call.py: using BVCI 41649 14:50:28.955908 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:28.967014 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:28.977995 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:28.988726 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:28.999951 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:29.011156 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:50:29.130432 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:50:29.246383 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:50:29.711785 run create_hlr_db(pid=3171): Launched 14:50:29.827471 bus /sierra_2: Setting Powered False 14:50:30.890595 run create_hlr_db(pid=3171): Terminated: ok {rc=0} 14:50:31.349842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3173): Launched 14:50:31.701767 run osmo-hlr_10.42.42.2(pid=3174): Launched 14:50:32.005744 run osmo-stp_10.42.42.5: Starting osmo-stp 14:50:32.585866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3176): Launched 14:50:32.887353 run osmo-stp_10.42.42.5(pid=3177): Launched 14:50:33.002060 run osmo-msc_10.42.42.6: Starting osmo-msc 14:50:33.545917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3179): Launched 14:50:33.847204 run osmo-msc_10.42.42.6(pid=3180): Launched 14:50:34.015355 run osmo-stp_10.42.42.5(pid=3177): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3177)] 14:50:34.142576 run osmo-stp_10.42.42.5(pid=3177): stdout: | (launched: 2022-12-14_14:50:32.832241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:34.269545 run osmo-stp_10.42.42.5(pid=3177): stderr: | 20221214145033002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145033003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145033003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145033003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145033004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145033004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145033004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:34.394610 run osmo-stp_10.42.42.5(pid=3177): stdout: | (launched: 2022-12-14_14:50:32.832241) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:34.513744 run osmo-stp_10.42.42.5(pid=3177): stderr: | 20221214145033002 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145033003 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145033003 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145033003 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145033004 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145033004 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145033004 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:34.656163 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3177): Process ended prematurely: osmo-stp_10.42.42.5(pid=3177) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3177)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 14:50:34.665058 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:50:34.691225 run osmo-hlr_10.42.42.2(pid=3174): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3174)] 14:50:34.738812 run osmo-hlr_10.42.42.2(pid=3174): stdout: | (launched: 2022-12-14_14:50:31.631753) 14:50:34.787712 run osmo-hlr_10.42.42.2(pid=3174): stderr: | 20221214145031836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145031836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145031836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145031836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145031836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145031836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145031860 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145031868 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145031868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145031868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:50:34.856626 run osmo-msc_10.42.42.6(pid=3180): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3180)] 14:50:34.903782 run osmo-msc_10.42.42.6(pid=3180): stdout: | (launched: 2022-12-14_14:50:33.791978) 14:50:34.953089 run osmo-msc_10.42.42.6(pid=3180): stderr: | 20221214145034060 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145034061 DLGLOBAL DEBUG validating counter group 0x7f3b275d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145034061 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145034061 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145034061 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145034061 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145034063 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145034063 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145034063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145034063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:50:35.002366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3173): Terminating (SIGTERM) 14:50:35.042032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3176): Terminating (SIGTERM) 14:50:35.081664 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3179): Terminating (SIGTERM) 14:50:35.121648 --- ParallelTerminationStrategy: PID 3173 died... 14:50:35.140748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3173): Terminated: ok {rc=0} 14:50:35.184641 --- ParallelTerminationStrategy: PID 3176 died... 14:50:35.203369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3176): Terminated: ok {rc=0} 14:50:35.246796 --- ParallelTerminationStrategy: PID 3179 died... 14:50:35.265465 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3179): Terminated: ok {rc=0} 14:50:35.349182 bus /sierra_3: Setting Powered False 14:50:36.444419 bus /sierra_3: Setting Powered False 14:50:37.556630 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 14:50:38.704676 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:38.717226 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:50:38.789335 tst mo_mt_call_osmux.py: using LAC 41649 14:50:38.915201 tst mo_mt_call_osmux.py: using RAC 84 14:50:39.039953 tst mo_mt_call_osmux.py: using CellId 41649 14:50:39.157411 tst mo_mt_call_osmux.py: using BVCI 41650 14:50:39.274786 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:39.286718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:39.298372 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:39.310075 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:39.321961 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:50:39.333652 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:50:39.449497 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:50:39.567015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:50:40.031649 run create_hlr_db(pid=3182): Launched 14:50:40.146433 bus /sierra_2: Setting Powered False 14:50:41.206743 run create_hlr_db(pid=3182): Terminated: ok {rc=0} 14:50:41.647116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3184): Launched 14:50:41.969591 run osmo-hlr_10.42.42.2(pid=3185): Launched 14:50:42.093070 run osmo-stp_10.42.42.5: Starting osmo-stp 14:50:42.646823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3187): Launched 14:50:42.968673 run osmo-stp_10.42.42.5(pid=3188): Launched 14:50:43.091482 run osmo-msc_10.42.42.6: Starting osmo-msc 14:50:43.675374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3190): Launched 14:50:43.998563 run osmo-msc_10.42.42.6(pid=3191): Launched 14:50:44.179132 run osmo-stp_10.42.42.5(pid=3188): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3188)] 14:50:44.314836 run osmo-stp_10.42.42.5(pid=3188): stdout: | (launched: 2022-12-14_14:50:42.910458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:44.452383 run osmo-stp_10.42.42.5(pid=3188): stderr: | 20221214145043102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145043102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145043103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145043103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145043105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145043106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145043106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:44.587704 run osmo-stp_10.42.42.5(pid=3188): stdout: | (launched: 2022-12-14_14:50:42.910458) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:44.715660 run osmo-stp_10.42.42.5(pid=3188): stderr: | 20221214145043102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145043102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145043103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145043103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145043105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145043106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145043106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:44.868727 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3188): Process ended prematurely: osmo-stp_10.42.42.5(pid=3188) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3188)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 14:50:44.878278 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:50:44.905812 run osmo-hlr_10.42.42.2(pid=3185): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3185)] 14:50:44.955241 run osmo-hlr_10.42.42.2(pid=3185): stdout: | (launched: 2022-12-14_14:50:41.911474) 14:50:45.006823 run osmo-hlr_10.42.42.2(pid=3185): stderr: | 20221214145042108 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145042108 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145042108 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145042108 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145042108 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145042108 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145042121 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145042129 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145042129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145042129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:50:45.079094 run osmo-msc_10.42.42.6(pid=3191): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3191)] 14:50:45.128640 run osmo-msc_10.42.42.6(pid=3191): stdout: | (launched: 2022-12-14_14:50:43.939817) 14:50:45.179854 run osmo-msc_10.42.42.6(pid=3191): stderr: | 20221214145044262 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145044262 DLGLOBAL DEBUG validating counter group 0x7f1622ca9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145044262 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145044262 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145044262 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145044262 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145044264 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145044264 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145044264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145044264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:50:45.231494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3184): Terminating (SIGTERM) 14:50:45.273066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3187): Terminating (SIGTERM) 14:50:45.314720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3190): Terminating (SIGTERM) 14:50:45.356692 --- ParallelTerminationStrategy: PID 3184 died... 14:50:45.376325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3184): Terminated: ok {rc=0} 14:50:45.422304 --- ParallelTerminationStrategy: PID 3187 died... 14:50:45.441984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3187): Terminated: ok {rc=0} 14:50:45.487832 --- ParallelTerminationStrategy: PID 3190 died... 14:50:45.507399 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3190): Terminated: ok {rc=0} 14:50:45.595197 bus /sierra_3: Setting Powered False 14:50:46.697571 bus /sierra_3: Setting Powered False 14:50:47.824402 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:50:49.078734 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:50:49.085230 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:50:49.118292 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 14:50:49.145279 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:50:49.197561 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:50:49.231883 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 14:50:49.259607 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:50:49.807278 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 14:50:49.856402 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:50:49.867865 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:50:49.936406 tst mo_mt_call.py: using LAC 41650 14:50:50.053739 tst mo_mt_call.py: using RAC 85 14:50:50.182215 tst mo_mt_call.py: using CellId 41650 14:50:50.307624 tst mo_mt_call.py: using BVCI 41651 14:50:50.425350 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:50:50.436836 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:50:50.449294 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:50:50.460695 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:50:50.472283 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:50:50.483705 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:50:50.597658 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:50:50.714402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:50:51.210289 run create_hlr_db(pid=3196): Launched 14:50:51.340645 bus /sierra_2: Setting Powered False 14:50:52.404238 run create_hlr_db(pid=3196): Terminated: ok {rc=0} 14:50:52.834721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3198): Launched 14:50:53.135259 run osmo-hlr_10.42.42.2(pid=3199): Launched 14:50:53.250581 run osmo-stp_10.42.42.5: Starting osmo-stp 14:50:53.782457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3201): Launched 14:50:54.082975 run osmo-stp_10.42.42.5(pid=3202): Launched 14:50:54.198194 run osmo-msc_10.42.42.6: Starting osmo-msc 14:50:54.740518 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3204): Launched 14:50:55.042163 run osmo-msc_10.42.42.6(pid=3205): Launched 14:50:55.210703 run osmo-stp_10.42.42.5(pid=3202): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3202)] 14:50:55.339050 run osmo-stp_10.42.42.5(pid=3202): stdout: | (launched: 2022-12-14_14:50:54.028629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:55.466603 run osmo-stp_10.42.42.5(pid=3202): stderr: | 20221214145054199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145054199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145054200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145054200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145054200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145054201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145054201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:55.592374 run osmo-stp_10.42.42.5(pid=3202): stdout: | (launched: 2022-12-14_14:50:54.028629) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:50:55.711321 run osmo-stp_10.42.42.5(pid=3202): stderr: | 20221214145054199 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145054199 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145054200 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145054200 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145054200 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145054201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145054201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:50:55.854301 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3202): Process ended prematurely: osmo-stp_10.42.42.5(pid=3202) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3202)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 14:50:55.863211 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 14:50:55.889935 run osmo-hlr_10.42.42.2(pid=3199): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3199)] 14:50:55.938255 run osmo-hlr_10.42.42.2(pid=3199): stdout: | (launched: 2022-12-14_14:50:53.080324) 14:50:55.987443 run osmo-hlr_10.42.42.2(pid=3199): stderr: | 20221214145053256 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145053256 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145053256 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145053256 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145053256 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145053256 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145053269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145053278 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145053279 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145053279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:50:56.056562 run osmo-msc_10.42.42.6(pid=3205): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3205)] 14:50:56.104125 run osmo-msc_10.42.42.6(pid=3205): stdout: | (launched: 2022-12-14_14:50:54.987146) 14:50:56.153604 run osmo-msc_10.42.42.6(pid=3205): stderr: | 20221214145055258 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145055258 DLGLOBAL DEBUG validating counter group 0x7fad86d0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145055258 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145055258 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145055259 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145055259 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145055260 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145055261 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145055261 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145055261 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:50:56.203836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3198): Terminating (SIGTERM) 14:50:56.243833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3201): Terminating (SIGTERM) 14:50:56.283889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3204): Terminating (SIGTERM) 14:50:56.324063 --- ParallelTerminationStrategy: PID 3198 died... 14:50:56.343474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3198): Terminated: ok {rc=0} 14:50:56.387688 --- ParallelTerminationStrategy: PID 3201 died... 14:50:56.406584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3201): Terminated: ok {rc=0} 14:50:56.450655 --- ParallelTerminationStrategy: PID 3204 died... 14:50:56.469566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3204): Terminated: ok {rc=0} 14:50:56.556098 bus /sierra_3: Setting Powered False 14:50:57.654850 bus /sierra_3: Setting Powered False 14:50:58.770659 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 14:50:59.914811 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:50:59.926596 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:50:59.997563 tst mo_mt_call_osmux.py: using LAC 41651 14:51:00.127207 tst mo_mt_call_osmux.py: using RAC 86 14:51:00.251532 tst mo_mt_call_osmux.py: using CellId 41651 14:51:00.375892 tst mo_mt_call_osmux.py: using BVCI 41652 14:51:00.485302 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:51:00.496431 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:51:00.507633 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:51:00.518775 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:51:00.530299 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:51:00.541715 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:51:00.659816 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:51:00.774870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:51:01.293316 run create_hlr_db(pid=3208): Launched 14:51:01.458854 bus /sierra_2: Setting Powered False 14:51:02.522704 run create_hlr_db(pid=3208): Terminated: ok {rc=0} 14:51:02.971163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3210): Launched 14:51:03.292892 run osmo-hlr_10.42.42.2(pid=3211): Launched 14:51:03.415139 run osmo-stp_10.42.42.5: Starting osmo-stp 14:51:03.966944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3213): Launched 14:51:04.288054 run osmo-stp_10.42.42.5(pid=3214): Launched 14:51:04.410330 run osmo-msc_10.42.42.6: Starting osmo-msc 14:51:04.989441 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3216): Launched 14:51:05.310488 run osmo-msc_10.42.42.6(pid=3217): Launched 14:51:05.489647 run osmo-stp_10.42.42.5(pid=3214): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3214)] 14:51:05.624697 run osmo-stp_10.42.42.5(pid=3214): stdout: | (launched: 2022-12-14_14:51:04.230003) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:05.760449 run osmo-stp_10.42.42.5(pid=3214): stderr: | 20221214145104423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145104423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145104423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145104424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145104424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145104424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145104424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:05.895719 run osmo-stp_10.42.42.5(pid=3214): stdout: | (launched: 2022-12-14_14:51:04.230003) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:06.023539 run osmo-stp_10.42.42.5(pid=3214): stderr: | 20221214145104423 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145104423 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145104423 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145104424 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145104424 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145104424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145104424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:06.176683 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3214): Process ended prematurely: osmo-stp_10.42.42.5(pid=3214) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3214)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 14:51:06.186481 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:51:06.214159 run osmo-hlr_10.42.42.2(pid=3211): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3211)] 14:51:06.263944 run osmo-hlr_10.42.42.2(pid=3211): stdout: | (launched: 2022-12-14_14:51:03.234611) 14:51:06.315647 run osmo-hlr_10.42.42.2(pid=3211): stderr: | 20221214145103432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145103433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145103433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145103433 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145103433 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145103433 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145103444 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145103454 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145103454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145103455 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:51:06.387114 run osmo-msc_10.42.42.6(pid=3217): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3217)] 14:51:06.436476 run osmo-msc_10.42.42.6(pid=3217): stdout: | (launched: 2022-12-14_14:51:05.252136) 14:51:06.487776 run osmo-msc_10.42.42.6(pid=3217): stderr: | 20221214145105575 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145105576 DLGLOBAL DEBUG validating counter group 0x7f5cc9685c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145105576 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145105576 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145105576 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145105576 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145105578 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145105578 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145105579 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145105579 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:51:06.539248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3210): Terminating (SIGTERM) 14:51:06.580650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3213): Terminating (SIGTERM) 14:51:06.622406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3216): Terminating (SIGTERM) 14:51:06.664103 --- ParallelTerminationStrategy: PID 3210 died... 14:51:06.684050 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3210): Terminated: ok {rc=0} 14:51:06.730212 --- ParallelTerminationStrategy: PID 3213 died... 14:51:06.749798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3213): Terminated: ok {rc=0} 14:51:06.795423 --- ParallelTerminationStrategy: PID 3216 died... 14:51:06.814975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3216): Terminated: ok {rc=0} 14:51:06.901549 bus /sierra_3: Setting Powered False 14:51:07.999417 bus /sierra_3: Setting Powered False 14:51:09.113175 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:51:10.362466 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:51:10.369962 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:51:10.404606 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 14:51:10.432136 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 14:51:10.486631 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:51:10.521287 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 14:51:10.548575 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 14:51:11.094649 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 14:51:11.143319 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:11.154441 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:51:11.224230 tst mo_mt_call.py: using LAC 41652 14:51:11.341333 tst mo_mt_call.py: using RAC 87 14:51:11.459244 tst mo_mt_call.py: using CellId 41652 14:51:11.587497 tst mo_mt_call.py: using BVCI 41653 14:51:11.704726 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:11.716284 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:11.727804 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:11.739259 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:11.751294 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:11.763248 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:51:11.879351 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:51:11.998509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:51:12.497800 run create_hlr_db(pid=3222): Launched 14:51:12.628829 bus /sierra_2: Setting Powered False 14:51:13.692823 run create_hlr_db(pid=3222): Terminated: ok {rc=0} 14:51:14.121659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3224): Launched 14:51:14.421976 run osmo-hlr_10.42.42.2(pid=3225): Launched 14:51:14.537649 run osmo-stp_10.42.42.5: Starting osmo-stp 14:51:15.071775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3227): Launched 14:51:15.373400 run osmo-stp_10.42.42.5(pid=3228): Launched 14:51:15.489202 run osmo-msc_10.42.42.6: Starting osmo-msc 14:51:16.059562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3230): Launched 14:51:16.391621 run osmo-msc_10.42.42.6(pid=3231): Launched 14:51:16.609540 run osmo-stp_10.42.42.5(pid=3228): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3228)] 14:51:16.765492 run osmo-stp_10.42.42.5(pid=3228): stdout: | (launched: 2022-12-14_14:51:15.318197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:17.156255 run osmo-stp_10.42.42.5(pid=3228): stderr: | 20221214145115489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145115489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145115489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145115490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145115490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145115490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145115490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:17.336421 run osmo-stp_10.42.42.5(pid=3228): stdout: | (launched: 2022-12-14_14:51:15.318197) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:17.468502 run osmo-stp_10.42.42.5(pid=3228): stderr: | 20221214145115489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145115489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145115489 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145115490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145115490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145115490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145115490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:17.621841 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3228): Process ended prematurely: osmo-stp_10.42.42.5(pid=3228) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3228)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 14:51:17.631338 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 14:51:17.659270 run osmo-hlr_10.42.42.2(pid=3225): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3225)] 14:51:17.709729 run osmo-hlr_10.42.42.2(pid=3225): stdout: | (launched: 2022-12-14_14:51:14.367285) 14:51:17.761997 run osmo-hlr_10.42.42.2(pid=3225): stderr: | 20221214145114543 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145114543 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145114543 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145114543 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145114543 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145114543 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145114555 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145114563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145114563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145114563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:51:17.834234 run osmo-msc_10.42.42.6(pid=3231): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3231)] 14:51:17.884349 run osmo-msc_10.42.42.6(pid=3231): stdout: | (launched: 2022-12-14_14:51:16.321906) 14:51:17.936120 run osmo-msc_10.42.42.6(pid=3231): stderr: | 20221214145116850 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145116850 DLGLOBAL DEBUG validating counter group 0x7f406faeec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145116850 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145116850 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145116851 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145116851 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145116854 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145116856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145116856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145116856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:51:17.988329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3224): Terminating (SIGTERM) 14:51:18.031018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3227): Terminating (SIGTERM) 14:51:18.073819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3230): Terminating (SIGTERM) 14:51:18.117317 --- ParallelTerminationStrategy: PID 3224 died... 14:51:18.137587 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3224): Terminated: ok {rc=0} 14:51:18.184154 --- ParallelTerminationStrategy: PID 3227 died... 14:51:18.205541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3227): Terminated: ok {rc=0} 14:51:18.251627 --- ParallelTerminationStrategy: PID 3230 died... 14:51:18.271372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3230): Terminated: ok {rc=0} 14:51:18.359381 bus /sierra_3: Setting Powered False 14:51:19.460151 bus /sierra_3: Setting Powered False 14:51:20.576836 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 14:51:21.726090 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:21.738441 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:51:21.812192 tst mo_mt_call_osmux.py: using LAC 41653 14:51:21.940354 tst mo_mt_call_osmux.py: using RAC 88 14:51:22.067678 tst mo_mt_call_osmux.py: using CellId 41653 14:51:22.193830 tst mo_mt_call_osmux.py: using BVCI 41654 14:51:22.311706 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:22.323432 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:22.334982 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:22.346603 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:22.358213 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:51:22.369500 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:51:22.488863 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:51:22.610105 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:51:23.073626 run create_hlr_db(pid=3233): Launched 14:51:23.190277 bus /sierra_2: Setting Powered False 14:51:24.249413 run create_hlr_db(pid=3233): Terminated: ok {rc=0} 14:51:24.688525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3235): Launched 14:51:25.009681 run osmo-hlr_10.42.42.2(pid=3236): Launched 14:51:25.132899 run osmo-stp_10.42.42.5: Starting osmo-stp 14:51:25.690062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3238): Launched 14:51:26.011869 run osmo-stp_10.42.42.5(pid=3239): Launched 14:51:26.135125 run osmo-msc_10.42.42.6: Starting osmo-msc 14:51:26.718114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3241): Launched 14:51:27.039824 run osmo-msc_10.42.42.6(pid=3242): Launched 14:51:27.219213 run osmo-stp_10.42.42.5(pid=3239): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3239)] 14:51:27.353954 run osmo-stp_10.42.42.5(pid=3239): stdout: | (launched: 2022-12-14_14:51:25.953916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:27.490064 run osmo-stp_10.42.42.5(pid=3239): stderr: | 20221214145126146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145126146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145126147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145126147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145126147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145126148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145126148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:27.625371 run osmo-stp_10.42.42.5(pid=3239): stdout: | (launched: 2022-12-14_14:51:25.953916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:27.753229 run osmo-stp_10.42.42.5(pid=3239): stderr: | 20221214145126146 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145126146 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145126147 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145126147 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145126147 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145126148 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145126148 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:27.906243 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3239): Process ended prematurely: osmo-stp_10.42.42.5(pid=3239) [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3239)] [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 14:51:27.915884 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:51:27.943921 run osmo-hlr_10.42.42.2(pid=3236): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3236)] 14:51:27.994351 run osmo-hlr_10.42.42.2(pid=3236): stdout: | (launched: 2022-12-14_14:51:24.951614) 14:51:28.046298 run osmo-hlr_10.42.42.2(pid=3236): stderr: | 20221214145125148 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145125148 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145125148 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145125148 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145125149 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145125149 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145125161 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145125169 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145125169 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145125169 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:51:28.118321 run osmo-msc_10.42.42.6(pid=3242): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3242)] 14:51:28.167956 run osmo-msc_10.42.42.6(pid=3242): stdout: | (launched: 2022-12-14_14:51:26.981454) 14:51:28.220021 run osmo-msc_10.42.42.6(pid=3242): stderr: | 20221214145127303 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145127303 DLGLOBAL DEBUG validating counter group 0x7fe618df3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145127303 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145127303 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145127303 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145127304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145127305 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145127306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145127306 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145127306 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:51:28.271496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3235): Terminating (SIGTERM) 14:51:28.312860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3238): Terminating (SIGTERM) 14:51:28.354675 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3241): Terminating (SIGTERM) 14:51:28.396415 --- ParallelTerminationStrategy: PID 3235 died... 14:51:28.416655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3235): Terminated: ok {rc=0} 14:51:28.463760 --- ParallelTerminationStrategy: PID 3238 died... 14:51:28.483435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3238): Terminated: ok {rc=0} 14:51:28.529376 --- ParallelTerminationStrategy: PID 3241 died... 14:51:28.549007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3241): Terminated: ok {rc=0} 14:51:28.637050 bus /sierra_3: Setting Powered False 14:51:29.734637 bus /sierra_3: Setting Powered False 14:51:30.865099 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 14:51:32.159733 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:51:32.165254 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 14:51:32.202525 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 14:51:32.231006 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 14:51:32.315663 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 14:51:32.350075 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 14:51:32.377330 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 14:51:32.964656 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2406 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 14:51:32.969837 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:32.980816 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:51:33.040740 tst emergency_mo_mt_call.py: using LAC 41654 14:51:33.170605 tst emergency_mo_mt_call.py: using RAC 89 14:51:33.293850 tst emergency_mo_mt_call.py: using CellId 41654 14:51:33.418368 tst emergency_mo_mt_call.py: using BVCI 41655 14:51:33.534474 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:33.545805 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:33.557502 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:33.568474 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:33.579628 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:33.590689 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:51:33.705010 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:51:33.818785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:51:34.274136 run create_hlr_db(pid=3248): Launched 14:51:34.388348 bus /sierra_2: Setting Powered False 14:51:35.447374 run create_hlr_db(pid=3248): Terminated: ok {rc=0} 14:51:35.860162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3250): Launched 14:51:36.155473 run osmo-hlr_10.42.42.2(pid=3251): Launched 14:51:36.269873 run osmo-stp_10.42.42.5: Starting osmo-stp 14:51:36.793152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3253): Launched 14:51:37.088233 run osmo-stp_10.42.42.5(pid=3254): Launched 14:51:37.211984 tst emergency_mo_mt_call.py: using MSISDN 8741 14:51:37.364311 run osmo-msc_10.42.42.6: Starting osmo-msc 14:51:37.895449 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3256): Launched 14:51:38.190346 run osmo-msc_10.42.42.6(pid=3257): Launched 14:51:38.355785 run osmo-stp_10.42.42.5(pid=3254): ERR: Terminated: ERROR {rc=1} [trial-2406↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3254)] 14:51:38.480698 run osmo-stp_10.42.42.5(pid=3254): stdout: | (launched: 2022-12-14_14:51:37.034381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:38.606289 run osmo-stp_10.42.42.5(pid=3254): stderr: | 20221214145137203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145137203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145137204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145137205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145137207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145137207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145137207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:38.729628 run osmo-stp_10.42.42.5(pid=3254): stdout: | (launched: 2022-12-14_14:51:37.034381) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:38.846682 run osmo-stp_10.42.42.5(pid=3254): stderr: | 20221214145137203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145137203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145137204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145137205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145137207 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145137207 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145137207 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:38.986652 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3254): Process ended prematurely: osmo-stp_10.42.42.5(pid=3254) [trial-2406↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3254)] [trial-2406↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 14:51:38.995096 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 14:51:39.021481 run osmo-hlr_10.42.42.2(pid=3251): ERR: Terminated: ERROR {rc=237} [trial-2406↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3251)] 14:51:39.069831 run osmo-hlr_10.42.42.2(pid=3251): stdout: | (launched: 2022-12-14_14:51:36.102055) 14:51:39.119765 run osmo-hlr_10.42.42.2(pid=3251): stderr: | 20221214145136275 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145136275 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145136275 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145136275 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145136275 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145136275 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145136287 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145136295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145136296 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145136296 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:51:39.189213 run osmo-msc_10.42.42.6(pid=3257): ERR: Terminated: ERROR {rc=2} [trial-2406↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3257)] 14:51:39.236821 run osmo-msc_10.42.42.6(pid=3257): stdout: | (launched: 2022-12-14_14:51:38.136245) 14:51:39.286429 run osmo-msc_10.42.42.6(pid=3257): stderr: | 20221214145138408 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145138408 DLGLOBAL DEBUG validating counter group 0x7f7cf396dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145138408 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145138408 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145138408 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145138409 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145138410 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145138411 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145138411 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145138411 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:51:39.336471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3250): Terminating (SIGTERM) 14:51:39.377017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3253): Terminating (SIGTERM) 14:51:39.417265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3256): Terminating (SIGTERM) 14:51:39.457615 --- ParallelTerminationStrategy: PID 3250 died... 14:51:39.476891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3250): Terminated: ok {rc=0} 14:51:39.521552 --- ParallelTerminationStrategy: PID 3253 died... 14:51:39.540345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3253): Terminated: ok {rc=0} 14:51:39.584748 --- ParallelTerminationStrategy: PID 3256 died... 14:51:39.603805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3256): Terminated: ok {rc=0} 14:51:39.687514 bus /sierra_3: Setting Powered False 14:51:40.786283 bus /sierra_3: Setting Powered False 14:51:41.902390 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 14:51:42.990228 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:43.002341 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:51:43.055039 tst emergency_preemptive_call.py: using LAC 41655 14:51:43.178882 tst emergency_preemptive_call.py: using RAC 90 14:51:43.302260 tst emergency_preemptive_call.py: using CellId 41655 14:51:43.426482 tst emergency_preemptive_call.py: using BVCI 41656 14:51:43.541718 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:43.553065 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:43.564251 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:43.575349 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:43.586473 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 14:51:43.597534 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:51:43.713712 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:51:43.834985 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:51:43.951758 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:51:44.064934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:51:44.523984 run create_hlr_db(pid=3259): Launched 14:51:44.639508 bus /sierra_2: Setting Powered False 14:51:45.698586 run create_hlr_db(pid=3259): Terminated: ok {rc=0} 14:51:46.185870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3261): Launched 14:51:46.501827 run osmo-hlr_10.42.42.2(pid=3262): Launched 14:51:46.719388 run osmo-stp_10.42.42.5: Starting osmo-stp 14:51:47.330379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3264): Launched 14:51:47.656861 run osmo-stp_10.42.42.5(pid=3265): Launched 14:51:47.789699 tst emergency_preemptive_call.py: using MSISDN 8742 14:51:47.951019 run osmo-msc_10.42.42.6: Starting osmo-msc 14:51:48.520770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3267): Launched 14:51:48.836470 run osmo-msc_10.42.42.6(pid=3268): Launched 14:51:49.013677 run osmo-stp_10.42.42.5(pid=3265): ERR: Terminated: ERROR {rc=1} [trial-2406↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3265)] 14:51:49.147461 run osmo-stp_10.42.42.5(pid=3265): stdout: | (launched: 2022-12-14_14:51:47.599330) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:49.281379 run osmo-stp_10.42.42.5(pid=3265): stderr: | 20221214145147790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145147790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145147790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145147790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145147791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145147791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145147791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:49.415433 run osmo-stp_10.42.42.5(pid=3265): stdout: | (launched: 2022-12-14_14:51:47.599330) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:51:49.541983 run osmo-stp_10.42.42.5(pid=3265): stderr: | 20221214145147790 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145147790 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145147790 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145147790 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145147791 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145147791 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145147791 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:51:49.692406 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3265): Process ended prematurely: osmo-stp_10.42.42.5(pid=3265) [trial-2406↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3265)] [trial-2406↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 14:51:49.701641 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 14:51:49.729407 run osmo-hlr_10.42.42.2(pid=3262): ERR: Terminated: ERROR {rc=237} [trial-2406↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3262)] 14:51:49.780356 run osmo-hlr_10.42.42.2(pid=3262): stdout: | (launched: 2022-12-14_14:51:46.435738) 14:51:49.833105 run osmo-hlr_10.42.42.2(pid=3262): stderr: | 20221214145146685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145146686 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145146686 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145146686 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145146686 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145146686 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145146703 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145146721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145146722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145146722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:51:49.906263 run osmo-msc_10.42.42.6(pid=3268): ERR: Terminated: ERROR {rc=2} [trial-2406↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3268)] 14:51:49.956318 run osmo-msc_10.42.42.6(pid=3268): stdout: | (launched: 2022-12-14_14:51:48.779264) 14:51:50.008196 run osmo-msc_10.42.42.6(pid=3268): stderr: | 20221214145149102 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145149103 DLGLOBAL DEBUG validating counter group 0x7f0bbeab5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145149103 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145149103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145149103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145149103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145149105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145149105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145149105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145149106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:51:50.060352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3261): Terminating (SIGTERM) 14:51:50.102524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3264): Terminating (SIGTERM) 14:51:50.144554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3267): Terminating (SIGTERM) 14:51:50.187103 --- ParallelTerminationStrategy: PID 3261 died... 14:51:50.207515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3261): Terminated: ok {rc=0} 14:51:50.253938 --- ParallelTerminationStrategy: PID 3264 died... 14:51:50.273776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3264): Terminated: ok {rc=0} 14:51:50.320066 --- ParallelTerminationStrategy: PID 3267 died... 14:51:50.339869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3267): Terminated: ok {rc=0} 14:51:50.428321 bus /sierra_9: Setting Powered False 14:51:51.527278 bus /sierra_9: Setting Powered False 14:51:52.644628 bus /sierra_8: Setting Powered False 14:51:53.742519 bus /sierra_8: Setting Powered False 14:51:54.857975 bus /sierra_3: Setting Powered False 14:51:55.956218 bus /sierra_3: Setting Powered False 14:51:57.070631 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 14:51:58.349095 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:51:58.353575 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 14:51:58.386178 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 14:51:58.425234 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 14:51:58.510140 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 14:51:58.542691 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 14:51:58.580394 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 14:51:59.171458 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 14:51:59.220272 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:51:59.231264 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:51:59.279806 tst cs_paging_gprs_active.py: using LAC 41656 14:51:59.399730 tst cs_paging_gprs_active.py: using RAC 91 14:51:59.527913 tst cs_paging_gprs_active.py: using CellId 41656 14:51:59.654262 tst cs_paging_gprs_active.py: using BVCI 41657 14:51:59.773181 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:51:59.784547 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:51:59.795691 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:51:59.806866 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:51:59.818211 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:51:59.829506 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:51:59.841038 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:51:59.852181 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:51:59.863608 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:51:59.980580 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:52:00.099103 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:52:00.316752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:52:00.640754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3273): Launched 14:52:00.931734 run iperf3-srv_10.42.42.10(pid=3274): Launched 14:52:01.099998 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:52:01.375714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:52:01.710488 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3275): Launched 14:52:02.010333 run iperf3-srv_10.42.42.10(pid=3276): Launched 14:52:02.146550 tst cs_paging_gprs_active.py:38: start network... 14:52:02.363955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:52:02.864850 run create_hlr_db(pid=3277): Launched 14:52:02.996560 bus /sierra_2: Setting Powered False 14:52:04.059913 run create_hlr_db(pid=3277): Terminated: ok {rc=0} 14:52:04.508802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3279): Launched 14:52:04.830988 run osmo-hlr_10.42.42.2(pid=3280): Launched 14:52:04.954196 run osmo-stp_10.42.42.5: Starting osmo-stp 14:52:05.507308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3282): Launched 14:52:05.829726 run osmo-stp_10.42.42.5(pid=3283): Launched 14:52:05.953077 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:52:06.509309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3285): Launched 14:52:06.633930 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:52:06.905985 run patchelf(pid=3286): Launched 14:52:07.087143 run osmo-stp_10.42.42.5(pid=3283): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3283)] 14:52:07.223592 run osmo-stp_10.42.42.5(pid=3283): stdout: | (launched: 2022-12-14_14:52:05.771308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:07.361481 run osmo-stp_10.42.42.5(pid=3283): stderr: | 20221214145205964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145205964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145205965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145205965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145205966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145205966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145205966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:07.499887 run osmo-stp_10.42.42.5(pid=3283): stdout: | (launched: 2022-12-14_14:52:05.771308) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:07.632329 run osmo-stp_10.42.42.5(pid=3283): stderr: | 20221214145205964 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145205964 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145205965 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145205965 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145205966 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145205966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145205966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:07.788728 run patchelf(pid=3286): Terminating (SIGINT) 14:52:07.969872 run patchelf(pid=3286): Terminated: ok {rc=0} 14:52:08.099956 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3283): Process ended prematurely: osmo-stp_10.42.42.5(pid=3283) [trial-2406↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3283)] [trial-2406↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 14:52:08.110153 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 14:52:08.138517 run osmo-hlr_10.42.42.2(pid=3280): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3280)] 14:52:08.188428 run osmo-hlr_10.42.42.2(pid=3280): stdout: | (launched: 2022-12-14_14:52:04.772550) 14:52:08.240223 run osmo-hlr_10.42.42.2(pid=3280): stderr: | 20221214145204968 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145204968 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145204968 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145204969 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145204969 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145204969 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145204981 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145204989 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145204990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145204990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:52:08.292382 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3273): Terminating (SIGTERM) 14:52:08.334235 run iperf3-srv_10.42.42.10(pid=3274): Terminating (SIGTERM) 14:52:08.376260 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3275): Terminating (SIGTERM) 14:52:08.418605 run iperf3-srv_10.42.42.10(pid=3276): Terminating (SIGTERM) 14:52:08.460344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3279): Terminating (SIGTERM) 14:52:08.502950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3282): Terminating (SIGTERM) 14:52:08.545136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3285): Terminating (SIGTERM) 14:52:08.587397 --- ParallelTerminationStrategy: PID 3273 died... 14:52:08.607358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3273): Terminated: ok {rc=0} 14:52:08.653524 --- ParallelTerminationStrategy: PID 3274 died... 14:52:08.672911 run iperf3-srv_10.42.42.10(pid=3274): Terminated {rc=256} 14:52:08.718513 --- ParallelTerminationStrategy: PID 3275 died... 14:52:08.738127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3275): Terminated: ok {rc=0} 14:52:08.783793 --- ParallelTerminationStrategy: PID 3276 died... 14:52:08.803241 run iperf3-srv_10.42.42.10(pid=3276): Terminated {rc=256} 14:52:08.848809 --- ParallelTerminationStrategy: PID 3279 died... 14:52:08.868759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3279): Terminated: ok {rc=0} 14:52:08.914359 --- ParallelTerminationStrategy: PID 3282 died... 14:52:08.933854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3282): Terminated: ok {rc=0} 14:52:08.979690 --- ParallelTerminationStrategy: PID 3285 died... 14:52:08.999360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3285): Terminated: ok {rc=0} 14:52:09.088886 bus /gobi_0: Setting Powered False 14:52:10.188108 bus /gobi_0: Setting Powered False 14:52:11.306197 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 14:52:12.451789 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:12.463020 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:52:12.514912 tst iperf3.py: using LAC 41657 14:52:12.634533 tst iperf3.py: using RAC 92 14:52:12.754787 tst iperf3.py: using CellId 41657 14:52:12.871887 tst iperf3.py: using BVCI 41658 14:52:12.982104 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:12.992724 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:13.003187 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:13.013653 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:13.023980 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:13.034576 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:13.045681 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:13.056201 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:13.067057 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:52:13.181891 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:52:13.384200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:52:13.686429 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3287): Launched 14:52:13.949044 run iperf3-srv_10.42.42.10(pid=3288): Launched 14:52:14.063278 tst iperf3.py:8: start network... 14:52:14.264469 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:52:14.732448 run create_hlr_db(pid=3289): Launched 14:52:14.849114 bus /gobi_6: Setting Powered False 14:52:15.922436 run create_hlr_db(pid=3289): Terminated: ok {rc=0} 14:52:16.386788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3291): Launched 14:52:16.734084 run osmo-hlr_10.42.42.2(pid=3292): Launched 14:52:16.950718 run osmo-stp_10.42.42.5: Starting osmo-stp 14:52:17.559348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3294): Launched 14:52:17.882570 run osmo-stp_10.42.42.5(pid=3295): Launched 14:52:18.006078 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:52:18.563430 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3297): Launched 14:52:18.689310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:52:18.962029 run patchelf(pid=3298): Launched 14:52:19.143131 run osmo-stp_10.42.42.5(pid=3295): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3295)] 14:52:19.280004 run osmo-stp_10.42.42.5(pid=3295): stdout: | (launched: 2022-12-14_14:52:17.824057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:19.418183 run osmo-stp_10.42.42.5(pid=3295): stderr: | 20221214145218015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145218015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145218016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145218016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145218017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145218017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145218017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:19.556484 run osmo-stp_10.42.42.5(pid=3295): stdout: | (launched: 2022-12-14_14:52:17.824057) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:19.689935 run osmo-stp_10.42.42.5(pid=3295): stderr: | 20221214145218015 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145218015 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145218016 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145218016 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145218017 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145218017 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145218017 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:19.846980 run patchelf(pid=3298): Terminating (SIGINT) 14:52:20.027960 run patchelf(pid=3298): Terminated: ok {rc=0} 14:52:20.158686 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3295): Process ended prematurely: osmo-stp_10.42.42.5(pid=3295) [trial-2406↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3295)] [trial-2406↪gprs:trx-sysmocell5000↪iperf3.py:8] 14:52:20.168708 tst iperf3.py:8: Test FAILED (7.8 sec) 14:52:20.197662 run osmo-hlr_10.42.42.2(pid=3292): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3292)] 14:52:20.248189 run osmo-hlr_10.42.42.2(pid=3292): stdout: | (launched: 2022-12-14_14:52:16.671625) 14:52:20.300491 run osmo-hlr_10.42.42.2(pid=3292): stderr: | 20221214145216933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145216933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145216933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145216933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145216933 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145216933 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145216949 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145216966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145216967 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145216967 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:52:20.353326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3287): Terminating (SIGTERM) 14:52:20.395457 run iperf3-srv_10.42.42.10(pid=3288): Terminating (SIGTERM) 14:52:20.437653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3291): Terminating (SIGTERM) 14:52:20.479887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3294): Terminating (SIGTERM) 14:52:20.522225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3297): Terminating (SIGTERM) 14:52:20.565345 --- ParallelTerminationStrategy: PID 3287 died... 14:52:20.585576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3287): Terminated: ok {rc=0} 14:52:20.632416 --- ParallelTerminationStrategy: PID 3288 died... 14:52:20.652102 run iperf3-srv_10.42.42.10(pid=3288): Terminated {rc=256} 14:52:20.698895 --- ParallelTerminationStrategy: PID 3291 died... 14:52:20.718544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3291): Terminated: ok {rc=0} 14:52:20.764535 --- ParallelTerminationStrategy: PID 3294 died... 14:52:20.784286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3294): Terminated: ok {rc=0} 14:52:20.830727 --- ParallelTerminationStrategy: PID 3297 died... 14:52:20.850425 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3297): Terminated: ok {rc=0} 14:52:20.938528 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 14:52:22.085057 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:22.096420 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:52:22.145779 tst iperf3m4.py: using LAC 41658 14:52:22.273716 tst iperf3m4.py: using RAC 93 14:52:22.398898 tst iperf3m4.py: using CellId 41658 14:52:22.527044 tst iperf3m4.py: using BVCI 41659 14:52:22.645999 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:22.657323 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:22.668102 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:22.679033 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:22.689993 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:22.700874 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:22.712130 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:22.723123 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:22.734230 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:52:22.850246 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:52:22.970810 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:52:23.087639 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:52:23.207201 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:52:23.425100 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:52:23.749300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3299): Launched 14:52:24.031402 run iperf3-srv_10.42.42.10(pid=3300): Launched 14:52:24.153303 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:52:24.370924 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:52:24.696837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3301): Launched 14:52:24.978917 run iperf3-srv_10.42.42.10(pid=3302): Launched 14:52:25.100459 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:52:25.317950 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:52:25.642524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3303): Launched 14:52:25.923697 run iperf3-srv_10.42.42.10(pid=3304): Launched 14:52:26.046021 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:52:26.263255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:52:26.588029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3305): Launched 14:52:26.869759 run iperf3-srv_10.42.42.10(pid=3306): Launched 14:52:26.991306 tst iperf3m4.py:8: start network... 14:52:27.208203 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:52:27.708895 run create_hlr_db(pid=3307): Launched 14:52:27.840703 bus /gobi_6: Setting Powered False 14:52:28.904377 run create_hlr_db(pid=3307): Terminated: ok {rc=0} 14:52:29.335332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3309): Launched 14:52:29.660734 run osmo-hlr_10.42.42.2(pid=3310): Launched 14:52:29.783450 run osmo-stp_10.42.42.5: Starting osmo-stp 14:52:30.343359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3312): Launched 14:52:30.666869 run osmo-stp_10.42.42.5(pid=3313): Launched 14:52:30.792023 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:52:31.397768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3315): Launched 14:52:31.529637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:52:31.812084 run patchelf(pid=3316): Launched 14:52:32.007709 run osmo-stp_10.42.42.5(pid=3313): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3313)] 14:52:32.147069 run osmo-stp_10.42.42.5(pid=3313): stdout: | (launched: 2022-12-14_14:52:30.607826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:32.285590 run osmo-stp_10.42.42.5(pid=3313): stderr: | 20221214145230799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145230799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145230800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145230800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145230801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145230801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145230801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:32.423810 run osmo-stp_10.42.42.5(pid=3313): stdout: | (launched: 2022-12-14_14:52:30.607826) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:32.556354 run osmo-stp_10.42.42.5(pid=3313): stderr: | 20221214145230799 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145230799 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145230800 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145230800 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145230801 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145230801 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145230801 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:32.712845 run patchelf(pid=3316): Terminating (SIGINT) 14:52:32.893596 run patchelf(pid=3316): Terminated: ok {rc=0} 14:52:33.023926 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3313): Process ended prematurely: osmo-stp_10.42.42.5(pid=3313) [trial-2406↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3313)] [trial-2406↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 14:52:33.034173 tst iperf3m4.py:8: Test FAILED (11.0 sec) 14:52:33.062797 run osmo-hlr_10.42.42.2(pid=3310): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3310)] 14:52:33.112333 run osmo-hlr_10.42.42.2(pid=3310): stdout: | (launched: 2022-12-14_14:52:29.602207) 14:52:33.163539 run osmo-hlr_10.42.42.2(pid=3310): stderr: | 20221214145229801 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145229801 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145229801 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145229801 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145229801 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145229801 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145229814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145229822 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145229822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145229822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:52:33.215705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3299): Terminating (SIGTERM) 14:52:33.257347 run iperf3-srv_10.42.42.10(pid=3300): Terminating (SIGTERM) 14:52:33.299014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3301): Terminating (SIGTERM) 14:52:33.340837 run iperf3-srv_10.42.42.10(pid=3302): Terminating (SIGTERM) 14:52:33.382252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3303): Terminating (SIGTERM) 14:52:33.423746 run iperf3-srv_10.42.42.10(pid=3304): Terminating (SIGTERM) 14:52:33.465204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3305): Terminating (SIGTERM) 14:52:33.507493 run iperf3-srv_10.42.42.10(pid=3306): Terminating (SIGTERM) 14:52:33.549091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3309): Terminating (SIGTERM) 14:52:33.590571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3312): Terminating (SIGTERM) 14:52:33.632080 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3315): Terminating (SIGTERM) 14:52:33.673921 --- ParallelTerminationStrategy: PID 3299 died... 14:52:33.693905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3299): Terminated: ok {rc=0} 14:52:33.739617 --- ParallelTerminationStrategy: PID 3300 died... 14:52:33.759359 run iperf3-srv_10.42.42.10(pid=3300): Terminated {rc=256} 14:52:33.804595 --- ParallelTerminationStrategy: PID 3301 died... 14:52:33.824061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3301): Terminated: ok {rc=0} 14:52:33.869461 --- ParallelTerminationStrategy: PID 3302 died... 14:52:33.888624 run iperf3-srv_10.42.42.10(pid=3302): Terminated {rc=256} 14:52:33.934019 --- ParallelTerminationStrategy: PID 3303 died... 14:52:33.953394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3303): Terminated: ok {rc=0} 14:52:33.998591 --- ParallelTerminationStrategy: PID 3304 died... 14:52:34.018012 run iperf3-srv_10.42.42.10(pid=3304): Terminated {rc=256} 14:52:34.063463 --- ParallelTerminationStrategy: PID 3305 died... 14:52:34.082832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3305): Terminated: ok {rc=0} 14:52:34.128404 --- ParallelTerminationStrategy: PID 3306 died... 14:52:34.147941 run iperf3-srv_10.42.42.10(pid=3306): Terminated {rc=256} 14:52:34.193340 --- ParallelTerminationStrategy: PID 3309 died... 14:52:34.212839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3309): Terminated: ok {rc=0} 14:52:34.258572 --- ParallelTerminationStrategy: PID 3312 died... 14:52:34.278065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3312): Terminated: ok {rc=0} 14:52:34.323720 --- ParallelTerminationStrategy: PID 3315 died... 14:52:34.343323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3315): Terminated: ok {rc=0} 14:52:34.430665 bus /gobi_4: Setting Powered False 14:52:35.529273 bus /gobi_4: Setting Powered False 14:52:36.643391 bus /gobi_1: Setting Powered False 14:52:37.741727 bus /gobi_1: Setting Powered False 14:52:38.856405 bus /gobi_0: Setting Powered False 14:52:39.955014 bus /gobi_0: Setting Powered False 14:52:41.072530 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 14:52:42.175484 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:42.187440 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:52:42.239092 tst ping.py: using LAC 41659 14:52:42.364833 tst ping.py: using RAC 94 14:52:42.490265 tst ping.py: using CellId 41659 14:52:42.616810 tst ping.py: using BVCI 41660 14:52:42.731719 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:42.742927 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:42.754059 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:42.765250 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:42.776539 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:42.787933 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:42.799193 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:42.810407 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:52:42.926286 tst ping.py:19: start network... 14:52:43.123979 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:52:43.579033 run create_hlr_db(pid=3317): Launched 14:52:43.693297 bus /gobi_6: Setting Powered False 14:52:44.752018 run create_hlr_db(pid=3317): Terminated: ok {rc=0} 14:52:45.186696 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3319): Launched 14:52:45.486788 run osmo-hlr_10.42.42.2(pid=3320): Launched 14:52:45.599527 run osmo-stp_10.42.42.5: Starting osmo-stp 14:52:46.175931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3322): Launched 14:52:46.505751 run osmo-stp_10.42.42.5(pid=3323): Launched 14:52:46.740215 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:52:47.349197 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3325): Launched 14:52:47.463273 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:52:47.713371 run patchelf(pid=3326): Launched 14:52:47.879786 run osmo-stp_10.42.42.5(pid=3323): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3323)] 14:52:48.005745 run osmo-stp_10.42.42.5(pid=3323): stdout: | (launched: 2022-12-14_14:52:46.432061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:48.133100 run osmo-stp_10.42.42.5(pid=3323): stderr: | 20221214145246764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145246764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145246764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145246769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145246770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145246770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145246770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:48.260246 run osmo-stp_10.42.42.5(pid=3323): stdout: | (launched: 2022-12-14_14:52:46.432061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:48.381368 run osmo-stp_10.42.42.5(pid=3323): stderr: | 20221214145246764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145246764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145246764 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145246769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145246770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145246770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145246770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:48.525664 run patchelf(pid=3326): Terminating (SIGINT) 14:52:48.692078 run patchelf(pid=3326): Terminated: ok {rc=0} 14:52:48.812745 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3323): Process ended prematurely: osmo-stp_10.42.42.5(pid=3323) [trial-2406↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3323)] [trial-2406↪gprs:trx-sysmocell5000↪ping.py:22] 14:52:48.821573 tst ping.py:22: Test FAILED (6.6 sec) 14:52:48.848673 run osmo-hlr_10.42.42.2(pid=3320): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3320)] 14:52:48.897238 run osmo-hlr_10.42.42.2(pid=3320): stdout: | (launched: 2022-12-14_14:52:45.433140) 14:52:48.947189 run osmo-hlr_10.42.42.2(pid=3320): stderr: | 20221214145245608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145245608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145245608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145245608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145245608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145245608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145245620 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145245628 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145245629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145245629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:52:48.997597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3319): Terminating (SIGTERM) 14:52:49.038292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3322): Terminating (SIGTERM) 14:52:49.079240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3325): Terminating (SIGTERM) 14:52:49.120464 --- ParallelTerminationStrategy: PID 3319 died... 14:52:49.139926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3319): Terminated: ok {rc=0} 14:52:49.184321 --- ParallelTerminationStrategy: PID 3322 died... 14:52:49.203463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3322): Terminated: ok {rc=0} 14:52:49.247707 --- ParallelTerminationStrategy: PID 3325 died... 14:52:49.266774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3325): Terminated: ok {rc=0} 14:52:49.351454 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 14:52:50.436064 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:50.447573 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 14:52:50.498189 tst ping_idle_ping.py: using LAC 41660 14:52:50.617676 tst ping_idle_ping.py: using RAC 95 14:52:50.743676 tst ping_idle_ping.py: using CellId 41660 14:52:50.870555 tst ping_idle_ping.py: using BVCI 41661 14:52:50.986942 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:50.998338 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:51.009578 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:51.020656 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:51.031833 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:51.042946 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:51.054245 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 14:52:51.065320 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 14:52:51.182964 tst ping_idle_ping.py:24: start network... 14:52:51.397547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:52:51.891511 run create_hlr_db(pid=3327): Launched 14:52:52.021067 bus /gobi_6: Setting Powered False 14:52:53.084671 run create_hlr_db(pid=3327): Terminated: ok {rc=0} 14:52:53.529892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3329): Launched 14:52:53.828562 run osmo-hlr_10.42.42.2(pid=3330): Launched 14:52:53.943115 run osmo-stp_10.42.42.5: Starting osmo-stp 14:52:54.467643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3332): Launched 14:52:54.765403 run osmo-stp_10.42.42.5(pid=3333): Launched 14:52:54.879897 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:52:55.392786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3335): Launched 14:52:55.507448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:52:55.758543 run patchelf(pid=3336): Launched 14:52:55.924585 run osmo-stp_10.42.42.5(pid=3333): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3333)] 14:52:56.050979 run osmo-stp_10.42.42.5(pid=3333): stdout: | (launched: 2022-12-14_14:52:54.710960) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:56.178417 run osmo-stp_10.42.42.5(pid=3333): stderr: | 20221214145254881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145254881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145254881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145254882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145254884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145254884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145254884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:56.305553 run osmo-stp_10.42.42.5(pid=3333): stdout: | (launched: 2022-12-14_14:52:54.710960) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:52:56.426806 run osmo-stp_10.42.42.5(pid=3333): stderr: | 20221214145254881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145254881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145254881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145254882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145254884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145254884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145254884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:52:56.570589 run patchelf(pid=3336): Terminating (SIGINT) 14:52:56.738143 run patchelf(pid=3336): Terminated: ok {rc=0} 14:52:56.858767 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3333): Process ended prematurely: osmo-stp_10.42.42.5(pid=3333) [trial-2406↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3333)] [trial-2406↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 14:52:56.867434 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 14:52:56.894715 run osmo-hlr_10.42.42.2(pid=3330): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3330)] 14:52:56.943210 run osmo-hlr_10.42.42.2(pid=3330): stdout: | (launched: 2022-12-14_14:52:53.774239) 14:52:56.993312 run osmo-hlr_10.42.42.2(pid=3330): stderr: | 20221214145253949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145253949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145253949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145253949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145253949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145253949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145253962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145253970 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145253970 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145253970 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:52:57.043993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3329): Terminating (SIGTERM) 14:52:57.084640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3332): Terminating (SIGTERM) 14:52:57.125383 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3335): Terminating (SIGTERM) 14:52:57.166915 --- ParallelTerminationStrategy: PID 3329 died... 14:52:57.186334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3329): Terminated: ok {rc=0} 14:52:57.230928 --- ParallelTerminationStrategy: PID 3332 died... 14:52:57.249994 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3332): Terminated: ok {rc=0} 14:52:57.294215 --- ParallelTerminationStrategy: PID 3335 died... 14:52:57.313315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3335): Terminated: ok {rc=0} 14:52:57.397230 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 14:52:58.712714 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:52:58.718673 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 14:52:58.753000 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 14:52:58.792333 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 14:52:58.880341 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 14:52:58.914863 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 14:52:58.953952 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 14:52:59.549901 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 14:52:59.601437 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:52:59.612685 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:52:59.664795 tst cs_paging_gprs_active.py: using LAC 41661 14:52:59.785263 tst cs_paging_gprs_active.py: using RAC 96 14:52:59.904847 tst cs_paging_gprs_active.py: using CellId 41661 14:53:00.032195 tst cs_paging_gprs_active.py: using BVCI 41662 14:53:00.143268 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:00.154504 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:00.165289 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:00.175995 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:00.187145 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:00.198343 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:00.209791 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:00.220783 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:00.231992 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:53:00.350996 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:53:00.467792 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:53:00.670428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:53:00.999409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3341): Launched 14:53:01.272050 run iperf3-srv_10.42.42.10(pid=3342): Launched 14:53:01.402965 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:53:01.607811 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:53:01.922082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3343): Launched 14:53:02.209719 run iperf3-srv_10.42.42.10(pid=3344): Launched 14:53:02.330653 tst cs_paging_gprs_active.py:38: start network... 14:53:02.533154 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:53:03.002614 run create_hlr_db(pid=3345): Launched 14:53:03.119356 bus /gobi_6: Setting Powered False 14:53:04.178888 run create_hlr_db(pid=3345): Terminated: ok {rc=0} 14:53:04.600291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3347): Launched 14:53:04.903845 run osmo-hlr_10.42.42.2(pid=3348): Launched 14:53:05.020343 run osmo-stp_10.42.42.5: Starting osmo-stp 14:53:05.543317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3350): Launched 14:53:05.846601 run osmo-stp_10.42.42.5(pid=3351): Launched 14:53:05.962573 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:53:06.481793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3353): Launched 14:53:06.598625 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:53:06.853171 run patchelf(pid=3354): Launched 14:53:07.023747 run osmo-stp_10.42.42.5(pid=3351): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3351)] 14:53:07.151785 run osmo-stp_10.42.42.5(pid=3351): stdout: | (launched: 2022-12-14_14:53:05.791279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:07.281525 run osmo-stp_10.42.42.5(pid=3351): stderr: | 20221214145305961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145305961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145305961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145305962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145305962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145305962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145305962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:07.410711 run osmo-stp_10.42.42.5(pid=3351): stdout: | (launched: 2022-12-14_14:53:05.791279) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:07.535090 run osmo-stp_10.42.42.5(pid=3351): stderr: | 20221214145305961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145305961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145305961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145305962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145305962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145305962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145305962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:07.682380 run patchelf(pid=3354): Terminating (SIGINT) 14:53:07.852155 run patchelf(pid=3354): Terminated: ok {rc=0} 14:53:07.974631 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3351): Process ended prematurely: osmo-stp_10.42.42.5(pid=3351) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3351)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 14:53:07.983963 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 14:53:08.011036 run osmo-hlr_10.42.42.2(pid=3348): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3348)] 14:53:08.059785 run osmo-hlr_10.42.42.2(pid=3348): stdout: | (launched: 2022-12-14_14:53:04.848516) 14:53:08.109513 run osmo-hlr_10.42.42.2(pid=3348): stderr: | 20221214145305024 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145305024 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145305024 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145305024 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145305024 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145305024 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145305037 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145305045 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145305045 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145305045 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:53:08.159380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3341): Terminating (SIGTERM) 14:53:08.200093 run iperf3-srv_10.42.42.10(pid=3342): Terminating (SIGTERM) 14:53:08.240526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3343): Terminating (SIGTERM) 14:53:08.281299 run iperf3-srv_10.42.42.10(pid=3344): Terminating (SIGTERM) 14:53:08.321605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3347): Terminating (SIGTERM) 14:53:08.361997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3350): Terminating (SIGTERM) 14:53:08.402325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3353): Terminating (SIGTERM) 14:53:08.442523 --- ParallelTerminationStrategy: PID 3341 died... 14:53:08.462086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3341): Terminated: ok {rc=0} 14:53:08.506392 --- ParallelTerminationStrategy: PID 3342 died... 14:53:08.525590 run iperf3-srv_10.42.42.10(pid=3342): Terminated {rc=256} 14:53:08.569992 --- ParallelTerminationStrategy: PID 3343 died... 14:53:08.589383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3343): Terminated: ok {rc=0} 14:53:08.633718 --- ParallelTerminationStrategy: PID 3344 died... 14:53:08.652780 run iperf3-srv_10.42.42.10(pid=3344): Terminated {rc=256} 14:53:08.696669 --- ParallelTerminationStrategy: PID 3347 died... 14:53:08.715779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3347): Terminated: ok {rc=0} 14:53:08.759910 --- ParallelTerminationStrategy: PID 3350 died... 14:53:08.779075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3350): Terminated: ok {rc=0} 14:53:08.823223 --- ParallelTerminationStrategy: PID 3353 died... 14:53:08.842409 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3353): Terminated: ok {rc=0} 14:53:08.929498 bus /gobi_0: Setting Powered False 14:53:10.028533 bus /gobi_0: Setting Powered False 14:53:11.144283 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 14:53:12.289288 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:12.300919 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:53:12.355018 tst iperf3.py: using LAC 41662 14:53:12.477242 tst iperf3.py: using RAC 97 14:53:12.594050 tst iperf3.py: using CellId 41662 14:53:12.710542 tst iperf3.py: using BVCI 41663 14:53:12.818690 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:12.829634 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:12.840277 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:12.850972 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:12.861905 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:12.872813 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:12.883818 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:12.894623 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:12.905876 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:53:13.024925 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:53:13.241934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:53:13.565095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3355): Launched 14:53:13.846190 run iperf3-srv_10.42.42.10(pid=3356): Launched 14:53:13.967941 tst iperf3.py:8: start network... 14:53:14.176463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:53:14.643862 run create_hlr_db(pid=3357): Launched 14:53:14.759140 bus /gobi_6: Setting Powered False 14:53:15.819035 run create_hlr_db(pid=3357): Terminated: ok {rc=0} 14:53:16.283409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3359): Launched 14:53:16.608279 run osmo-hlr_10.42.42.2(pid=3360): Launched 14:53:16.853549 run osmo-stp_10.42.42.5: Starting osmo-stp 14:53:17.450963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3362): Launched 14:53:17.752122 run osmo-stp_10.42.42.5(pid=3363): Launched 14:53:17.867497 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:53:18.386505 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3365): Launched 14:53:18.503142 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:53:18.758836 run patchelf(pid=3366): Launched 14:53:18.927953 run osmo-stp_10.42.42.5(pid=3363): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3363)] 14:53:19.057208 run osmo-stp_10.42.42.5(pid=3363): stdout: | (launched: 2022-12-14_14:53:17.697212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:19.186714 run osmo-stp_10.42.42.5(pid=3363): stderr: | 20221214145317867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145317867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145317867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145317868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145317870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145317870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145317870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:19.316181 run osmo-stp_10.42.42.5(pid=3363): stdout: | (launched: 2022-12-14_14:53:17.697212) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:19.439789 run osmo-stp_10.42.42.5(pid=3363): stderr: | 20221214145317867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145317867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145317867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145317868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145317870 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145317870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145317870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:19.586682 run patchelf(pid=3366): Terminating (SIGINT) 14:53:19.755949 run patchelf(pid=3366): Terminated: ok {rc=0} 14:53:19.878501 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3363): Process ended prematurely: osmo-stp_10.42.42.5(pid=3363) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3363)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 14:53:19.887946 tst iperf3.py:8: Test FAILED (7.6 sec) 14:53:19.914973 run osmo-hlr_10.42.42.2(pid=3360): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3360)] 14:53:19.963105 run osmo-hlr_10.42.42.2(pid=3360): stdout: | (launched: 2022-12-14_14:53:16.542949) 14:53:20.013044 run osmo-hlr_10.42.42.2(pid=3360): stderr: | 20221214145316879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145316879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145316879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145316879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145316879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145316879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145316902 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145316910 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145316910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145316910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:53:20.063140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3355): Terminating (SIGTERM) 14:53:20.103298 run iperf3-srv_10.42.42.10(pid=3356): Terminating (SIGTERM) 14:53:20.143609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3359): Terminating (SIGTERM) 14:53:20.183946 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3362): Terminating (SIGTERM) 14:53:20.224096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3365): Terminating (SIGTERM) 14:53:20.264727 --- ParallelTerminationStrategy: PID 3355 died... 14:53:20.284360 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3355): Terminated: ok {rc=0} 14:53:20.328898 --- ParallelTerminationStrategy: PID 3356 died... 14:53:20.348479 run iperf3-srv_10.42.42.10(pid=3356): Terminated {rc=256} 14:53:20.392718 --- ParallelTerminationStrategy: PID 3359 died... 14:53:20.411974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3359): Terminated: ok {rc=0} 14:53:20.456320 --- ParallelTerminationStrategy: PID 3362 died... 14:53:20.475532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3362): Terminated: ok {rc=0} 14:53:20.519747 --- ParallelTerminationStrategy: PID 3365 died... 14:53:20.538936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3365): Terminated: ok {rc=0} 14:53:20.625428 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 14:53:21.772539 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:21.784342 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:53:21.835885 tst iperf3m4.py: using LAC 41663 14:53:21.955456 tst iperf3m4.py: using RAC 98 14:53:22.074730 tst iperf3m4.py: using CellId 41663 14:53:22.197721 tst iperf3m4.py: using BVCI 41664 14:53:22.308751 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:22.319850 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:22.330649 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:22.341343 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:22.352486 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:22.363680 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:22.374965 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:22.386148 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:22.397463 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:53:22.519594 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:53:22.639909 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:53:22.757642 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:53:22.877939 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:53:23.079626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:53:23.382438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3367): Launched 14:53:23.647546 run iperf3-srv_10.42.42.10(pid=3368): Launched 14:53:23.762016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:53:23.964035 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:53:24.267215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3369): Launched 14:53:24.531809 run iperf3-srv_10.42.42.10(pid=3370): Launched 14:53:24.646415 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:53:24.848586 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:53:25.152598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3371): Launched 14:53:25.418159 run iperf3-srv_10.42.42.10(pid=3372): Launched 14:53:25.532514 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:53:25.734731 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:53:26.038150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3373): Launched 14:53:26.302665 run iperf3-srv_10.42.42.10(pid=3374): Launched 14:53:26.416593 tst iperf3m4.py:8: start network... 14:53:26.618747 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:53:27.086346 run create_hlr_db(pid=3375): Launched 14:53:27.202936 bus /gobi_6: Setting Powered False 14:53:28.263294 run create_hlr_db(pid=3375): Terminated: ok {rc=0} 14:53:28.684659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3377): Launched 14:53:28.987670 run osmo-hlr_10.42.42.2(pid=3378): Launched 14:53:29.103914 run osmo-stp_10.42.42.5: Starting osmo-stp 14:53:29.625099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3380): Launched 14:53:29.929394 run osmo-stp_10.42.42.5(pid=3381): Launched 14:53:30.045795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:53:30.568341 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3383): Launched 14:53:30.685678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:53:30.946460 run patchelf(pid=3384): Launched 14:53:31.149750 run osmo-stp_10.42.42.5(pid=3381): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3381)] 14:53:31.292725 run osmo-stp_10.42.42.5(pid=3381): stdout: | (launched: 2022-12-14_14:53:29.873921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:31.439470 run osmo-stp_10.42.42.5(pid=3381): stderr: | 20221214145330043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145330043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145330043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145330043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145330044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145330044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145330044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:31.583424 run osmo-stp_10.42.42.5(pid=3381): stdout: | (launched: 2022-12-14_14:53:29.873921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:31.720681 run osmo-stp_10.42.42.5(pid=3381): stderr: | 20221214145330043 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145330043 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145330043 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145330043 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145330044 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145330044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145330044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:31.885330 run patchelf(pid=3384): Terminating (SIGINT) 14:53:32.073705 run patchelf(pid=3384): Terminated: ok {rc=0} 14:53:32.207928 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3381): Process ended prematurely: osmo-stp_10.42.42.5(pid=3381) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3381)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 14:53:32.218311 tst iperf3m4.py:8: Test FAILED (10.5 sec) 14:53:32.247632 run osmo-hlr_10.42.42.2(pid=3378): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3378)] 14:53:32.298150 run osmo-hlr_10.42.42.2(pid=3378): stdout: | (launched: 2022-12-14_14:53:28.932074) 14:53:32.350825 run osmo-hlr_10.42.42.2(pid=3378): stderr: | 20221214145329109 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145329109 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145329109 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145329109 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145329109 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145329109 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145329120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145329128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145329129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145329129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:53:32.403448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3367): Terminating (SIGTERM) 14:53:32.446028 run iperf3-srv_10.42.42.10(pid=3368): Terminating (SIGTERM) 14:53:32.488275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3369): Terminating (SIGTERM) 14:53:32.530834 run iperf3-srv_10.42.42.10(pid=3370): Terminating (SIGTERM) 14:53:32.572775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3371): Terminating (SIGTERM) 14:53:32.615075 run iperf3-srv_10.42.42.10(pid=3372): Terminating (SIGTERM) 14:53:32.657146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3373): Terminating (SIGTERM) 14:53:32.699068 run iperf3-srv_10.42.42.10(pid=3374): Terminating (SIGTERM) 14:53:32.741459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3377): Terminating (SIGTERM) 14:53:32.783307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3380): Terminating (SIGTERM) 14:53:32.825504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3383): Terminating (SIGTERM) 14:53:32.867990 --- ParallelTerminationStrategy: PID 3367 died... 14:53:32.887855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3367): Terminated: ok {rc=0} 14:53:32.934650 --- ParallelTerminationStrategy: PID 3368 died... 14:53:32.954426 run iperf3-srv_10.42.42.10(pid=3368): Terminated {rc=256} 14:53:33.000757 --- ParallelTerminationStrategy: PID 3369 died... 14:53:33.020441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3369): Terminated: ok {rc=0} 14:53:33.066592 --- ParallelTerminationStrategy: PID 3370 died... 14:53:33.086190 run iperf3-srv_10.42.42.10(pid=3370): Terminated {rc=256} 14:53:33.132256 --- ParallelTerminationStrategy: PID 3371 died... 14:53:33.151798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3371): Terminated: ok {rc=0} 14:53:33.198337 --- ParallelTerminationStrategy: PID 3372 died... 14:53:33.217993 run iperf3-srv_10.42.42.10(pid=3372): Terminated {rc=256} 14:53:33.264019 --- ParallelTerminationStrategy: PID 3373 died... 14:53:33.283530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3373): Terminated: ok {rc=0} 14:53:33.329946 --- ParallelTerminationStrategy: PID 3374 died... 14:53:33.349586 run iperf3-srv_10.42.42.10(pid=3374): Terminated {rc=256} 14:53:33.395665 --- ParallelTerminationStrategy: PID 3377 died... 14:53:33.415320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3377): Terminated: ok {rc=0} 14:53:33.461596 --- ParallelTerminationStrategy: PID 3380 died... 14:53:33.481647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3380): Terminated: ok {rc=0} 14:53:33.528151 --- ParallelTerminationStrategy: PID 3383 died... 14:53:33.547623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3383): Terminated: ok {rc=0} 14:53:33.636223 bus /gobi_4: Setting Powered False 14:53:34.735335 bus /gobi_4: Setting Powered False 14:53:35.850290 bus /gobi_1: Setting Powered False 14:53:36.948677 bus /gobi_1: Setting Powered False 14:53:38.062805 bus /gobi_0: Setting Powered False 14:53:39.159416 bus /gobi_0: Setting Powered False 14:53:40.277231 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 14:53:41.380247 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:41.392559 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:53:41.445572 tst ping.py: using LAC 41664 14:53:41.570535 tst ping.py: using RAC 99 14:53:41.687679 tst ping.py: using CellId 41664 14:53:41.803623 tst ping.py: using BVCI 41665 14:53:41.919633 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:41.931318 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:41.942900 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:41.954409 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:41.965835 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:41.977247 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:41.988690 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:41.999974 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:53:42.116851 tst ping.py:19: start network... 14:53:42.330157 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:53:42.820568 run create_hlr_db(pid=3385): Launched 14:53:42.950840 bus /gobi_6: Setting Powered False 14:53:44.013873 run create_hlr_db(pid=3385): Terminated: ok {rc=0} 14:53:44.437608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3387): Launched 14:53:44.733535 run osmo-hlr_10.42.42.2(pid=3388): Launched 14:53:44.847495 run osmo-stp_10.42.42.5: Starting osmo-stp 14:53:45.372104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3390): Launched 14:53:45.669653 run osmo-stp_10.42.42.5(pid=3391): Launched 14:53:45.783531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:53:46.409965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3393): Launched 14:53:46.539123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:53:46.827730 run patchelf(pid=3394): Launched 14:53:47.011804 run osmo-stp_10.42.42.5(pid=3391): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3391)] 14:53:47.148453 run osmo-stp_10.42.42.5(pid=3391): stdout: | (launched: 2022-12-14_14:53:45.615085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:47.277834 run osmo-stp_10.42.42.5(pid=3391): stderr: | 20221214145345786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145345786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145345786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145345787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145345787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145345787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145345787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:47.406518 run osmo-stp_10.42.42.5(pid=3391): stdout: | (launched: 2022-12-14_14:53:45.615085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:47.529474 run osmo-stp_10.42.42.5(pid=3391): stderr: | 20221214145345786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145345786 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145345786 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145345787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145345787 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145345787 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145345787 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:47.673960 run patchelf(pid=3394): Terminating (SIGINT) 14:53:47.841892 run patchelf(pid=3394): Terminated: ok {rc=0} 14:53:47.962601 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3391): Process ended prematurely: osmo-stp_10.42.42.5(pid=3391) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3391)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 14:53:47.971550 tst ping.py:22: Test FAILED (6.6 sec) 14:53:47.998578 run osmo-hlr_10.42.42.2(pid=3388): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3388)] 14:53:48.047156 run osmo-hlr_10.42.42.2(pid=3388): stdout: | (launched: 2022-12-14_14:53:44.679406) 14:53:48.096783 run osmo-hlr_10.42.42.2(pid=3388): stderr: | 20221214145344856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145344856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145344856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145344856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145344856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145344856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145344868 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145344877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145344878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145344878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:53:48.146908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3387): Terminating (SIGTERM) 14:53:48.187169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3390): Terminating (SIGTERM) 14:53:48.227520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3393): Terminating (SIGTERM) 14:53:48.267922 --- ParallelTerminationStrategy: PID 3387 died... 14:53:48.287405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3387): Terminated: ok {rc=0} 14:53:48.331875 --- ParallelTerminationStrategy: PID 3390 died... 14:53:48.350977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3390): Terminated: ok {rc=0} 14:53:48.395328 --- ParallelTerminationStrategy: PID 3393 died... 14:53:48.414512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3393): Terminated: ok {rc=0} 14:53:48.501228 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 14:53:49.589486 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:49.601178 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 14:53:49.657210 tst ping_idle_ping.py: using LAC 41665 14:53:49.772447 tst ping_idle_ping.py: using RAC 100 14:53:49.886669 tst ping_idle_ping.py: using CellId 41665 14:53:50.001302 tst ping_idle_ping.py: using BVCI 41666 14:53:50.108728 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:50.119827 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:50.130631 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:50.141431 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:50.152616 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:50.163963 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:50.175373 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 14:53:50.186660 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 14:53:50.301343 tst ping_idle_ping.py:24: start network... 14:53:50.499719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:53:50.961634 run create_hlr_db(pid=3395): Launched 14:53:51.076156 bus /gobi_6: Setting Powered False 14:53:52.136468 run create_hlr_db(pid=3395): Terminated: ok {rc=0} 14:53:52.554051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3397): Launched 14:53:52.852296 run osmo-hlr_10.42.42.2(pid=3398): Launched 14:53:52.966453 run osmo-stp_10.42.42.5: Starting osmo-stp 14:53:53.491785 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3400): Launched 14:53:53.790363 run osmo-stp_10.42.42.5(pid=3401): Launched 14:53:53.905067 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:53:54.417992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3403): Launched 14:53:54.532698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:53:54.784071 run patchelf(pid=3404): Launched 14:53:54.951005 run osmo-stp_10.42.42.5(pid=3401): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3401)] 14:53:55.077725 run osmo-stp_10.42.42.5(pid=3401): stdout: | (launched: 2022-12-14_14:53:53.736106) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:55.205565 run osmo-stp_10.42.42.5(pid=3401): stderr: | 20221214145353907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145353907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145353907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145353908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145353908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145353908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145353908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:55.333381 run osmo-stp_10.42.42.5(pid=3401): stdout: | (launched: 2022-12-14_14:53:53.736106) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:53:55.455665 run osmo-stp_10.42.42.5(pid=3401): stderr: | 20221214145353907 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145353907 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145353907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145353908 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145353908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145353908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145353908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:53:55.599785 run patchelf(pid=3404): Terminating (SIGINT) 14:53:55.767431 run patchelf(pid=3404): Terminated: ok {rc=0} 14:53:55.888453 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3401): Process ended prematurely: osmo-stp_10.42.42.5(pid=3401) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3401)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 14:53:55.897365 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 14:53:55.924142 run osmo-hlr_10.42.42.2(pid=3398): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3398)] 14:53:55.972316 run osmo-hlr_10.42.42.2(pid=3398): stdout: | (launched: 2022-12-14_14:53:52.797569) 14:53:56.021847 run osmo-hlr_10.42.42.2(pid=3398): stderr: | 20221214145352972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145352972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145352972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145352972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145352972 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145352972 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145352988 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145352996 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145352996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145352996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:53:56.071552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3397): Terminating (SIGTERM) 14:53:56.111919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3400): Terminating (SIGTERM) 14:53:56.151858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3403): Terminating (SIGTERM) 14:53:56.192038 --- ParallelTerminationStrategy: PID 3397 died... 14:53:56.211619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3397): Terminated: ok {rc=0} 14:53:56.255937 --- ParallelTerminationStrategy: PID 3400 died... 14:53:56.275043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3400): Terminated: ok {rc=0} 14:53:56.319377 --- ParallelTerminationStrategy: PID 3403 died... 14:53:56.338484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3403): Terminated: ok {rc=0} 14:53:56.425325 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 14:53:57.746850 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:53:57.753924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 14:53:57.787976 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 14:53:57.827163 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 14:53:57.913322 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 14:53:57.947387 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 14:53:57.986533 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 14:53:58.585120 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 14:53:58.637459 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:53:58.648874 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:53:58.719517 tst cs_paging_gprs_active.py: using LAC 41666 14:53:58.844813 tst cs_paging_gprs_active.py: using RAC 101 14:53:58.970333 tst cs_paging_gprs_active.py: using CellId 41666 14:53:59.095209 tst cs_paging_gprs_active.py: using BVCI 41667 14:53:59.212241 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:53:59.223836 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:53:59.235187 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:53:59.246640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:53:59.258298 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:53:59.269950 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:53:59.281643 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:53:59.293075 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:53:59.304737 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:53:59.420686 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:53:59.539541 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:53:59.757896 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:54:00.081367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3408): Launched 14:54:00.363295 run iperf3-srv_10.42.42.10(pid=3409): Launched 14:54:00.484941 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:54:00.702262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:54:01.049683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3410): Launched 14:54:01.338977 run iperf3-srv_10.42.42.10(pid=3411): Launched 14:54:01.476470 tst cs_paging_gprs_active.py:38: start network... 14:54:01.698710 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:54:02.264502 run create_hlr_db(pid=3448): Launched 14:54:02.432007 bus /gobi_6: Setting Powered False 14:54:03.519757 run create_hlr_db(pid=3448): Terminated: ok {rc=0} 14:54:04.049770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3683): Launched 14:54:04.385773 run osmo-hlr_10.42.42.2(pid=3686): Launched 14:54:04.632659 run osmo-stp_10.42.42.5: Starting osmo-stp 14:54:05.313391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3688): Launched 14:54:05.635137 run osmo-stp_10.42.42.5(pid=3689): Launched 14:54:05.876893 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:54:06.525970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3693): Launched 14:54:06.655551 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:54:06.949879 run patchelf(pid=3694): Launched 14:54:07.132466 run osmo-stp_10.42.42.5(pid=3689): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3689)] 14:54:07.265079 run osmo-stp_10.42.42.5(pid=3689): stdout: | (launched: 2022-12-14_14:54:05.572506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:07.397742 run osmo-stp_10.42.42.5(pid=3689): stderr: | 20221214145405915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145405915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145405915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145405916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145405916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145405916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145405916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:07.532841 run osmo-stp_10.42.42.5(pid=3689): stdout: | (launched: 2022-12-14_14:54:05.572506) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:07.663236 run osmo-stp_10.42.42.5(pid=3689): stderr: | 20221214145405915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145405915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145405915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145405916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145405916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145405916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145405916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:07.816007 run patchelf(pid=3694): Terminating (SIGINT) 14:54:07.990815 run patchelf(pid=3694): Terminated: ok {rc=0} 14:54:08.117381 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3689): Process ended prematurely: osmo-stp_10.42.42.5(pid=3689) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3689)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 14:54:08.127818 tst cs_paging_gprs_active.py:38: Test FAILED (9.5 sec) 14:54:08.156418 run osmo-hlr_10.42.42.2(pid=3686): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3686)] 14:54:08.208389 run osmo-hlr_10.42.42.2(pid=3686): stdout: | (launched: 2022-12-14_14:54:04.314548) 14:54:08.261602 run osmo-hlr_10.42.42.2(pid=3686): stderr: | 20221214145404623 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145404623 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145404623 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145404623 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145404623 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145404623 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145404639 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145404651 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145404652 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145404652 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:54:08.313913 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3408): Terminating (SIGTERM) 14:54:08.355824 run iperf3-srv_10.42.42.10(pid=3409): Terminating (SIGTERM) 14:54:08.401580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3410): Terminating (SIGTERM) 14:54:08.445419 run iperf3-srv_10.42.42.10(pid=3411): Terminating (SIGTERM) 14:54:08.490530 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3683): Terminating (SIGTERM) 14:54:08.534340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3688): Terminating (SIGTERM) 14:54:08.578943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3693): Terminating (SIGTERM) 14:54:08.624455 --- ParallelTerminationStrategy: PID 3408 died... 14:54:08.645688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3408): Terminated: ok {rc=0} 14:54:08.694117 --- ParallelTerminationStrategy: PID 3409 died... 14:54:08.714580 run iperf3-srv_10.42.42.10(pid=3409): Terminated {rc=256} 14:54:08.761336 --- ParallelTerminationStrategy: PID 3410 died... 14:54:08.781957 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3410): Terminated: ok {rc=0} 14:54:08.830565 --- ParallelTerminationStrategy: PID 3411 died... 14:54:08.850884 run iperf3-srv_10.42.42.10(pid=3411): Terminated {rc=256} 14:54:08.897366 --- ParallelTerminationStrategy: PID 3683 died... 14:54:08.918168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3683): Terminated: ok {rc=0} 14:54:08.965023 --- ParallelTerminationStrategy: PID 3688 died... 14:54:08.985802 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3688): Terminated: ok {rc=0} 14:54:09.033222 --- ParallelTerminationStrategy: PID 3693 died... 14:54:09.053762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3693): Terminated: ok {rc=0} 14:54:09.143338 bus /gobi_0: Setting Powered False 14:54:10.241582 bus /gobi_0: Setting Powered False 14:54:11.357551 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 14:54:12.511372 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:12.524804 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:54:12.600453 tst iperf3.py: using LAC 41667 14:54:12.729676 tst iperf3.py: using RAC 102 14:54:12.858791 tst iperf3.py: using CellId 41667 14:54:12.985615 tst iperf3.py: using BVCI 41668 14:54:13.107049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:13.119600 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:13.131950 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:13.144538 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:13.157226 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:13.169808 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:13.182793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:13.195322 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:13.208334 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:54:13.331414 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:54:13.556119 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:54:13.895464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3695): Launched 14:54:14.198626 run iperf3-srv_10.42.42.10(pid=3696): Launched 14:54:14.336575 tst iperf3.py:8: start network... 14:54:14.559402 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:54:15.078442 run create_hlr_db(pid=3697): Launched 14:54:15.248113 bus /gobi_6: Setting Powered False 14:54:16.351606 run create_hlr_db(pid=3697): Terminated: ok {rc=0} 14:54:16.937771 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3699): Launched 14:54:17.347854 run osmo-hlr_10.42.42.2(pid=3700): Launched 14:54:17.674205 run osmo-stp_10.42.42.5: Starting osmo-stp 14:54:18.371101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3702): Launched 14:54:18.721404 run osmo-stp_10.42.42.5(pid=3703): Launched 14:54:18.973106 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:54:19.639771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3705): Launched 14:54:19.778827 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:54:20.067361 run patchelf(pid=3706): Launched 14:54:20.267540 run osmo-stp_10.42.42.5(pid=3703): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3703)] 14:54:20.409807 run osmo-stp_10.42.42.5(pid=3703): stdout: | (launched: 2022-12-14_14:54:18.657073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:20.555201 run osmo-stp_10.42.42.5(pid=3703): stderr: | 20221214145418961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145418961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145418961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145418962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145418962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145418962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145418962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:20.699722 run osmo-stp_10.42.42.5(pid=3703): stdout: | (launched: 2022-12-14_14:54:18.657073) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:20.838008 run osmo-stp_10.42.42.5(pid=3703): stderr: | 20221214145418961 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145418961 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145418961 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145418962 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145418962 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145418962 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145418962 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:21.000591 run patchelf(pid=3706): Terminating (SIGINT) 14:54:21.189471 run patchelf(pid=3706): Terminated: ok {rc=0} 14:54:21.326127 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3703): Process ended prematurely: osmo-stp_10.42.42.5(pid=3703) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3703)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 14:54:21.337738 tst iperf3.py:8: Test FAILED (8.9 sec) 14:54:21.368678 run osmo-hlr_10.42.42.2(pid=3700): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3700)] 14:54:21.422100 run osmo-hlr_10.42.42.2(pid=3700): stdout: | (launched: 2022-12-14_14:54:17.271929) 14:54:21.476818 run osmo-hlr_10.42.42.2(pid=3700): stderr: | 20221214145417634 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145417634 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145417636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145417636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145417636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145417636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145417657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145417669 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145417669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145417669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:54:21.531861 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3695): Terminating (SIGTERM) 14:54:21.577408 run iperf3-srv_10.42.42.10(pid=3696): Terminating (SIGTERM) 14:54:21.626114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3699): Terminating (SIGTERM) 14:54:21.671160 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3702): Terminating (SIGTERM) 14:54:21.717394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3705): Terminating (SIGTERM) 14:54:21.763849 --- ParallelTerminationStrategy: PID 3695 died... 14:54:21.785183 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3695): Terminated: ok {rc=0} 14:54:21.836185 --- ParallelTerminationStrategy: PID 3696 died... 14:54:21.857050 run iperf3-srv_10.42.42.10(pid=3696): Terminated {rc=256} 14:54:21.905936 --- ParallelTerminationStrategy: PID 3699 died... 14:54:21.926647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3699): Terminated: ok {rc=0} 14:54:21.974771 --- ParallelTerminationStrategy: PID 3702 died... 14:54:21.996021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3702): Terminated: ok {rc=0} 14:54:22.045385 --- ParallelTerminationStrategy: PID 3705 died... 14:54:22.067175 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3705): Terminated: ok {rc=0} 14:54:22.159734 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 14:54:23.319805 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:23.333285 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:54:23.407069 tst iperf3m4.py: using LAC 41668 14:54:23.538378 tst iperf3m4.py: using RAC 103 14:54:23.674235 tst iperf3m4.py: using CellId 41668 14:54:23.804513 tst iperf3m4.py: using BVCI 41669 14:54:23.929471 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:23.942091 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:23.954751 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:23.967229 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:23.979899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:23.992512 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:24.005360 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:24.017917 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:24.031578 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:54:24.158992 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:54:24.287933 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:54:24.412487 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:54:24.538911 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:54:24.768329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:54:25.115450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3708): Launched 14:54:25.398634 run iperf3-srv_10.42.42.10(pid=3709): Launched 14:54:25.521282 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:54:25.741425 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:54:26.066673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3710): Launched 14:54:26.349167 run iperf3-srv_10.42.42.10(pid=3711): Launched 14:54:26.471263 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:54:26.689951 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:54:27.014567 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3712): Launched 14:54:27.298017 run iperf3-srv_10.42.42.10(pid=3713): Launched 14:54:27.419968 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:54:27.639125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:54:27.963936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3714): Launched 14:54:28.246464 run iperf3-srv_10.42.42.10(pid=3715): Launched 14:54:28.368389 tst iperf3m4.py:8: start network... 14:54:28.586511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:54:29.086692 run create_hlr_db(pid=3716): Launched 14:54:29.218362 bus /gobi_6: Setting Powered False 14:54:30.282467 run create_hlr_db(pid=3716): Terminated: ok {rc=0} 14:54:30.732079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3718): Launched 14:54:31.070640 run osmo-hlr_10.42.42.2(pid=3719): Launched 14:54:31.337696 run osmo-stp_10.42.42.5: Starting osmo-stp 14:54:31.957505 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3721): Launched 14:54:32.297848 run osmo-stp_10.42.42.5(pid=3722): Launched 14:54:32.452611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:54:33.014768 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3724): Launched 14:54:33.139233 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:54:33.412041 run patchelf(pid=3725): Launched 14:54:33.593029 run osmo-stp_10.42.42.5(pid=3722): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3722)] 14:54:33.730591 run osmo-stp_10.42.42.5(pid=3722): stdout: | (launched: 2022-12-14_14:54:32.234642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:33.868462 run osmo-stp_10.42.42.5(pid=3722): stderr: | 20221214145432461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145432461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145432461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145432462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145432462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145432462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145432462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:34.006493 run osmo-stp_10.42.42.5(pid=3722): stdout: | (launched: 2022-12-14_14:54:32.234642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:34.138890 run osmo-stp_10.42.42.5(pid=3722): stderr: | 20221214145432461 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145432461 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145432461 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145432462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145432462 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145432462 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145432462 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:34.295606 run patchelf(pid=3725): Terminating (SIGINT) 14:54:34.476777 run patchelf(pid=3725): Terminated: ok {rc=0} 14:54:34.608030 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3722): Process ended prematurely: osmo-stp_10.42.42.5(pid=3722) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3722)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 14:54:34.618289 tst iperf3m4.py:8: Test FAILED (11.3 sec) 14:54:34.647088 run osmo-hlr_10.42.42.2(pid=3719): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3719)] 14:54:34.697300 run osmo-hlr_10.42.42.2(pid=3719): stdout: | (launched: 2022-12-14_14:54:31.005472) 14:54:34.749138 run osmo-hlr_10.42.42.2(pid=3719): stderr: | 20221214145431230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145431230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145431230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145431230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145431230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145431230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145431251 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145431267 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145431267 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145431267 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:54:34.801496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3708): Terminating (SIGTERM) 14:54:34.843700 run iperf3-srv_10.42.42.10(pid=3709): Terminating (SIGTERM) 14:54:34.886108 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3710): Terminating (SIGTERM) 14:54:34.928133 run iperf3-srv_10.42.42.10(pid=3711): Terminating (SIGTERM) 14:54:34.970706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3712): Terminating (SIGTERM) 14:54:35.012520 run iperf3-srv_10.42.42.10(pid=3713): Terminating (SIGTERM) 14:54:35.054426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3714): Terminating (SIGTERM) 14:54:35.096061 run iperf3-srv_10.42.42.10(pid=3715): Terminating (SIGTERM) 14:54:35.138096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3718): Terminating (SIGTERM) 14:54:35.179636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3721): Terminating (SIGTERM) 14:54:35.221806 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3724): Terminating (SIGTERM) 14:54:35.263668 --- ParallelTerminationStrategy: PID 3708 died... 14:54:35.283685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3708): Terminated: ok {rc=0} 14:54:35.329811 --- ParallelTerminationStrategy: PID 3709 died... 14:54:35.349246 run iperf3-srv_10.42.42.10(pid=3709): Terminated {rc=256} 14:54:35.394980 --- ParallelTerminationStrategy: PID 3710 died... 14:54:35.414476 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3710): Terminated: ok {rc=0} 14:54:35.460251 --- ParallelTerminationStrategy: PID 3711 died... 14:54:35.479648 run iperf3-srv_10.42.42.10(pid=3711): Terminated {rc=256} 14:54:35.525334 --- ParallelTerminationStrategy: PID 3712 died... 14:54:35.544669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3712): Terminated: ok {rc=0} 14:54:35.591088 --- ParallelTerminationStrategy: PID 3713 died... 14:54:35.610656 run iperf3-srv_10.42.42.10(pid=3713): Terminated {rc=256} 14:54:35.656418 --- ParallelTerminationStrategy: PID 3714 died... 14:54:35.676225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3714): Terminated: ok {rc=0} 14:54:35.722169 --- ParallelTerminationStrategy: PID 3715 died... 14:54:35.741597 run iperf3-srv_10.42.42.10(pid=3715): Terminated {rc=256} 14:54:35.787395 --- ParallelTerminationStrategy: PID 3718 died... 14:54:35.806865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3718): Terminated: ok {rc=0} 14:54:35.852863 --- ParallelTerminationStrategy: PID 3721 died... 14:54:35.872839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3721): Terminated: ok {rc=0} 14:54:35.919170 --- ParallelTerminationStrategy: PID 3724 died... 14:54:35.938694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3724): Terminated: ok {rc=0} 14:54:36.026569 bus /gobi_4: Setting Powered False 14:54:37.126309 bus /gobi_4: Setting Powered False 14:54:38.242316 bus /gobi_1: Setting Powered False 14:54:39.341430 bus /gobi_1: Setting Powered False 14:54:40.459628 bus /gobi_0: Setting Powered False 14:54:41.558756 bus /gobi_0: Setting Powered False 14:54:42.677320 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 14:54:43.780805 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:43.792910 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:54:43.864206 tst ping.py: using LAC 41669 14:54:43.980801 tst ping.py: using RAC 104 14:54:44.094886 tst ping.py: using CellId 41669 14:54:44.209083 tst ping.py: using BVCI 41670 14:54:44.315770 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:44.326866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:44.337742 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:44.348533 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:44.359590 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:44.370474 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:44.381839 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:44.392722 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:54:44.507283 tst ping.py:19: start network... 14:54:44.704856 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:54:45.161043 run create_hlr_db(pid=3727): Launched 14:54:45.274320 bus /gobi_6: Setting Powered False 14:54:46.348041 run create_hlr_db(pid=3727): Terminated: ok {rc=0} 14:54:46.818026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3729): Launched 14:54:47.149609 run osmo-hlr_10.42.42.2(pid=3730): Launched 14:54:47.263471 run osmo-stp_10.42.42.5: Starting osmo-stp 14:54:47.793513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3732): Launched 14:54:48.089205 run osmo-stp_10.42.42.5(pid=3733): Launched 14:54:48.203668 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:54:48.713363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3735): Launched 14:54:48.827275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:54:49.076870 run patchelf(pid=3736): Launched 14:54:49.242517 run osmo-stp_10.42.42.5(pid=3733): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3733)] 14:54:49.368416 run osmo-stp_10.42.42.5(pid=3733): stdout: | (launched: 2022-12-14_14:54:48.034902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:49.495693 run osmo-stp_10.42.42.5(pid=3733): stderr: | 20221214145448204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145448204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145448205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145448205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145448206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145448206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145448206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:49.623133 run osmo-stp_10.42.42.5(pid=3733): stdout: | (launched: 2022-12-14_14:54:48.034902) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:49.744260 run osmo-stp_10.42.42.5(pid=3733): stderr: | 20221214145448204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145448204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145448205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145448205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145448206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145448206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145448206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:49.888758 run patchelf(pid=3736): Terminating (SIGINT) 14:54:50.055305 run patchelf(pid=3736): Terminated: ok {rc=0} 14:54:50.175846 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3733): Process ended prematurely: osmo-stp_10.42.42.5(pid=3733) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3733)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 14:54:50.184758 tst ping.py:22: Test FAILED (6.4 sec) 14:54:50.211729 run osmo-hlr_10.42.42.2(pid=3730): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3730)] 14:54:50.260521 run osmo-hlr_10.42.42.2(pid=3730): stdout: | (launched: 2022-12-14_14:54:47.088373) 14:54:50.309986 run osmo-hlr_10.42.42.2(pid=3730): stderr: | 20221214145447271 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145447271 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145447271 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145447271 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145447271 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145447271 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145447283 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145447292 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145447292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145447292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:54:50.359777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3729): Terminating (SIGTERM) 14:54:50.400021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3732): Terminating (SIGTERM) 14:54:50.440380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3735): Terminating (SIGTERM) 14:54:50.481139 --- ParallelTerminationStrategy: PID 3729 died... 14:54:50.500885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3729): Terminated: ok {rc=0} 14:54:50.545508 --- ParallelTerminationStrategy: PID 3732 died... 14:54:50.564479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3732): Terminated: ok {rc=0} 14:54:50.609356 --- ParallelTerminationStrategy: PID 3735 died... 14:54:50.628398 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3735): Terminated: ok {rc=0} 14:54:50.714616 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 14:54:51.804245 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:51.816180 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 14:54:51.888911 tst ping_idle_ping.py: using LAC 41670 14:54:52.005723 tst ping_idle_ping.py: using RAC 105 14:54:52.124262 tst ping_idle_ping.py: using CellId 41670 14:54:52.241145 tst ping_idle_ping.py: using BVCI 41671 14:54:52.348718 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:52.359932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:52.370915 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:52.381827 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:52.393589 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:52.405253 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:52.417222 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 14:54:52.428708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 14:54:52.547400 tst ping_idle_ping.py:24: start network... 14:54:52.762782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:54:53.262361 run create_hlr_db(pid=3737): Launched 14:54:53.392579 bus /gobi_6: Setting Powered False 14:54:54.455996 run create_hlr_db(pid=3737): Terminated: ok {rc=0} 14:54:54.883506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3739): Launched 14:54:55.188392 run osmo-hlr_10.42.42.2(pid=3740): Launched 14:54:55.312651 run osmo-stp_10.42.42.5: Starting osmo-stp 14:54:55.869591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3742): Launched 14:54:56.185723 run osmo-stp_10.42.42.5(pid=3743): Launched 14:54:56.306006 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:54:56.852692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3745): Launched 14:54:56.974559 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:54:57.241542 run patchelf(pid=3746): Launched 14:54:57.419394 run osmo-stp_10.42.42.5(pid=3743): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3743)] 14:54:57.554214 run osmo-stp_10.42.42.5(pid=3743): stdout: | (launched: 2022-12-14_14:54:56.128447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:57.690860 run osmo-stp_10.42.42.5(pid=3743): stderr: | 20221214145456319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145456319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145456319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145456320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145456322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145456322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145456322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:57.826927 run osmo-stp_10.42.42.5(pid=3743): stdout: | (launched: 2022-12-14_14:54:56.128447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:54:57.957456 run osmo-stp_10.42.42.5(pid=3743): stderr: | 20221214145456319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145456319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145456319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145456320 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145456322 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145456322 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145456322 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:54:58.111316 run patchelf(pid=3746): Terminating (SIGINT) 14:54:58.289315 run patchelf(pid=3746): Terminated: ok {rc=0} 14:54:58.418065 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3743): Process ended prematurely: osmo-stp_10.42.42.5(pid=3743) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3743)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 14:54:58.427499 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 14:54:58.455293 run osmo-hlr_10.42.42.2(pid=3740): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3740)] 14:54:58.505092 run osmo-hlr_10.42.42.2(pid=3740): stdout: | (launched: 2022-12-14_14:54:55.130239) 14:54:58.556895 run osmo-hlr_10.42.42.2(pid=3740): stderr: | 20221214145455327 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145455327 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145455328 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145455328 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145455328 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145455328 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145455340 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145455350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145455350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145455350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:54:58.609540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3739): Terminating (SIGTERM) 14:54:58.651791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3742): Terminating (SIGTERM) 14:54:58.694230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3745): Terminating (SIGTERM) 14:54:58.736483 --- ParallelTerminationStrategy: PID 3739 died... 14:54:58.756507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3739): Terminated: ok {rc=0} 14:54:58.803002 --- ParallelTerminationStrategy: PID 3742 died... 14:54:58.822474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3742): Terminated: ok {rc=0} 14:54:58.868276 --- ParallelTerminationStrategy: PID 3745 died... 14:54:58.887792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3745): Terminated: ok {rc=0} 14:54:58.975078 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:55:00.276907 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:55:00.283453 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:55:00.317065 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 14:55:00.356197 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 14:55:00.441476 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:55:00.474109 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 14:55:00.511345 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 14:55:01.117843 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 14:55:01.168708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:01.179866 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:55:01.252364 tst cs_paging_gprs_active.py: using LAC 41671 14:55:01.402111 tst cs_paging_gprs_active.py: using RAC 106 14:55:01.535240 tst cs_paging_gprs_active.py: using CellId 41671 14:55:01.665029 tst cs_paging_gprs_active.py: using BVCI 41672 14:55:01.813328 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:01.828609 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:01.844740 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:01.857124 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:01.869381 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:01.881853 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:01.894083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:01.906137 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:01.918279 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:55:02.063147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:55:02.183052 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 14:55:02.388932 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:55:02.692732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3754): Launched 14:55:02.957382 run iperf3-srv_10.42.42.10(pid=3755): Launched 14:55:03.071636 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 14:55:03.273603 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:55:03.576749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3756): Launched 14:55:03.839729 run iperf3-srv_10.42.42.10(pid=3757): Launched 14:55:03.954343 tst cs_paging_gprs_active.py:38: start network... 14:55:04.156049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:55:04.624708 run create_hlr_db(pid=3758): Launched 14:55:04.758808 bus /gobi_6: Setting Powered False 14:55:05.822444 run create_hlr_db(pid=3758): Terminated: ok {rc=0} 14:55:06.271585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3760): Launched 14:55:06.594935 run osmo-hlr_10.42.42.2(pid=3761): Launched 14:55:06.718437 run osmo-stp_10.42.42.5: Starting osmo-stp 14:55:07.276558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3763): Launched 14:55:07.600052 run osmo-stp_10.42.42.5(pid=3764): Launched 14:55:07.724611 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:55:08.283452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3766): Launched 14:55:08.407908 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:55:08.681891 run patchelf(pid=3767): Launched 14:55:08.863619 run osmo-stp_10.42.42.5(pid=3764): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3764)] 14:55:09.000426 run osmo-stp_10.42.42.5(pid=3764): stdout: | (launched: 2022-12-14_14:55:07.541098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:09.138610 run osmo-stp_10.42.42.5(pid=3764): stderr: | 20221214145507734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145507734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145507734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145507735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145507735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145507736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145507736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:09.276310 run osmo-stp_10.42.42.5(pid=3764): stdout: | (launched: 2022-12-14_14:55:07.541098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:09.409137 run osmo-stp_10.42.42.5(pid=3764): stderr: | 20221214145507734 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145507734 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145507734 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145507735 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145507735 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145507736 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145507736 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:09.566454 run patchelf(pid=3767): Terminating (SIGINT) 14:55:09.748029 run patchelf(pid=3767): Terminated: ok {rc=0} 14:55:09.878489 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3764): Process ended prematurely: osmo-stp_10.42.42.5(pid=3764) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3764)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 14:55:09.888484 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 14:55:09.917194 run osmo-hlr_10.42.42.2(pid=3761): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3761)] 14:55:09.967909 run osmo-hlr_10.42.42.2(pid=3761): stdout: | (launched: 2022-12-14_14:55:06.535956) 14:55:10.019924 run osmo-hlr_10.42.42.2(pid=3761): stderr: | 20221214145506734 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145506734 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145506734 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145506734 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145506734 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145506734 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145506746 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145506754 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145506754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145506754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:55:10.072344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3754): Terminating (SIGTERM) 14:55:10.114461 run iperf3-srv_10.42.42.10(pid=3755): Terminating (SIGTERM) 14:55:10.156928 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3756): Terminating (SIGTERM) 14:55:10.198995 run iperf3-srv_10.42.42.10(pid=3757): Terminating (SIGTERM) 14:55:10.240764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3760): Terminating (SIGTERM) 14:55:10.283169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3763): Terminating (SIGTERM) 14:55:10.325308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3766): Terminating (SIGTERM) 14:55:10.367462 --- ParallelTerminationStrategy: PID 3754 died... 14:55:10.387481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3754): Terminated: ok {rc=0} 14:55:10.433625 --- ParallelTerminationStrategy: PID 3755 died... 14:55:10.452902 run iperf3-srv_10.42.42.10(pid=3755): Terminated {rc=256} 14:55:10.498872 --- ParallelTerminationStrategy: PID 3756 died... 14:55:10.518481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3756): Terminated: ok {rc=0} 14:55:10.564400 --- ParallelTerminationStrategy: PID 3757 died... 14:55:10.584249 run iperf3-srv_10.42.42.10(pid=3757): Terminated {rc=256} 14:55:10.630353 --- ParallelTerminationStrategy: PID 3760 died... 14:55:10.649782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3760): Terminated: ok {rc=0} 14:55:10.695619 --- ParallelTerminationStrategy: PID 3763 died... 14:55:10.715212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3763): Terminated: ok {rc=0} 14:55:10.761389 --- ParallelTerminationStrategy: PID 3766 died... 14:55:10.780840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3766): Terminated: ok {rc=0} 14:55:10.868385 bus /gobi_0: Setting Powered False 14:55:11.968202 bus /gobi_0: Setting Powered False 14:55:13.084854 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 14:55:14.228774 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:14.240478 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:55:14.313382 tst iperf3.py: using LAC 41672 14:55:14.432898 tst iperf3.py: using RAC 107 14:55:14.550959 tst iperf3.py: using CellId 41672 14:55:14.670233 tst iperf3.py: using BVCI 41673 14:55:14.780788 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:14.791714 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:14.802529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:14.813336 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:14.824290 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:14.835663 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:14.846776 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:14.857795 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:14.868849 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:55:14.988076 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 14:55:15.206469 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:55:15.530627 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3768): Launched 14:55:15.812939 run iperf3-srv_10.42.42.10(pid=3769): Launched 14:55:15.953713 tst iperf3.py:8: start network... 14:55:16.183315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:55:16.696778 run create_hlr_db(pid=3770): Launched 14:55:16.860417 bus /gobi_6: Setting Powered False 14:55:17.920543 run create_hlr_db(pid=3770): Terminated: ok {rc=0} 14:55:18.373574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3772): Launched 14:55:18.696898 run osmo-hlr_10.42.42.2(pid=3773): Launched 14:55:18.820765 run osmo-stp_10.42.42.5: Starting osmo-stp 14:55:19.380409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3775): Launched 14:55:19.703511 run osmo-stp_10.42.42.5(pid=3776): Launched 14:55:19.826375 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:55:20.383557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3778): Launched 14:55:20.507757 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:55:20.781254 run patchelf(pid=3779): Launched 14:55:20.962184 run osmo-stp_10.42.42.5(pid=3776): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3776)] 14:55:21.099609 run osmo-stp_10.42.42.5(pid=3776): stdout: | (launched: 2022-12-14_14:55:19.644880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:21.237773 run osmo-stp_10.42.42.5(pid=3776): stderr: | 20221214145519840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145519840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145519840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145519840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145519841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145519841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145519841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:21.376010 run osmo-stp_10.42.42.5(pid=3776): stdout: | (launched: 2022-12-14_14:55:19.644880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:21.508122 run osmo-stp_10.42.42.5(pid=3776): stderr: | 20221214145519840 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145519840 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145519840 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145519840 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145519841 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145519841 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145519841 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:21.665578 run patchelf(pid=3779): Terminating (SIGINT) 14:55:21.846848 run patchelf(pid=3779): Terminated: ok {rc=0} 14:55:21.978211 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3776): Process ended prematurely: osmo-stp_10.42.42.5(pid=3776) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3776)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 14:55:21.988335 tst iperf3.py:8: Test FAILED (7.8 sec) 14:55:22.017107 run osmo-hlr_10.42.42.2(pid=3773): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3773)] 14:55:22.067744 run osmo-hlr_10.42.42.2(pid=3773): stdout: | (launched: 2022-12-14_14:55:18.638594) 14:55:22.119917 run osmo-hlr_10.42.42.2(pid=3773): stderr: | 20221214145518840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145518840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145518840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145518840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145518840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145518840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145518855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145518865 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145518865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145518865 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:55:22.172324 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3768): Terminating (SIGTERM) 14:55:22.214651 run iperf3-srv_10.42.42.10(pid=3769): Terminating (SIGTERM) 14:55:22.256710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3772): Terminating (SIGTERM) 14:55:22.299264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3775): Terminating (SIGTERM) 14:55:22.341589 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3778): Terminating (SIGTERM) 14:55:22.383904 --- ParallelTerminationStrategy: PID 3768 died... 14:55:22.403968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3768): Terminated: ok {rc=0} 14:55:22.450259 --- ParallelTerminationStrategy: PID 3769 died... 14:55:22.469709 run iperf3-srv_10.42.42.10(pid=3769): Terminated {rc=256} 14:55:22.515451 --- ParallelTerminationStrategy: PID 3772 died... 14:55:22.534894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3772): Terminated: ok {rc=0} 14:55:22.581244 --- ParallelTerminationStrategy: PID 3775 died... 14:55:22.600712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3775): Terminated: ok {rc=0} 14:55:22.646572 --- ParallelTerminationStrategy: PID 3778 died... 14:55:22.665983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3778): Terminated: ok {rc=0} 14:55:22.753735 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 14:55:23.906550 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:23.918639 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:55:23.993185 tst iperf3m4.py: using LAC 41673 14:55:24.119130 tst iperf3m4.py: using RAC 108 14:55:24.246613 tst iperf3m4.py: using CellId 41673 14:55:24.370937 tst iperf3m4.py: using BVCI 41674 14:55:24.487602 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:24.498999 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:24.510187 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:24.521354 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:24.532547 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:24.543798 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:24.555117 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:24.566264 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:24.578054 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:55:24.695053 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:55:24.814658 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:55:24.932696 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:55:25.052668 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 14:55:25.270371 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:55:25.594366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3780): Launched 14:55:25.877155 run iperf3-srv_10.42.42.10(pid=3781): Launched 14:55:25.998760 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 14:55:26.217174 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:55:26.541523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3782): Launched 14:55:26.825088 run iperf3-srv_10.42.42.10(pid=3783): Launched 14:55:26.946576 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 14:55:27.163205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:55:27.487445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3784): Launched 14:55:27.770467 run iperf3-srv_10.42.42.10(pid=3785): Launched 14:55:27.891938 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 14:55:28.110067 run iperf3-srv_10.42.42.10: Starting iperf3-srv 14:55:28.434197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3786): Launched 14:55:28.715508 run iperf3-srv_10.42.42.10(pid=3787): Launched 14:55:28.837432 tst iperf3m4.py:8: start network... 14:55:29.054330 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:55:29.555418 run create_hlr_db(pid=3788): Launched 14:55:29.687399 bus /gobi_6: Setting Powered False 14:55:30.750876 run create_hlr_db(pid=3788): Terminated: ok {rc=0} 14:55:31.217725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3790): Launched 14:55:31.565745 run osmo-hlr_10.42.42.2(pid=3791): Launched 14:55:31.706520 run osmo-stp_10.42.42.5: Starting osmo-stp 14:55:32.393635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3793): Launched 14:55:32.696076 run osmo-stp_10.42.42.5(pid=3794): Launched 14:55:32.812024 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:55:33.358262 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3796): Launched 14:55:33.482952 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:55:33.757405 run patchelf(pid=3797): Launched 14:55:33.937705 run osmo-stp_10.42.42.5(pid=3794): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3794)] 14:55:34.075188 run osmo-stp_10.42.42.5(pid=3794): stdout: | (launched: 2022-12-14_14:55:32.640871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:34.214104 run osmo-stp_10.42.42.5(pid=3794): stderr: | 20221214145532809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145532809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145532809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145532810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145532810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145532810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145532810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:34.352172 run osmo-stp_10.42.42.5(pid=3794): stdout: | (launched: 2022-12-14_14:55:32.640871) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:34.484411 run osmo-stp_10.42.42.5(pid=3794): stderr: | 20221214145532809 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145532809 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145532809 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145532810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145532810 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145532810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145532810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:34.641844 run patchelf(pid=3797): Terminating (SIGINT) 14:55:34.823532 run patchelf(pid=3797): Terminated: ok {rc=0} 14:55:34.954891 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3794): Process ended prematurely: osmo-stp_10.42.42.5(pid=3794) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3794)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 14:55:34.965275 tst iperf3m4.py:8: Test FAILED (11.1 sec) 14:55:34.994228 run osmo-hlr_10.42.42.2(pid=3791): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3791)] 14:55:35.044105 run osmo-hlr_10.42.42.2(pid=3791): stdout: | (launched: 2022-12-14_14:55:31.495403) 14:55:35.095822 run osmo-hlr_10.42.42.2(pid=3791): stderr: | 20221214145531925 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145531925 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145531925 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145531925 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145531925 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145531925 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145531952 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145531968 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145531968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145531968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:55:35.147903 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3780): Terminating (SIGTERM) 14:55:35.189942 run iperf3-srv_10.42.42.10(pid=3781): Terminating (SIGTERM) 14:55:35.231950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3782): Terminating (SIGTERM) 14:55:35.273722 run iperf3-srv_10.42.42.10(pid=3783): Terminating (SIGTERM) 14:55:35.315293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3784): Terminating (SIGTERM) 14:55:35.357171 run iperf3-srv_10.42.42.10(pid=3785): Terminating (SIGTERM) 14:55:35.398722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3786): Terminating (SIGTERM) 14:55:35.440323 run iperf3-srv_10.42.42.10(pid=3787): Terminating (SIGTERM) 14:55:35.481882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3790): Terminating (SIGTERM) 14:55:35.523504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3793): Terminating (SIGTERM) 14:55:35.565447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3796): Terminating (SIGTERM) 14:55:35.608043 --- ParallelTerminationStrategy: PID 3780 died... 14:55:35.628119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3780): Terminated: ok {rc=0} 14:55:35.674632 --- ParallelTerminationStrategy: PID 3781 died... 14:55:35.694287 run iperf3-srv_10.42.42.10(pid=3781): Terminated {rc=256} 14:55:35.740235 --- ParallelTerminationStrategy: PID 3782 died... 14:55:35.759760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3782): Terminated: ok {rc=0} 14:55:35.806094 --- ParallelTerminationStrategy: PID 3783 died... 14:55:35.825672 run iperf3-srv_10.42.42.10(pid=3783): Terminated {rc=256} 14:55:35.871729 --- ParallelTerminationStrategy: PID 3784 died... 14:55:35.891357 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3784): Terminated: ok {rc=0} 14:55:35.937519 --- ParallelTerminationStrategy: PID 3785 died... 14:55:35.957102 run iperf3-srv_10.42.42.10(pid=3785): Terminated {rc=256} 14:55:36.003193 --- ParallelTerminationStrategy: PID 3786 died... 14:55:36.022864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3786): Terminated: ok {rc=0} 14:55:36.068843 --- ParallelTerminationStrategy: PID 3787 died... 14:55:36.088931 run iperf3-srv_10.42.42.10(pid=3787): Terminated {rc=256} 14:55:36.135115 --- ParallelTerminationStrategy: PID 3790 died... 14:55:36.155127 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3790): Terminated: ok {rc=0} 14:55:36.201565 --- ParallelTerminationStrategy: PID 3793 died... 14:55:36.221166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3793): Terminated: ok {rc=0} 14:55:36.267349 --- ParallelTerminationStrategy: PID 3796 died... 14:55:36.286933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3796): Terminated: ok {rc=0} 14:55:36.375071 bus /gobi_4: Setting Powered False 14:55:37.474767 bus /gobi_4: Setting Powered False 14:55:38.592774 bus /gobi_1: Setting Powered False 14:55:39.691103 bus /gobi_1: Setting Powered False 14:55:40.805425 bus /gobi_0: Setting Powered False 14:55:41.903312 bus /gobi_0: Setting Powered False 14:55:43.021178 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 14:55:44.124522 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:44.136801 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:55:44.208641 tst ping.py: using LAC 41674 14:55:44.324867 tst ping.py: using RAC 109 14:55:44.439779 tst ping.py: using CellId 41674 14:55:44.559530 tst ping.py: using BVCI 41675 14:55:44.667231 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:44.678415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:44.689163 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:44.699831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:44.710879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:44.722056 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:44.733376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:44.744216 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:55:44.861071 tst ping.py:19: start network... 14:55:45.074810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:55:45.565336 run create_hlr_db(pid=3798): Launched 14:55:45.695886 bus /gobi_6: Setting Powered False 14:55:46.768243 run create_hlr_db(pid=3798): Terminated: ok {rc=0} 14:55:47.267282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3800): Launched 14:55:47.587522 run osmo-hlr_10.42.42.2(pid=3801): Launched 14:55:47.709638 run osmo-stp_10.42.42.5: Starting osmo-stp 14:55:48.262159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3803): Launched 14:55:48.576928 run osmo-stp_10.42.42.5(pid=3804): Launched 14:55:48.697584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:55:49.242205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3806): Launched 14:55:49.363809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:55:49.632824 run patchelf(pid=3807): Launched 14:55:49.808724 run osmo-stp_10.42.42.5(pid=3804): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3804)] 14:55:49.942503 run osmo-stp_10.42.42.5(pid=3804): stdout: | (launched: 2022-12-14_14:55:48.519719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:50.077759 run osmo-stp_10.42.42.5(pid=3804): stderr: | 20221214145548711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145548711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145548711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145548712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145548712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145548712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145548712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:50.212836 run osmo-stp_10.42.42.5(pid=3804): stdout: | (launched: 2022-12-14_14:55:48.519719) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:50.342511 run osmo-stp_10.42.42.5(pid=3804): stderr: | 20221214145548711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145548711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145548711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145548712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145548712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145548712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145548712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:50.495389 run patchelf(pid=3807): Terminating (SIGINT) 14:55:50.673249 run patchelf(pid=3807): Terminated: ok {rc=0} 14:55:50.801255 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3804): Process ended prematurely: osmo-stp_10.42.42.5(pid=3804) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3804)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 14:55:50.810783 tst ping.py:22: Test FAILED (6.7 sec) 14:55:50.838829 run osmo-hlr_10.42.42.2(pid=3801): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3801)] 14:55:50.888540 run osmo-hlr_10.42.42.2(pid=3801): stdout: | (launched: 2022-12-14_14:55:47.529710) 14:55:50.940012 run osmo-hlr_10.42.42.2(pid=3801): stderr: | 20221214145547728 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145547728 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145547728 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145547729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145547729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145547729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145547745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145547755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145547755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145547755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:55:50.991912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3800): Terminating (SIGTERM) 14:55:51.033556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3803): Terminating (SIGTERM) 14:55:51.075562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3806): Terminating (SIGTERM) 14:55:51.117215 --- ParallelTerminationStrategy: PID 3800 died... 14:55:51.137035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3800): Terminated: ok {rc=0} 14:55:51.182904 --- ParallelTerminationStrategy: PID 3803 died... 14:55:51.202315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3803): Terminated: ok {rc=0} 14:55:51.247963 --- ParallelTerminationStrategy: PID 3806 died... 14:55:51.267295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3806): Terminated: ok {rc=0} 14:55:51.354522 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 14:55:52.440401 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:52.452557 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:55:52.527629 tst ping_idle_ping.py: using LAC 41675 14:55:52.653404 tst ping_idle_ping.py: using RAC 110 14:55:52.777679 tst ping_idle_ping.py: using CellId 41675 14:55:52.908664 tst ping_idle_ping.py: using BVCI 41676 14:55:53.025194 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:53.036671 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:53.047978 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:53.059400 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:53.071172 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:53.082960 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:53.094899 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 14:55:53.106761 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 14:55:53.224314 tst ping_idle_ping.py:24: start network... 14:55:53.423957 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:55:53.885335 run create_hlr_db(pid=3808): Launched 14:55:54.000313 bus /gobi_6: Setting Powered False 14:55:55.059994 run create_hlr_db(pid=3808): Terminated: ok {rc=0} 14:55:55.495792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3810): Launched 14:55:55.813383 run osmo-hlr_10.42.42.2(pid=3811): Launched 14:55:55.934729 run osmo-stp_10.42.42.5: Starting osmo-stp 14:55:56.483117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3813): Launched 14:55:56.801503 run osmo-stp_10.42.42.5(pid=3814): Launched 14:55:56.923316 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:55:57.470662 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3816): Launched 14:55:57.593146 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:55:57.861249 run patchelf(pid=3817): Launched 14:55:58.038803 run osmo-stp_10.42.42.5(pid=3814): ERR: Terminated: ERROR {rc=1} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3814)] 14:55:58.173822 run osmo-stp_10.42.42.5(pid=3814): stdout: | (launched: 2022-12-14_14:55:56.744048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:58.309988 run osmo-stp_10.42.42.5(pid=3814): stderr: | 20221214145556938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145556938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145556938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145556939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145556939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145556939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145556939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:58.446605 run osmo-stp_10.42.42.5(pid=3814): stdout: | (launched: 2022-12-14_14:55:56.744048) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:55:58.576872 run osmo-stp_10.42.42.5(pid=3814): stderr: | 20221214145556938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145556938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145556938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145556939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145556939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145556939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145556939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:55:58.731524 run patchelf(pid=3817): Terminating (SIGINT) 14:55:58.909834 run patchelf(pid=3817): Terminated: ok {rc=0} 14:55:59.038222 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3814): Process ended prematurely: osmo-stp_10.42.42.5(pid=3814) [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3814)] [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 14:55:59.047610 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 14:55:59.075558 run osmo-hlr_10.42.42.2(pid=3811): ERR: Terminated: ERROR {rc=237} [trial-2406↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3811)] 14:55:59.125672 run osmo-hlr_10.42.42.2(pid=3811): stdout: | (launched: 2022-12-14_14:55:55.756126) 14:55:59.177336 run osmo-hlr_10.42.42.2(pid=3811): stderr: | 20221214145555955 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145555955 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145555955 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145555956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145555956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145555956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145555969 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145555977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145555977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145555977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:55:59.229428 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3810): Terminating (SIGTERM) 14:55:59.271168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3813): Terminating (SIGTERM) 14:55:59.312867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3816): Terminating (SIGTERM) 14:55:59.354788 --- ParallelTerminationStrategy: PID 3810 died... 14:55:59.374714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3810): Terminated: ok {rc=0} 14:55:59.420580 --- ParallelTerminationStrategy: PID 3813 died... 14:55:59.440041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3813): Terminated: ok {rc=0} 14:55:59.485750 --- ParallelTerminationStrategy: PID 3816 died... 14:55:59.505184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3816): Terminated: ok {rc=0} 14:55:59.593284 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:56:00.908003 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:56:00.919915 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:56:00.968186 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 14:56:01.003395 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:56:01.060858 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:56:01.103025 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 14:56:01.146192 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:56:01.691559 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2406 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 14:56:01.697678 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:56:01.709966 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:56:01.782548 tst switch_tch_pdch.py: using LAC 41676 14:56:01.943230 tst switch_tch_pdch.py: using RAC 111 14:56:02.104553 tst switch_tch_pdch.py: using CellId 41676 14:56:02.231391 tst switch_tch_pdch.py: using BVCI 41677 14:56:02.350218 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:56:02.363077 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:56:02.375325 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:56:02.387571 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:56:02.400375 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:56:02.412452 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:56:02.424833 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 14:56:02.436920 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:56:02.554356 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:56:02.669305 tst switch_tch_pdch.py:51: start network... 14:56:02.867087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:56:03.322679 run create_hlr_db(pid=3821): Launched 14:56:03.436563 bus /gobi_6: Setting Powered False 14:56:04.499478 run create_hlr_db(pid=3821): Terminated: ok {rc=0} 14:56:04.941665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3823): Launched 14:56:05.257744 run osmo-hlr_10.42.42.2(pid=3824): Launched 14:56:05.378550 run osmo-stp_10.42.42.5: Starting osmo-stp 14:56:05.926894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3826): Launched 14:56:06.243103 run osmo-stp_10.42.42.5(pid=3827): Launched 14:56:06.364453 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:56:06.912148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3829): Launched 14:56:07.034009 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:56:07.300784 run patchelf(pid=3830): Launched 14:56:07.477649 run osmo-stp_10.42.42.5(pid=3827): ERR: Terminated: ERROR {rc=1} [trial-2406↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3827)] 14:56:07.612360 run osmo-stp_10.42.42.5(pid=3827): stdout: | (launched: 2022-12-14_14:56:06.185795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:56:07.747915 run osmo-stp_10.42.42.5(pid=3827): stderr: | 20221214145606377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145606377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145606378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145606378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145606378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145606379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145606379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:56:07.883792 run osmo-stp_10.42.42.5(pid=3827): stdout: | (launched: 2022-12-14_14:56:06.185795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:56:08.013285 run osmo-stp_10.42.42.5(pid=3827): stderr: | 20221214145606377 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145606377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145606378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145606378 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145606378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145606379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145606379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:56:08.166503 run patchelf(pid=3830): Terminating (SIGINT) 14:56:08.344059 run patchelf(pid=3830): Terminated: ok {rc=0} 14:56:08.472381 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3827): Process ended prematurely: osmo-stp_10.42.42.5(pid=3827) [trial-2406↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3827)] [trial-2406↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 14:56:08.481919 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 14:56:08.509767 run osmo-hlr_10.42.42.2(pid=3824): ERR: Terminated: ERROR {rc=237} [trial-2406↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3824)] 14:56:08.559535 run osmo-hlr_10.42.42.2(pid=3824): stdout: | (launched: 2022-12-14_14:56:05.200394) 14:56:08.611634 run osmo-hlr_10.42.42.2(pid=3824): stderr: | 20221214145605398 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145605398 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145605398 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145605398 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145605398 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145605398 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145605411 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145605419 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145605419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145605419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:56:08.663825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3823): Terminating (SIGTERM) 14:56:08.705579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3826): Terminating (SIGTERM) 14:56:08.747056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3829): Terminating (SIGTERM) 14:56:08.789020 --- ParallelTerminationStrategy: PID 3823 died... 14:56:08.808920 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3823): Terminated: ok {rc=0} 14:56:08.855042 --- ParallelTerminationStrategy: PID 3826 died... 14:56:08.874496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3826): Terminated: ok {rc=0} 14:56:08.920126 --- ParallelTerminationStrategy: PID 3829 died... 14:56:08.939551 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3829): Terminated: ok {rc=0} 14:56:09.026874 bus /gobi_0: Setting Powered False 14:56:10.125645 bus /gobi_0: Setting Powered False 14:56:11.243075 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 14:56:12.496567 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:56:12.502372 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 14:56:12.535367 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 14:56:12.570067 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 14:56:12.623557 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 14:56:12.658147 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 14:56:12.694050 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 14:56:13.245462 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2406 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 14:56:13.251547 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:56:13.263129 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 14:56:13.333661 tst switch_tch_pdch.py: using LAC 41677 14:56:13.450539 tst switch_tch_pdch.py: using RAC 112 14:56:13.568804 tst switch_tch_pdch.py: using CellId 41677 14:56:13.684913 tst switch_tch_pdch.py: using BVCI 41678 14:56:13.791658 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:56:13.802756 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:56:13.813567 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:56:13.824280 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:56:13.835330 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:56:13.846497 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:56:13.857656 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 14:56:13.868626 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:56:13.989325 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 14:56:14.106311 tst switch_tch_pdch.py:51: start network... 14:56:14.321188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:56:14.786960 run create_hlr_db(pid=3835): Launched 14:56:14.916531 bus /gobi_6: Setting Powered False 14:56:15.992438 run create_hlr_db(pid=3835): Terminated: ok {rc=0} 14:56:16.405222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3837): Launched 14:56:16.728120 run osmo-hlr_10.42.42.2(pid=3838): Launched 14:56:16.872865 run osmo-stp_10.42.42.5: Starting osmo-stp 14:56:17.562044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3840): Launched 14:56:17.877339 run osmo-stp_10.42.42.5(pid=3841): Launched 14:56:17.997386 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 14:56:18.516067 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3843): Launched 14:56:18.637921 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 14:56:18.904277 run patchelf(pid=3844): Launched 14:56:19.080708 run osmo-stp_10.42.42.5(pid=3841): ERR: Terminated: ERROR {rc=1} [trial-2406↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3841)] 14:56:19.214573 run osmo-stp_10.42.42.5(pid=3841): stdout: | (launched: 2022-12-14_14:56:17.820072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:56:19.349889 run osmo-stp_10.42.42.5(pid=3841): stderr: | 20221214145618014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145618014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145618015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145618015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145618015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145618015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145618015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:56:19.484708 run osmo-stp_10.42.42.5(pid=3841): stdout: | (launched: 2022-12-14_14:56:17.820072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:56:19.614306 run osmo-stp_10.42.42.5(pid=3841): stderr: | 20221214145618014 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145618014 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145618015 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145618015 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145618015 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145618015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145618015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:56:19.767437 run patchelf(pid=3844): Terminating (SIGINT) 14:56:19.944278 run patchelf(pid=3844): Terminated: ok {rc=0} 14:56:20.072464 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3841): Process ended prematurely: osmo-stp_10.42.42.5(pid=3841) [trial-2406↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3841)] [trial-2406↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 14:56:20.081913 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 14:56:20.109846 run osmo-hlr_10.42.42.2(pid=3838): ERR: Terminated: ERROR {rc=237} [trial-2406↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3838)] 14:56:20.159710 run osmo-hlr_10.42.42.2(pid=3838): stdout: | (launched: 2022-12-14_14:56:16.661873) 14:56:20.211055 run osmo-hlr_10.42.42.2(pid=3838): stderr: | 20221214145617072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145617072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145617072 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145617072 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145617073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145617073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145617099 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145617118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145617118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145617118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:56:20.262988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3837): Terminating (SIGTERM) 14:56:20.306143 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3840): Terminating (SIGTERM) 14:56:20.347732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3843): Terminating (SIGTERM) 14:56:20.389546 --- ParallelTerminationStrategy: PID 3837 died... 14:56:20.409326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3837): Terminated: ok {rc=0} 14:56:20.455298 --- ParallelTerminationStrategy: PID 3840 died... 14:56:20.474629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3840): Terminated: ok {rc=0} 14:56:20.520760 --- ParallelTerminationStrategy: PID 3843 died... 14:56:20.540184 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3843): Terminated: ok {rc=0} 14:56:20.627524 bus /gobi_0: Setting Powered False 14:56:21.726060 bus /gobi_0: Setting Powered False 14:56:22.842136 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2406 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 nitb_sms:trx-umtrx --------------------------------------------------------------------- 14:56:24.097045 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:56:24.101192 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 14:56:24.132678 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 14:56:24.140477 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 14:56:24.192914 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 14:56:24.226178 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 14:56:24.233580 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 14:56:24.767725 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 14:56:24.774145 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 14:56:24.785649 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 14:56:24.834645 tst mo_mt_sms.py: using LAC 41678 14:56:24.953107 tst mo_mt_sms.py: using RAC 113 14:56:25.068416 tst mo_mt_sms.py: using CellId 41678 14:56:25.185640 tst mo_mt_sms.py: using BVCI 41679 14:56:25.302500 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 14:56:25.417197 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 14:56:25.529084 tst mo_mt_sms.py:9: start nitb and bts... 14:56:25.745145 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:56:26.391681 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3848): Launched 14:56:26.709998 run osmo-nitb_10.42.42.2(pid=3849): Launched 14:56:26.886296 run osmo-nitb_10.42.42.2(pid=3849): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3849)] 14:56:27.029029 run osmo-nitb_10.42.42.2(pid=3849): stdout: | (launched: 2022-12-14_14:56:26.652483) 14:56:27.173193 run osmo-nitb_10.42.42.2(pid=3849): stderr: | (launched: 2022-12-14_14:56:26.699587) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:56:27.317365 run osmo-nitb_10.42.42.2(pid=3849): stdout: | (launched: 2022-12-14_14:56:26.652483) 14:56:27.454765 run osmo-nitb_10.42.42.2(pid=3849): stderr: | (launched: 2022-12-14_14:56:26.699587) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3849): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3849) [trial-2406↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3849)] 14:56:27.830259 tst osmo-nitb_10.42.42.2(pid=3849): stdout: | (launched: 2022-12-14_14:56:26.652483) 14:56:27.958194 tst osmo-nitb_10.42.42.2(pid=3849): stderr: | (launched: 2022-12-14_14:56:26.699587) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:56:28.108805 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3849): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3849) [trial-2406↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3849)] [trial-2406↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 14:56:28.117942 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 14:56:28.125096 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3848): Terminating (SIGTERM) 14:56:28.335223 --- ParallelTerminationStrategy: PID 3848 died... 14:56:28.355909 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3848): Terminated: ok {rc=0} 14:56:28.443886 bus /sierra_3: Setting Powered False 14:56:29.543956 bus /sierra_3: Setting Powered False 14:56:30.660154 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 sms:trx-umtrx --------------------------------------------------------------------- 14:56:31.872457 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:56:31.876340 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 14:56:31.911569 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:56:31.941917 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 14:56:31.995598 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 14:56:32.046457 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:56:32.078907 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 14:56:32.602785 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 14:56:32.608666 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:32.619857 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 14:56:32.668019 tst mo_mt_sms.py: using LAC 41679 14:56:32.792343 tst mo_mt_sms.py: using RAC 114 14:56:32.916013 tst mo_mt_sms.py: using CellId 41679 14:56:33.039637 tst mo_mt_sms.py: using BVCI 41680 14:56:33.154286 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:33.165359 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:33.176275 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:33.187131 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:33.198070 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:33.208841 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 14:56:33.327454 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 14:56:33.441102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:56:33.896564 run create_hlr_db(pid=3853): Launched 14:56:34.011569 bus /sierra_2: Setting Powered False 14:56:35.071477 run create_hlr_db(pid=3853): Terminated: ok {rc=0} 14:56:35.505302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3855): Launched 14:56:35.823452 run osmo-hlr_10.42.42.2(pid=3856): Launched 14:56:35.944510 run osmo-stp_10.42.42.5: Starting osmo-stp 14:56:36.489617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3858): Launched 14:56:36.806873 run osmo-stp_10.42.42.5(pid=3859): Launched 14:56:36.927912 run osmo-msc_10.42.42.6: Starting osmo-msc 14:56:37.501069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3861): Launched 14:56:37.817873 run osmo-msc_10.42.42.6(pid=3862): Launched 14:56:37.994758 run osmo-stp_10.42.42.5(pid=3859): ERR: Terminated: ERROR {rc=1} [trial-2406↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3859)] 14:56:38.128238 run osmo-stp_10.42.42.5(pid=3859): stdout: | (launched: 2022-12-14_14:56:36.749300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:56:38.262487 run osmo-stp_10.42.42.5(pid=3859): stderr: | 20221214145636942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145636943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145636943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145636943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145636944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145636944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145636944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:56:38.396734 run osmo-stp_10.42.42.5(pid=3859): stdout: | (launched: 2022-12-14_14:56:36.749300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:56:38.522797 run osmo-stp_10.42.42.5(pid=3859): stderr: | 20221214145636942 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145636943 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145636943 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145636943 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145636944 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145636944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145636944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:56:38.675096 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3859): Process ended prematurely: osmo-stp_10.42.42.5(pid=3859) [trial-2406↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3859)] [trial-2406↪sms:trx-umtrx↪mo_mt_sms.py:16] 14:56:38.684195 tst mo_mt_sms.py:16: Test FAILED (6.1 sec) 14:56:38.711529 run osmo-hlr_10.42.42.2(pid=3856): ERR: Terminated: ERROR {rc=237} [trial-2406↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3856)] 14:56:38.761905 run osmo-hlr_10.42.42.2(pid=3856): stdout: | (launched: 2022-12-14_14:56:35.766079) 14:56:38.813960 run osmo-hlr_10.42.42.2(pid=3856): stderr: | 20221214145635966 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145635966 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145635966 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145635966 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145635966 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145635966 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145635979 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145635987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145635988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145635988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:56:38.886098 run osmo-msc_10.42.42.6(pid=3862): ERR: Terminated: ERROR {rc=2} [trial-2406↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3862)] 14:56:38.935826 run osmo-msc_10.42.42.6(pid=3862): stdout: | (launched: 2022-12-14_14:56:37.760461) 14:56:38.987227 run osmo-msc_10.42.42.6(pid=3862): stderr: | 20221214145638082 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145638082 DLGLOBAL DEBUG validating counter group 0x7f2bb963bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145638082 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145638082 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145638082 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145638082 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145638084 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145638084 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145638084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145638085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:56:39.039122 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3855): Terminating (SIGTERM) 14:56:39.080708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3858): Terminating (SIGTERM) 14:56:39.122532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3861): Terminating (SIGTERM) 14:56:39.164425 --- ParallelTerminationStrategy: PID 3855 died... 14:56:39.184677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3855): Terminated: ok {rc=0} 14:56:39.230782 --- ParallelTerminationStrategy: PID 3858 died... 14:56:39.250444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3858): Terminated: ok {rc=0} 14:56:39.296315 --- ParallelTerminationStrategy: PID 3861 died... 14:56:39.316367 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3861): Terminated: ok {rc=0} 14:56:39.403106 bus /sierra_3: Setting Powered False 14:56:40.501058 bus /sierra_3: Setting Powered False 14:56:41.616280 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 14:56:42.839811 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:56:42.843550 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 14:56:42.875127 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 14:56:42.882135 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 14:56:42.918431 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 14:56:42.950429 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 14:56:42.957100 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 14:56:43.476223 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2406 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 14:56:43.481120 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 14:56:43.491710 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 14:56:43.538352 tst assert_extension.py: using LAC 41680 14:56:43.663476 tst assert_extension.py: using RAC 115 14:56:43.781482 tst assert_extension.py: using CellId 41680 14:56:43.905900 tst assert_extension.py: using BVCI 41681 14:56:44.022947 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 14:56:44.137885 tst assert_extension.py:10: start nitb and bts... 14:56:44.335434 run osmo-nitb_10.42.42.2: Starting osmo-nitb 14:56:44.939970 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3869): Launched 14:56:45.235533 run osmo-nitb_10.42.42.2(pid=3870): Launched 14:56:45.400354 run osmo-nitb_10.42.42.2(pid=3870): ERR: Terminated: ERROR {rc=2} [trial-2406↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3870)] 14:56:45.534019 run osmo-nitb_10.42.42.2(pid=3870): stdout: | (launched: 2022-12-14_14:56:45.181559) 14:56:45.668765 run osmo-nitb_10.42.42.2(pid=3870): stderr: | (launched: 2022-12-14_14:56:45.225331) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:56:45.803807 run osmo-nitb_10.42.42.2(pid=3870): stdout: | (launched: 2022-12-14_14:56:45.181559) 14:56:45.965792 run osmo-nitb_10.42.42.2(pid=3870): stderr: | (launched: 2022-12-14_14:56:45.225331) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3870): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3870) [trial-2406↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3870)] 14:56:46.347113 tst osmo-nitb_10.42.42.2(pid=3870): stdout: | (launched: 2022-12-14_14:56:45.181559) 14:56:46.469629 tst osmo-nitb_10.42.42.2(pid=3870): stderr: | (launched: 2022-12-14_14:56:45.225331) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 14:56:46.614871 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3870): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3870) [trial-2406↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3870)] [trial-2406↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 14:56:46.624183 tst assert_extension.py:12: Test FAILED (3.1 sec) 14:56:46.631836 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3869): Terminating (SIGTERM) 14:56:46.842642 --- ParallelTerminationStrategy: PID 3869 died... 14:56:46.865990 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3869): Terminated: ok {rc=0} 14:56:46.980408 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 ussd:trx-umtrx --------------------------------------------------------------------- 14:56:48.155144 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:56:48.159037 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 14:56:48.190594 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:56:48.217237 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 14:56:48.252521 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 14:56:48.286818 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:56:48.314811 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 14:56:48.838364 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2406 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 14:56:48.844404 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:48.855472 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 14:56:48.902690 tst assert_extension.py: using LAC 41681 14:56:49.021414 tst assert_extension.py: using RAC 116 14:56:49.147795 tst assert_extension.py: using CellId 41681 14:56:49.274137 tst assert_extension.py: using BVCI 41682 14:56:49.391180 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:49.402468 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:49.413615 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:49.424412 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:49.435271 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:56:49.446758 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 14:56:49.562869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:56:50.049740 run create_hlr_db(pid=3874): Launched 14:56:50.170306 bus /sierra_2: Setting Powered False 14:56:51.229187 run create_hlr_db(pid=3874): Terminated: ok {rc=0} 14:56:51.662882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3876): Launched 14:56:51.979465 run osmo-hlr_10.42.42.2(pid=3877): Launched 14:56:52.100895 run osmo-stp_10.42.42.5: Starting osmo-stp 14:56:52.652046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3879): Launched 14:56:52.968651 run osmo-stp_10.42.42.5(pid=3880): Launched 14:56:53.089777 run osmo-msc_10.42.42.6: Starting osmo-msc 14:56:53.662035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3882): Launched 14:56:53.978451 run osmo-msc_10.42.42.6(pid=3883): Launched 14:56:54.154799 run osmo-stp_10.42.42.5(pid=3880): ERR: Terminated: ERROR {rc=1} [trial-2406↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3880)] 14:56:54.287890 run osmo-stp_10.42.42.5(pid=3880): stdout: | (launched: 2022-12-14_14:56:52.911349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:56:54.421564 run osmo-stp_10.42.42.5(pid=3880): stderr: | 20221214145653101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145653101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145653102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145653102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145653104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145653104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145653104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:56:54.555313 run osmo-stp_10.42.42.5(pid=3880): stdout: | (launched: 2022-12-14_14:56:52.911349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:56:54.681638 run osmo-stp_10.42.42.5(pid=3880): stderr: | 20221214145653101 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145653101 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145653102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145653102 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145653104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145653104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145653104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:56:54.832683 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3880): Process ended prematurely: osmo-stp_10.42.42.5(pid=3880) [trial-2406↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3880)] [trial-2406↪ussd:trx-umtrx↪assert_extension.py:17] 14:56:54.841788 tst assert_extension.py:17: Test FAILED (6.0 sec) 14:56:54.869491 run osmo-hlr_10.42.42.2(pid=3877): ERR: Terminated: ERROR {rc=237} [trial-2406↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3877)] 14:56:54.919936 run osmo-hlr_10.42.42.2(pid=3877): stdout: | (launched: 2022-12-14_14:56:51.921886) 14:56:54.971681 run osmo-hlr_10.42.42.2(pid=3877): stderr: | 20221214145652117 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145652117 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145652117 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145652117 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145652117 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145652117 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145652129 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145652137 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145652137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145652138 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:56:55.043832 run osmo-msc_10.42.42.6(pid=3883): ERR: Terminated: ERROR {rc=2} [trial-2406↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3883)] 14:56:55.093589 run osmo-msc_10.42.42.6(pid=3883): stdout: | (launched: 2022-12-14_14:56:53.921174) 14:56:55.144919 run osmo-msc_10.42.42.6(pid=3883): stderr: | 20221214145654241 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145654241 DLGLOBAL DEBUG validating counter group 0x7efd92bf7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145654241 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145654241 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145654241 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145654241 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145654244 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145654244 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145654245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145654245 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:56:55.196566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3876): Terminating (SIGTERM) 14:56:55.238219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3879): Terminating (SIGTERM) 14:56:55.279952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3882): Terminating (SIGTERM) 14:56:55.321971 --- ParallelTerminationStrategy: PID 3876 died... 14:56:55.341442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3876): Terminated: ok {rc=0} 14:56:55.387082 --- ParallelTerminationStrategy: PID 3879 died... 14:56:55.406462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3879): Terminated: ok {rc=0} 14:56:55.452116 --- ParallelTerminationStrategy: PID 3882 died... 14:56:55.471469 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3882): Terminated: ok {rc=0} 14:56:55.557783 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 14:56:56.761507 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:56:56.768387 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 14:56:56.800388 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 14:56:56.827381 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 14:56:56.876739 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 14:56:56.908472 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 14:56:56.934727 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 14:56:57.486258 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 14:56:57.542547 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:56:57.554259 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:56:57.624657 tst mo_mt_call.py: using LAC 41682 14:56:57.749790 tst mo_mt_call.py: using RAC 117 14:56:57.874313 tst mo_mt_call.py: using CellId 41682 14:56:57.998578 tst mo_mt_call.py: using BVCI 41683 14:56:58.115182 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:56:58.126670 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:56:58.137948 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:56:58.149285 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:56:58.160618 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:56:58.171966 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:56:58.292942 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:56:58.411008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:56:58.877728 run create_hlr_db(pid=3888): Launched 14:56:58.994153 bus /sierra_2: Setting Powered False 14:57:00.053995 run create_hlr_db(pid=3888): Terminated: ok {rc=0} 14:57:00.496034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3890): Launched 14:57:00.819765 run osmo-hlr_10.42.42.2(pid=3891): Launched 14:57:01.127364 run osmo-stp_10.42.42.5: Starting osmo-stp 14:57:01.749034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3893): Launched 14:57:02.191086 run osmo-stp_10.42.42.5(pid=3894): Launched 14:57:02.445661 run osmo-msc_10.42.42.6: Starting osmo-msc 14:57:02.992391 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3896): Launched 14:57:03.295470 run osmo-msc_10.42.42.6(pid=3897): Launched 14:57:03.466693 run osmo-stp_10.42.42.5(pid=3894): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3894)] 14:57:03.595805 run osmo-stp_10.42.42.5(pid=3894): stdout: | (launched: 2022-12-14_14:57:02.110939) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:03.725524 run osmo-stp_10.42.42.5(pid=3894): stderr: | 20221214145702324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145702324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145702324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145702326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145702326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145702326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145702327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:03.852632 run osmo-stp_10.42.42.5(pid=3894): stdout: | (launched: 2022-12-14_14:57:02.110939) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:03.972457 run osmo-stp_10.42.42.5(pid=3894): stderr: | 20221214145702324 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145702324 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145702324 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145702326 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145702326 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145702326 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145702327 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:04.116453 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3894): Process ended prematurely: osmo-stp_10.42.42.5(pid=3894) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3894)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 14:57:04.125635 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 14:57:04.152313 run osmo-hlr_10.42.42.2(pid=3891): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3891)] 14:57:04.201333 run osmo-hlr_10.42.42.2(pid=3891): stdout: | (launched: 2022-12-14_14:57:00.761099) 14:57:04.251516 run osmo-hlr_10.42.42.2(pid=3891): stderr: | 20221214145701019 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145701019 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145701019 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145701019 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145701019 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145701019 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145701035 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145701050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145701050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145701050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:57:04.321452 run osmo-msc_10.42.42.6(pid=3897): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3897)] 14:57:04.370561 run osmo-msc_10.42.42.6(pid=3897): stdout: | (launched: 2022-12-14_14:57:03.240316) 14:57:04.420636 run osmo-msc_10.42.42.6(pid=3897): stderr: | 20221214145703510 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145703511 DLGLOBAL DEBUG validating counter group 0x7f9e9ade5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145703511 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145703511 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145703511 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145703511 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145703513 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145703513 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145703513 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145703513 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:57:04.471020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3890): Terminating (SIGTERM) 14:57:04.511478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3893): Terminating (SIGTERM) 14:57:04.551543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3896): Terminating (SIGTERM) 14:57:04.592446 --- ParallelTerminationStrategy: PID 3890 died... 14:57:04.611726 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3890): Terminated: ok {rc=0} 14:57:04.656832 --- ParallelTerminationStrategy: PID 3893 died... 14:57:04.675935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3893): Terminated: ok {rc=0} 14:57:04.720875 --- ParallelTerminationStrategy: PID 3896 died... 14:57:04.740472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3896): Terminated: ok {rc=0} 14:57:04.827532 bus /sierra_3: Setting Powered False 14:57:05.927722 bus /sierra_3: Setting Powered False 14:57:07.041180 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 14:57:08.190464 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:57:08.202743 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 14:57:08.279926 tst mo_mt_call_osmux.py: using LAC 41683 14:57:08.397618 tst mo_mt_call_osmux.py: using RAC 118 14:57:08.522293 tst mo_mt_call_osmux.py: using CellId 41683 14:57:08.646781 tst mo_mt_call_osmux.py: using BVCI 41684 14:57:08.763189 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:57:08.774705 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:57:08.786067 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:57:08.797357 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:57:08.808754 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 14:57:08.820046 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:57:08.939105 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 14:57:09.056020 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:57:09.522898 run create_hlr_db(pid=3899): Launched 14:57:09.639132 bus /sierra_2: Setting Powered False 14:57:10.698893 run create_hlr_db(pid=3899): Terminated: ok {rc=0} 14:57:11.118560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3901): Launched 14:57:11.420743 run osmo-hlr_10.42.42.2(pid=3902): Launched 14:57:11.537537 run osmo-stp_10.42.42.5: Starting osmo-stp 14:57:12.070325 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3904): Launched 14:57:12.373591 run osmo-stp_10.42.42.5(pid=3905): Launched 14:57:12.489960 run osmo-msc_10.42.42.6: Starting osmo-msc 14:57:13.038523 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3907): Launched 14:57:13.340738 run osmo-msc_10.42.42.6(pid=3908): Launched 14:57:13.511291 run osmo-stp_10.42.42.5(pid=3905): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3905)] 14:57:13.639900 run osmo-stp_10.42.42.5(pid=3905): stdout: | (launched: 2022-12-14_14:57:12.318374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:13.768447 run osmo-stp_10.42.42.5(pid=3905): stderr: | 20221214145712490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145712490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145712490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145712491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145712491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145712491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145712491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:13.894844 run osmo-stp_10.42.42.5(pid=3905): stdout: | (launched: 2022-12-14_14:57:12.318374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:14.014843 run osmo-stp_10.42.42.5(pid=3905): stderr: | 20221214145712490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145712490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145712490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145712491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145712491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145712491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145712491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:14.158461 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3905): Process ended prematurely: osmo-stp_10.42.42.5(pid=3905) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3905)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 14:57:14.167385 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 14:57:14.193988 run osmo-hlr_10.42.42.2(pid=3902): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3902)] 14:57:14.242979 run osmo-hlr_10.42.42.2(pid=3902): stdout: | (launched: 2022-12-14_14:57:11.365436) 14:57:14.293400 run osmo-hlr_10.42.42.2(pid=3902): stderr: | 20221214145711541 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145711541 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145711541 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145711541 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145711541 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145711541 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145711553 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145711561 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145711561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145711561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:57:14.362988 run osmo-msc_10.42.42.6(pid=3908): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3908)] 14:57:14.411269 run osmo-msc_10.42.42.6(pid=3908): stdout: | (launched: 2022-12-14_14:57:13.285409) 14:57:14.461066 run osmo-msc_10.42.42.6(pid=3908): stderr: | 20221214145713555 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145713555 DLGLOBAL DEBUG validating counter group 0x7f93a9400c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145713555 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145713555 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145713555 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145713556 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145713558 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145713558 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145713558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145713558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:57:14.511191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3901): Terminating (SIGTERM) 14:57:14.551527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3904): Terminating (SIGTERM) 14:57:14.591446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3907): Terminating (SIGTERM) 14:57:14.632126 --- ParallelTerminationStrategy: PID 3901 died... 14:57:14.651426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3901): Terminated: ok {rc=0} 14:57:14.696563 --- ParallelTerminationStrategy: PID 3904 died... 14:57:14.715737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3904): Terminated: ok {rc=0} 14:57:14.759562 --- ParallelTerminationStrategy: PID 3907 died... 14:57:14.779016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3907): Terminated: ok {rc=0} 14:57:14.863973 bus /sierra_3: Setting Powered False 14:57:15.966154 bus /sierra_3: Setting Powered False 14:57:17.087521 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 14:57:18.340258 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:57:18.347117 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 14:57:18.378515 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 14:57:18.405611 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 14:57:18.458444 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 14:57:18.491804 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 14:57:18.518984 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 14:57:19.065432 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 14:57:19.114054 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:19.124887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:57:19.192828 tst mo_mt_call.py: using LAC 41684 14:57:19.312483 tst mo_mt_call.py: using RAC 119 14:57:19.434728 tst mo_mt_call.py: using CellId 41684 14:57:19.552688 tst mo_mt_call.py: using BVCI 41685 14:57:19.663481 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:19.674426 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:19.685213 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:19.695887 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:19.707037 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:19.717748 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:57:19.837659 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:57:19.956932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:57:20.456401 run create_hlr_db(pid=3914): Launched 14:57:20.588601 bus /sierra_2: Setting Powered False 14:57:21.653297 run create_hlr_db(pid=3914): Terminated: ok {rc=0} 14:57:22.103776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3916): Launched 14:57:22.427416 run osmo-hlr_10.42.42.2(pid=3917): Launched 14:57:22.551027 run osmo-stp_10.42.42.5: Starting osmo-stp 14:57:23.110401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3919): Launched 14:57:23.433077 run osmo-stp_10.42.42.5(pid=3920): Launched 14:57:23.555362 run osmo-msc_10.42.42.6: Starting osmo-msc 14:57:24.138818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3922): Launched 14:57:24.460519 run osmo-msc_10.42.42.6(pid=3923): Launched 14:57:24.641005 run osmo-stp_10.42.42.5(pid=3920): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3920)] 14:57:24.776652 run osmo-stp_10.42.42.5(pid=3920): stdout: | (launched: 2022-12-14_14:57:23.374614) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:24.913920 run osmo-stp_10.42.42.5(pid=3920): stderr: | 20221214145723567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145723567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145723567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145723568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145723568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145723568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145723568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:25.050759 run osmo-stp_10.42.42.5(pid=3920): stdout: | (launched: 2022-12-14_14:57:23.374614) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:25.179233 run osmo-stp_10.42.42.5(pid=3920): stderr: | 20221214145723567 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145723567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145723567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145723568 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145723568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145723568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145723568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:25.333295 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3920): Process ended prematurely: osmo-stp_10.42.42.5(pid=3920) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3920)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 14:57:25.342806 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:57:25.370811 run osmo-hlr_10.42.42.2(pid=3917): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3917)] 14:57:25.420694 run osmo-hlr_10.42.42.2(pid=3917): stdout: | (launched: 2022-12-14_14:57:22.368897) 14:57:25.472299 run osmo-hlr_10.42.42.2(pid=3917): stderr: | 20221214145722566 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145722566 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145722566 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145722566 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145722566 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145722566 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145722579 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145722587 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145722587 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145722587 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:57:25.544339 run osmo-msc_10.42.42.6(pid=3923): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3923)] 14:57:25.594182 run osmo-msc_10.42.42.6(pid=3923): stdout: | (launched: 2022-12-14_14:57:24.401954) 14:57:25.646217 run osmo-msc_10.42.42.6(pid=3923): stderr: | 20221214145724725 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145724725 DLGLOBAL DEBUG validating counter group 0x7f6c73e54c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145724725 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145724725 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145724725 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145724725 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145724727 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145724727 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145724727 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145724728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:57:25.698322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3916): Terminating (SIGTERM) 14:57:25.740028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3919): Terminating (SIGTERM) 14:57:25.781846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3922): Terminating (SIGTERM) 14:57:25.823738 --- ParallelTerminationStrategy: PID 3916 died... 14:57:25.843855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3916): Terminated: ok {rc=0} 14:57:25.889855 --- ParallelTerminationStrategy: PID 3919 died... 14:57:25.909597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3919): Terminated: ok {rc=0} 14:57:25.955838 --- ParallelTerminationStrategy: PID 3922 died... 14:57:25.975526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3922): Terminated: ok {rc=0} 14:57:26.064726 bus /sierra_3: Setting Powered False 14:57:27.161081 bus /sierra_3: Setting Powered False 14:57:28.274695 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 14:57:29.423142 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:29.435389 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 14:57:29.507673 tst mo_mt_call_osmux.py: using LAC 41685 14:57:29.640142 tst mo_mt_call_osmux.py: using RAC 120 14:57:29.758374 tst mo_mt_call_osmux.py: using CellId 41685 14:57:29.883880 tst mo_mt_call_osmux.py: using BVCI 41686 14:57:30.000908 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:30.012721 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:30.024359 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:30.035889 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:30.047502 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 14:57:30.058874 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:57:30.177683 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 14:57:30.298433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:57:30.766896 run create_hlr_db(pid=3925): Launched 14:57:30.912070 bus /sierra_2: Setting Powered False 14:57:31.973519 run create_hlr_db(pid=3925): Terminated: ok {rc=0} 14:57:32.440562 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3927): Launched 14:57:32.745296 run osmo-hlr_10.42.42.2(pid=3928): Launched 14:57:32.861579 run osmo-stp_10.42.42.5: Starting osmo-stp 14:57:33.384088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3930): Launched 14:57:33.686452 run osmo-stp_10.42.42.5(pid=3931): Launched 14:57:33.802419 run osmo-msc_10.42.42.6: Starting osmo-msc 14:57:34.348309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3933): Launched 14:57:34.652651 run osmo-msc_10.42.42.6(pid=3934): Launched 14:57:34.822738 run osmo-stp_10.42.42.5(pid=3931): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3931)] 14:57:34.951994 run osmo-stp_10.42.42.5(pid=3931): stdout: | (launched: 2022-12-14_14:57:33.631699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:35.080844 run osmo-stp_10.42.42.5(pid=3931): stderr: | 20221214145733801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145733801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145733801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145733801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145733802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145733802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145733802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:35.207776 run osmo-stp_10.42.42.5(pid=3931): stdout: | (launched: 2022-12-14_14:57:33.631699) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:35.327642 run osmo-stp_10.42.42.5(pid=3931): stderr: | 20221214145733801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145733801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145733801 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145733801 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145733802 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145733802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145733802 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:35.471856 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3931): Process ended prematurely: osmo-stp_10.42.42.5(pid=3931) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3931)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 14:57:35.480713 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 14:57:35.507407 run osmo-hlr_10.42.42.2(pid=3928): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3928)] 14:57:35.555719 run osmo-hlr_10.42.42.2(pid=3928): stdout: | (launched: 2022-12-14_14:57:32.689895) 14:57:35.605365 run osmo-hlr_10.42.42.2(pid=3928): stderr: | 20221214145732867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145732867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145732867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145732867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145732867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145732867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145732879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145732888 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145732888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145732888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:57:35.674819 run osmo-msc_10.42.42.6(pid=3934): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3934)] 14:57:35.722845 run osmo-msc_10.42.42.6(pid=3934): stdout: | (launched: 2022-12-14_14:57:34.596307) 14:57:35.772204 run osmo-msc_10.42.42.6(pid=3934): stderr: | 20221214145734871 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145734871 DLGLOBAL DEBUG validating counter group 0x7fc74c077c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145734871 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145734871 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145734872 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145734872 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145734873 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145734874 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145734874 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145734874 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:57:35.822011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3927): Terminating (SIGTERM) 14:57:35.862110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3930): Terminating (SIGTERM) 14:57:35.901952 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3933): Terminating (SIGTERM) 14:57:35.942146 --- ParallelTerminationStrategy: PID 3927 died... 14:57:35.961505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3927): Terminated: ok {rc=0} 14:57:36.005549 --- ParallelTerminationStrategy: PID 3930 died... 14:57:36.024253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3930): Terminated: ok {rc=0} 14:57:36.068271 --- ParallelTerminationStrategy: PID 3933 died... 14:57:36.087024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3933): Terminated: ok {rc=0} 14:57:36.173399 bus /sierra_3: Setting Powered False 14:57:37.272065 bus /sierra_3: Setting Powered False 14:57:38.383614 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 14:57:39.626568 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:57:39.632942 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 14:57:39.664621 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 14:57:39.692510 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 14:57:39.745071 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 14:57:39.777799 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 14:57:39.805099 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 14:57:40.353496 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 14:57:40.404772 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:40.417521 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:57:40.488132 tst mo_mt_call.py: using LAC 41686 14:57:40.616595 tst mo_mt_call.py: using RAC 121 14:57:40.737678 tst mo_mt_call.py: using CellId 41686 14:57:40.858688 tst mo_mt_call.py: using BVCI 41687 14:57:40.971109 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:40.982248 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:40.993214 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:41.004066 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:41.015965 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:41.026900 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:57:41.146733 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:57:41.263688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:57:41.731964 run create_hlr_db(pid=3939): Launched 14:57:41.847889 bus /sierra_2: Setting Powered False 14:57:42.907676 run create_hlr_db(pid=3939): Terminated: ok {rc=0} 14:57:43.349505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3941): Launched 14:57:43.673690 run osmo-hlr_10.42.42.2(pid=3942): Launched 14:57:43.798012 run osmo-stp_10.42.42.5: Starting osmo-stp 14:57:44.354066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3944): Launched 14:57:44.677958 run osmo-stp_10.42.42.5(pid=3945): Launched 14:57:44.801711 run osmo-msc_10.42.42.6: Starting osmo-msc 14:57:45.386365 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3947): Launched 14:57:45.710739 run osmo-msc_10.42.42.6(pid=3948): Launched 14:57:45.985044 run osmo-stp_10.42.42.5(pid=3945): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3945)] 14:57:46.265294 run osmo-stp_10.42.42.5(pid=3945): stdout: | (launched: 2022-12-14_14:57:44.618758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:46.557208 run osmo-stp_10.42.42.5(pid=3945): stderr: | 20221214145744812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145744812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145744813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145744813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145744814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145744814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145744814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:46.695476 run osmo-stp_10.42.42.5(pid=3945): stdout: | (launched: 2022-12-14_14:57:44.618758) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:46.826833 run osmo-stp_10.42.42.5(pid=3945): stderr: | 20221214145744812 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145744812 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145744813 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145744813 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145744814 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145744814 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145744814 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:46.982444 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3945): Process ended prematurely: osmo-stp_10.42.42.5(pid=3945) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3945)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 14:57:46.992422 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 14:57:47.020819 run osmo-hlr_10.42.42.2(pid=3942): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3942)] 14:57:47.071409 run osmo-hlr_10.42.42.2(pid=3942): stdout: | (launched: 2022-12-14_14:57:43.614813) 14:57:47.123639 run osmo-hlr_10.42.42.2(pid=3942): stderr: | 20221214145743816 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145743816 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145743816 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145743816 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145743816 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145743816 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145743828 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145743836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145743837 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145743837 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:57:47.196086 run osmo-msc_10.42.42.6(pid=3948): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3948)] 14:57:47.246736 run osmo-msc_10.42.42.6(pid=3948): stdout: | (launched: 2022-12-14_14:57:45.651961) 14:57:47.298870 run osmo-msc_10.42.42.6(pid=3948): stderr: | 20221214145746084 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145746084 DLGLOBAL DEBUG validating counter group 0x7ff113836c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145746084 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145746084 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145746085 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145746085 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145746087 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145746087 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145746087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145746088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:57:47.351809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3941): Terminating (SIGTERM) 14:57:47.394026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3944): Terminating (SIGTERM) 14:57:47.435551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3947): Terminating (SIGTERM) 14:57:47.477569 --- ParallelTerminationStrategy: PID 3941 died... 14:57:47.497589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3941): Terminated: ok {rc=0} 14:57:47.543534 --- ParallelTerminationStrategy: PID 3944 died... 14:57:47.563115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3944): Terminated: ok {rc=0} 14:57:47.609408 --- ParallelTerminationStrategy: PID 3947 died... 14:57:47.629022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3947): Terminated: ok {rc=0} 14:57:47.717103 bus /sierra_3: Setting Powered False 14:57:48.816871 bus /sierra_3: Setting Powered False 14:57:49.932201 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 14:57:51.082808 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:51.095138 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 14:57:51.165468 tst mo_mt_call_osmux.py: using LAC 41687 14:57:51.292466 tst mo_mt_call_osmux.py: using RAC 122 14:57:51.431631 tst mo_mt_call_osmux.py: using CellId 41687 14:57:51.566317 tst mo_mt_call_osmux.py: using BVCI 41688 14:57:51.685214 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:51.696756 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:51.708182 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:51.719506 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:51.731033 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 14:57:51.742479 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:57:51.857546 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 14:57:51.973334 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:57:52.441560 run create_hlr_db(pid=3950): Launched 14:57:52.559419 bus /sierra_2: Setting Powered False 14:57:53.619467 run create_hlr_db(pid=3950): Terminated: ok {rc=0} 14:57:54.041213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3952): Launched 14:57:54.344410 run osmo-hlr_10.42.42.2(pid=3953): Launched 14:57:54.461184 run osmo-stp_10.42.42.5: Starting osmo-stp 14:57:54.999928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3955): Launched 14:57:55.326318 run osmo-stp_10.42.42.5(pid=3956): Launched 14:57:55.450307 run osmo-msc_10.42.42.6: Starting osmo-msc 14:57:56.036867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3958): Launched 14:57:56.360741 run osmo-msc_10.42.42.6(pid=3959): Launched 14:57:56.543000 run osmo-stp_10.42.42.5(pid=3956): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3956)] 14:57:56.679797 run osmo-stp_10.42.42.5(pid=3956): stdout: | (launched: 2022-12-14_14:57:55.267583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:56.817150 run osmo-stp_10.42.42.5(pid=3956): stderr: | 20221214145755462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145755462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145755462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145755462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145755463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145755463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145755463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:56.952746 run osmo-stp_10.42.42.5(pid=3956): stdout: | (launched: 2022-12-14_14:57:55.267583) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:57:57.081064 run osmo-stp_10.42.42.5(pid=3956): stderr: | 20221214145755462 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145755462 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145755462 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145755462 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145755463 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145755463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145755463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:57:57.234540 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3956): Process ended prematurely: osmo-stp_10.42.42.5(pid=3956) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3956)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 14:57:57.244093 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:57:57.272446 run osmo-hlr_10.42.42.2(pid=3953): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3953)] 14:57:57.323239 run osmo-hlr_10.42.42.2(pid=3953): stdout: | (launched: 2022-12-14_14:57:54.289188) 14:57:57.375384 run osmo-hlr_10.42.42.2(pid=3953): stderr: | 20221214145754467 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145754467 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145754467 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145754467 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145754467 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145754467 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145754480 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145754489 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145754489 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145754489 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:57:57.447852 run osmo-msc_10.42.42.6(pid=3959): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3959)] 14:57:57.497939 run osmo-msc_10.42.42.6(pid=3959): stdout: | (launched: 2022-12-14_14:57:56.301873) 14:57:57.550143 run osmo-msc_10.42.42.6(pid=3959): stderr: | 20221214145756623 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145756623 DLGLOBAL DEBUG validating counter group 0x7f71e79abc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145756624 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145756624 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145756624 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145756624 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145756626 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145756626 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145756626 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145756626 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:57:57.602496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3952): Terminating (SIGTERM) 14:57:57.644273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3955): Terminating (SIGTERM) 14:57:57.686725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3958): Terminating (SIGTERM) 14:57:57.729179 --- ParallelTerminationStrategy: PID 3952 died... 14:57:57.749495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3952): Terminated: ok {rc=0} 14:57:57.795708 --- ParallelTerminationStrategy: PID 3955 died... 14:57:57.815392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3955): Terminated: ok {rc=0} 14:57:57.861598 --- ParallelTerminationStrategy: PID 3958 died... 14:57:57.881550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3958): Terminated: ok {rc=0} 14:57:57.968676 bus /sierra_3: Setting Powered False 14:57:59.068027 bus /sierra_3: Setting Powered False 14:58:00.183315 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 14:58:01.436152 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:58:01.443251 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 14:58:01.477154 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 14:58:01.506005 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 14:58:01.561048 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 14:58:01.597201 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 14:58:01.625856 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 14:58:02.172098 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 14:58:02.227779 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:02.239798 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:58:02.310347 tst mo_mt_call.py: using LAC 41688 14:58:02.437201 tst mo_mt_call.py: using RAC 123 14:58:02.563152 tst mo_mt_call.py: using CellId 41688 14:58:02.688885 tst mo_mt_call.py: using BVCI 41689 14:58:02.805879 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:02.817331 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:02.828493 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:02.839817 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:02.851205 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:02.862470 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:58:02.978724 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:58:03.096161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:58:03.565694 run create_hlr_db(pid=3965): Launched 14:58:03.684266 bus /sierra_2: Setting Powered False 14:58:04.745393 run create_hlr_db(pid=3965): Terminated: ok {rc=0} 14:58:05.188268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3967): Launched 14:58:05.512860 run osmo-hlr_10.42.42.2(pid=3968): Launched 14:58:05.637544 run osmo-stp_10.42.42.5: Starting osmo-stp 14:58:06.195772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3970): Launched 14:58:06.519218 run osmo-stp_10.42.42.5(pid=3971): Launched 14:58:06.643853 run osmo-msc_10.42.42.6: Starting osmo-msc 14:58:07.229614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3973): Launched 14:58:07.553861 run osmo-msc_10.42.42.6(pid=3974): Launched 14:58:07.735194 run osmo-stp_10.42.42.5(pid=3971): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3971)] 14:58:07.872839 run osmo-stp_10.42.42.5(pid=3971): stdout: | (launched: 2022-12-14_14:58:06.460717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:08.009953 run osmo-stp_10.42.42.5(pid=3971): stderr: | 20221214145806652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145806653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145806653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145806653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145806654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145806654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145806654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:08.145544 run osmo-stp_10.42.42.5(pid=3971): stdout: | (launched: 2022-12-14_14:58:06.460717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:08.273715 run osmo-stp_10.42.42.5(pid=3971): stderr: | 20221214145806652 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145806653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145806653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145806653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145806654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145806654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145806654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:08.427686 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3971): Process ended prematurely: osmo-stp_10.42.42.5(pid=3971) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3971)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 14:58:08.437203 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 14:58:08.465036 run osmo-hlr_10.42.42.2(pid=3968): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3968)] 14:58:08.514907 run osmo-hlr_10.42.42.2(pid=3968): stdout: | (launched: 2022-12-14_14:58:05.454370) 14:58:08.566562 run osmo-hlr_10.42.42.2(pid=3968): stderr: | 20221214145805652 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145805652 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145805652 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145805652 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145805652 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145805652 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145805665 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145805675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145805675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145805675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:58:08.638533 run osmo-msc_10.42.42.6(pid=3974): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3974)] 14:58:08.688574 run osmo-msc_10.42.42.6(pid=3974): stdout: | (launched: 2022-12-14_14:58:07.494990) 14:58:08.740076 run osmo-msc_10.42.42.6(pid=3974): stderr: | 20221214145807820 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145807820 DLGLOBAL DEBUG validating counter group 0x7f736f8a3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145807820 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145807820 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145807820 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145807821 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145807822 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145807823 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145807823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145807823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:58:08.791692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3967): Terminating (SIGTERM) 14:58:08.833310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3970): Terminating (SIGTERM) 14:58:08.874922 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3973): Terminating (SIGTERM) 14:58:08.917134 --- ParallelTerminationStrategy: PID 3967 died... 14:58:08.936820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3967): Terminated: ok {rc=0} 14:58:08.982690 --- ParallelTerminationStrategy: PID 3970 died... 14:58:09.002106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3970): Terminated: ok {rc=0} 14:58:09.047858 --- ParallelTerminationStrategy: PID 3973 died... 14:58:09.067345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3973): Terminated: ok {rc=0} 14:58:09.154339 bus /sierra_3: Setting Powered False 14:58:10.254550 bus /sierra_3: Setting Powered False 14:58:11.373435 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 14:58:12.522618 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:12.534900 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 14:58:12.604836 tst mo_mt_call_osmux.py: using LAC 41689 14:58:12.732610 tst mo_mt_call_osmux.py: using RAC 124 14:58:12.864277 tst mo_mt_call_osmux.py: using CellId 41689 14:58:12.992290 tst mo_mt_call_osmux.py: using BVCI 41690 14:58:13.111286 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:13.122924 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:13.134390 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:13.145938 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:13.157546 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 14:58:13.168919 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:58:13.285943 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 14:58:13.400932 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:58:13.868401 run create_hlr_db(pid=3976): Launched 14:58:13.985836 bus /sierra_2: Setting Powered False 14:58:15.046463 run create_hlr_db(pid=3976): Terminated: ok {rc=0} 14:58:15.488182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3978): Launched 14:58:15.812281 run osmo-hlr_10.42.42.2(pid=3979): Launched 14:58:15.980398 run osmo-stp_10.42.42.5: Starting osmo-stp 14:58:16.814973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3981): Launched 14:58:17.174998 run osmo-stp_10.42.42.5(pid=3982): Launched 14:58:17.468160 run osmo-msc_10.42.42.6: Starting osmo-msc 14:58:18.046997 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3984): Launched 14:58:18.348319 run osmo-msc_10.42.42.6(pid=3985): Launched 14:58:18.517788 run osmo-stp_10.42.42.5(pid=3982): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3982)] 14:58:18.646484 run osmo-stp_10.42.42.5(pid=3982): stdout: | (launched: 2022-12-14_14:58:17.105857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:18.774637 run osmo-stp_10.42.42.5(pid=3982): stderr: | 20221214145817390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145817390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145817390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145817391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145817391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145817391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145817391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:18.900571 run osmo-stp_10.42.42.5(pid=3982): stdout: | (launched: 2022-12-14_14:58:17.105857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:19.020202 run osmo-stp_10.42.42.5(pid=3982): stderr: | 20221214145817390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145817390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145817390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145817391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145817391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145817391 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145817391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:19.163852 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3982): Process ended prematurely: osmo-stp_10.42.42.5(pid=3982) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3982)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 14:58:19.172641 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 14:58:19.199160 run osmo-hlr_10.42.42.2(pid=3979): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3979)] 14:58:19.247309 run osmo-hlr_10.42.42.2(pid=3979): stdout: | (launched: 2022-12-14_14:58:15.753847) 14:58:19.296885 run osmo-hlr_10.42.42.2(pid=3979): stderr: | 20221214145816098 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145816099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145816099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145816099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145816099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145816099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145816120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145816144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145816145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145816145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:58:19.366492 run osmo-msc_10.42.42.6(pid=3985): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3985)] 14:58:19.414017 run osmo-msc_10.42.42.6(pid=3985): stdout: | (launched: 2022-12-14_14:58:18.293387) 14:58:19.464083 run osmo-msc_10.42.42.6(pid=3985): stderr: | 20221214145818566 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145818566 DLGLOBAL DEBUG validating counter group 0x7fd95d588c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145818566 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145818566 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145818566 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145818566 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145818568 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145818568 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145818569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145818569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:58:19.513854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3978): Terminating (SIGTERM) 14:58:19.554082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3981): Terminating (SIGTERM) 14:58:19.594154 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3984): Terminating (SIGTERM) 14:58:19.634243 --- ParallelTerminationStrategy: PID 3978 died... 14:58:19.653694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3978): Terminated: ok {rc=0} 14:58:19.697600 --- ParallelTerminationStrategy: PID 3981 died... 14:58:19.716530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3981): Terminated: ok {rc=0} 14:58:19.760412 --- ParallelTerminationStrategy: PID 3984 died... 14:58:19.779322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3984): Terminated: ok {rc=0} 14:58:19.865230 bus /sierra_3: Setting Powered False 14:58:20.963241 bus /sierra_3: Setting Powered False 14:58:22.077977 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 14:58:23.322645 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:58:23.329063 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 14:58:23.360924 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 14:58:23.388032 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 14:58:23.440005 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 14:58:23.473705 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 14:58:23.501724 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 14:58:24.048445 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 14:58:24.098388 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:24.109762 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:58:24.177825 tst mo_mt_call.py: using LAC 41690 14:58:24.298691 tst mo_mt_call.py: using RAC 125 14:58:24.418752 tst mo_mt_call.py: using CellId 41690 14:58:24.539029 tst mo_mt_call.py: using BVCI 41691 14:58:24.650786 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:24.661828 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:24.672608 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:24.683721 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:24.694952 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:24.706126 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:58:24.823842 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:58:24.940580 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:58:25.406590 run create_hlr_db(pid=3990): Launched 14:58:25.522070 bus /sierra_2: Setting Powered False 14:58:26.585695 run create_hlr_db(pid=3990): Terminated: ok {rc=0} 14:58:27.035212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3992): Launched 14:58:27.358506 run osmo-hlr_10.42.42.2(pid=3993): Launched 14:58:27.483012 run osmo-stp_10.42.42.5: Starting osmo-stp 14:58:28.039240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3995): Launched 14:58:28.364702 run osmo-stp_10.42.42.5(pid=3996): Launched 14:58:28.488415 run osmo-msc_10.42.42.6: Starting osmo-msc 14:58:29.077806 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3998): Launched 14:58:29.402000 run osmo-msc_10.42.42.6(pid=3999): Launched 14:58:29.583155 run osmo-stp_10.42.42.5(pid=3996): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3996)] 14:58:29.719604 run osmo-stp_10.42.42.5(pid=3996): stdout: | (launched: 2022-12-14_14:58:28.306210) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:29.856048 run osmo-stp_10.42.42.5(pid=3996): stderr: | 20221214145828500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145828501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145828501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145828501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145828502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145828502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145828502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:29.991731 run osmo-stp_10.42.42.5(pid=3996): stdout: | (launched: 2022-12-14_14:58:28.306210) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:30.119744 run osmo-stp_10.42.42.5(pid=3996): stderr: | 20221214145828500 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145828501 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145828501 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145828501 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145828502 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145828502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145828502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:30.273707 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3996): Process ended prematurely: osmo-stp_10.42.42.5(pid=3996) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3996)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 14:58:30.283095 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 14:58:30.311067 run osmo-hlr_10.42.42.2(pid=3993): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3993)] 14:58:30.361266 run osmo-hlr_10.42.42.2(pid=3993): stdout: | (launched: 2022-12-14_14:58:27.299922) 14:58:30.412695 run osmo-hlr_10.42.42.2(pid=3993): stderr: | 20221214145827500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145827500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145827500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145827500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145827500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145827500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145827513 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145827521 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145827522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145827522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:58:30.484573 run osmo-msc_10.42.42.6(pid=3999): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3999)] 14:58:30.534317 run osmo-msc_10.42.42.6(pid=3999): stdout: | (launched: 2022-12-14_14:58:29.343053) 14:58:30.585894 run osmo-msc_10.42.42.6(pid=3999): stderr: | 20221214145829664 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145829664 DLGLOBAL DEBUG validating counter group 0x7efdd3c13c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145829664 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145829664 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145829665 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145829665 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145829667 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145829667 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145829667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145829667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:58:30.637731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3992): Terminating (SIGTERM) 14:58:30.679575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3995): Terminating (SIGTERM) 14:58:30.721193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3998): Terminating (SIGTERM) 14:58:30.763584 --- ParallelTerminationStrategy: PID 3992 died... 14:58:30.783553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3992): Terminated: ok {rc=0} 14:58:30.829949 --- ParallelTerminationStrategy: PID 3995 died... 14:58:30.853294 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3995): Terminated: ok {rc=0} 14:58:30.914418 --- ParallelTerminationStrategy: PID 3998 died... 14:58:30.934796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3998): Terminated: ok {rc=0} 14:58:31.024895 bus /sierra_3: Setting Powered False 14:58:32.132912 bus /sierra_3: Setting Powered False 14:58:33.255168 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 14:58:34.404799 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:34.417164 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 14:58:34.489258 tst mo_mt_call_osmux.py: using LAC 41691 14:58:34.617306 tst mo_mt_call_osmux.py: using RAC 126 14:58:34.745744 tst mo_mt_call_osmux.py: using CellId 41691 14:58:34.868047 tst mo_mt_call_osmux.py: using BVCI 41692 14:58:34.979405 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:34.990740 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:35.001888 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:35.012719 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:35.024600 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 14:58:35.036493 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:58:35.157141 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 14:58:35.274420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:58:35.743544 run create_hlr_db(pid=4001): Launched 14:58:35.859081 bus /sierra_2: Setting Powered False 14:58:36.919639 run create_hlr_db(pid=4001): Terminated: ok {rc=0} 14:58:37.340098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4003): Launched 14:58:37.642456 run osmo-hlr_10.42.42.2(pid=4004): Launched 14:58:37.758370 run osmo-stp_10.42.42.5: Starting osmo-stp 14:58:38.293302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4006): Launched 14:58:38.595398 run osmo-stp_10.42.42.5(pid=4007): Launched 14:58:38.711871 run osmo-msc_10.42.42.6: Starting osmo-msc 14:58:39.258236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4009): Launched 14:58:39.561920 run osmo-msc_10.42.42.6(pid=4010): Launched 14:58:39.731530 run osmo-stp_10.42.42.5(pid=4007): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4007)] 14:58:39.860544 run osmo-stp_10.42.42.5(pid=4007): stdout: | (launched: 2022-12-14_14:58:38.540334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:39.988829 run osmo-stp_10.42.42.5(pid=4007): stderr: | 20221214145838712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145838713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145838713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145838713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145838714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145838714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145838714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:40.115282 run osmo-stp_10.42.42.5(pid=4007): stdout: | (launched: 2022-12-14_14:58:38.540334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:40.235082 run osmo-stp_10.42.42.5(pid=4007): stderr: | 20221214145838712 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145838713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145838713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145838713 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145838714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145838714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145838714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:40.378832 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4007): Process ended prematurely: osmo-stp_10.42.42.5(pid=4007) [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4007)] [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 14:58:40.387961 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 14:58:40.414532 run osmo-hlr_10.42.42.2(pid=4004): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4004)] 14:58:40.462590 run osmo-hlr_10.42.42.2(pid=4004): stdout: | (launched: 2022-12-14_14:58:37.587478) 14:58:40.511817 run osmo-hlr_10.42.42.2(pid=4004): stderr: | 20221214145837764 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145837764 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145837764 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145837764 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145837764 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145837764 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145837776 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145837784 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145837784 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145837785 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:58:40.581417 run osmo-msc_10.42.42.6(pid=4010): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4010)] 14:58:40.628312 run osmo-msc_10.42.42.6(pid=4010): stdout: | (launched: 2022-12-14_14:58:39.506069) 14:58:40.677482 run osmo-msc_10.42.42.6(pid=4010): stderr: | 20221214145839779 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145839780 DLGLOBAL DEBUG validating counter group 0x7f271d9bcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145839780 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145839780 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145839780 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145839780 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145839782 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145839782 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145839783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145839783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:58:40.726910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4003): Terminating (SIGTERM) 14:58:40.766365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4006): Terminating (SIGTERM) 14:58:40.805844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4009): Terminating (SIGTERM) 14:58:40.845770 --- ParallelTerminationStrategy: PID 4003 died... 14:58:40.865180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4003): Terminated: ok {rc=0} 14:58:40.908914 --- ParallelTerminationStrategy: PID 4006 died... 14:58:40.927851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4006): Terminated: ok {rc=0} 14:58:40.971904 --- ParallelTerminationStrategy: PID 4009 died... 14:58:40.990801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4009): Terminated: ok {rc=0} 14:58:41.076217 bus /sierra_3: Setting Powered False 14:58:42.174822 bus /sierra_3: Setting Powered False 14:58:43.288393 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 14:58:44.542921 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:58:44.549953 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 14:58:44.582927 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 14:58:44.610807 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 14:58:44.664430 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 14:58:44.696302 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 14:58:44.722766 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 14:58:45.276432 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 14:58:45.328309 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:45.340107 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:58:45.410485 tst mo_mt_call.py: using LAC 41692 14:58:45.538625 tst mo_mt_call.py: using RAC 127 14:58:45.674187 tst mo_mt_call.py: using CellId 41692 14:58:45.801646 tst mo_mt_call.py: using BVCI 41693 14:58:45.929798 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:45.942376 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:45.954352 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:45.966494 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:45.978679 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:45.990725 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:58:46.114418 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:58:46.234986 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:58:46.749343 run create_hlr_db(pid=4015): Launched 14:58:46.908288 bus /sierra_2: Setting Powered False 14:58:47.972334 run create_hlr_db(pid=4015): Terminated: ok {rc=0} 14:58:48.404395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4017): Launched 14:58:48.706559 run osmo-hlr_10.42.42.2(pid=4018): Launched 14:58:48.823842 run osmo-stp_10.42.42.5: Starting osmo-stp 14:58:49.341998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4020): Launched 14:58:49.643419 run osmo-stp_10.42.42.5(pid=4021): Launched 14:58:49.758863 run osmo-msc_10.42.42.6: Starting osmo-msc 14:58:50.302344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4023): Launched 14:58:50.604828 run osmo-msc_10.42.42.6(pid=4024): Launched 14:58:50.774126 run osmo-stp_10.42.42.5(pid=4021): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4021)] 14:58:50.901347 run osmo-stp_10.42.42.5(pid=4021): stdout: | (launched: 2022-12-14_14:58:49.588248) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:51.028619 run osmo-stp_10.42.42.5(pid=4021): stderr: | 20221214145849760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145849760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145849761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145849761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145849761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145849762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145849762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:51.154858 run osmo-stp_10.42.42.5(pid=4021): stdout: | (launched: 2022-12-14_14:58:49.588248) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:58:51.274619 run osmo-stp_10.42.42.5(pid=4021): stderr: | 20221214145849760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145849760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145849761 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145849761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145849761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145849762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145849762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:58:51.417990 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4021): Process ended prematurely: osmo-stp_10.42.42.5(pid=4021) [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4021)] [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 14:58:51.426890 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 14:58:51.453249 run osmo-hlr_10.42.42.2(pid=4018): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4018)] 14:58:51.501086 run osmo-hlr_10.42.42.2(pid=4018): stdout: | (launched: 2022-12-14_14:58:48.651280) 14:58:51.550302 run osmo-hlr_10.42.42.2(pid=4018): stderr: | 20221214145848827 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145848827 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145848827 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145848827 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145848827 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145848827 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145848840 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145848849 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145848849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145848849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:58:51.619364 run osmo-msc_10.42.42.6(pid=4024): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4024)] 14:58:51.666395 run osmo-msc_10.42.42.6(pid=4024): stdout: | (launched: 2022-12-14_14:58:50.549789) 14:58:51.715895 run osmo-msc_10.42.42.6(pid=4024): stderr: | 20221214145850823 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145850823 DLGLOBAL DEBUG validating counter group 0x7fcd1c752c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145850823 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145850823 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145850824 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145850824 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145850826 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145850826 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145850826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145850826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:58:51.765195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4017): Terminating (SIGTERM) 14:58:51.804853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4020): Terminating (SIGTERM) 14:58:51.844698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4023): Terminating (SIGTERM) 14:58:51.884834 --- ParallelTerminationStrategy: PID 4017 died... 14:58:51.904417 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4017): Terminated: ok {rc=0} 14:58:51.948750 --- ParallelTerminationStrategy: PID 4020 died... 14:58:51.967611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4020): Terminated: ok {rc=0} 14:58:52.011313 --- ParallelTerminationStrategy: PID 4023 died... 14:58:52.030102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4023): Terminated: ok {rc=0} 14:58:52.115711 bus /sierra_3: Setting Powered False 14:58:53.215100 bus /sierra_3: Setting Powered False 14:58:54.330172 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 14:58:55.476752 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:55.488446 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 14:58:55.557677 tst mo_mt_call_osmux.py: using LAC 41693 14:58:55.676059 tst mo_mt_call_osmux.py: using RAC 128 14:58:55.795367 tst mo_mt_call_osmux.py: using CellId 41693 14:58:55.915384 tst mo_mt_call_osmux.py: using BVCI 41694 14:58:56.025978 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:56.036990 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:56.047921 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:56.058738 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:56.070004 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 14:58:56.081207 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:58:56.196352 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 14:58:56.315430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:58:56.816627 run create_hlr_db(pid=4026): Launched 14:58:56.949650 bus /sierra_2: Setting Powered False 14:58:58.013734 run create_hlr_db(pid=4026): Terminated: ok {rc=0} 14:58:58.446065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4028): Launched 14:58:58.749589 run osmo-hlr_10.42.42.2(pid=4029): Launched 14:58:58.865089 run osmo-stp_10.42.42.5: Starting osmo-stp 14:58:59.399293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4031): Launched 14:58:59.701946 run osmo-stp_10.42.42.5(pid=4032): Launched 14:58:59.818165 run osmo-msc_10.42.42.6: Starting osmo-msc 14:59:00.364606 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4034): Launched 14:59:00.669105 run osmo-msc_10.42.42.6(pid=4035): Launched 14:59:00.867303 run osmo-stp_10.42.42.5(pid=4032): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4032)] 14:59:01.156301 run osmo-stp_10.42.42.5(pid=4032): stdout: | (launched: 2022-12-14_14:58:59.646965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:01.296181 run osmo-stp_10.42.42.5(pid=4032): stderr: | 20221214145859817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145859818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145859818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145859818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145859819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145859819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145859819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:01.434723 run osmo-stp_10.42.42.5(pid=4032): stdout: | (launched: 2022-12-14_14:58:59.646965) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:01.570160 run osmo-stp_10.42.42.5(pid=4032): stderr: | 20221214145859817 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145859818 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145859818 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145859818 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145859819 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145859819 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145859819 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:01.729414 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4032): Process ended prematurely: osmo-stp_10.42.42.5(pid=4032) [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4032)] [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 14:59:01.740240 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:59:01.769995 run osmo-hlr_10.42.42.2(pid=4029): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4029)] 14:59:01.822770 run osmo-hlr_10.42.42.2(pid=4029): stdout: | (launched: 2022-12-14_14:58:58.694609) 14:59:01.876838 run osmo-hlr_10.42.42.2(pid=4029): stderr: | 20221214145858870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145858870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145858870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145858871 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145858871 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145858871 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145858883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145858894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145858894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145858894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:59:01.950391 run osmo-msc_10.42.42.6(pid=4035): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4035)] 14:59:02.001356 run osmo-msc_10.42.42.6(pid=4035): stdout: | (launched: 2022-12-14_14:59:00.612364) 14:59:02.055433 run osmo-msc_10.42.42.6(pid=4035): stderr: | 20221214145900899 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145900899 DLGLOBAL DEBUG validating counter group 0x7fec85e7ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145900899 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145900899 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145900899 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145900899 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145900903 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145900903 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145900903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145900903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:59:02.110554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4028): Terminating (SIGTERM) 14:59:02.153977 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4031): Terminating (SIGTERM) 14:59:02.198765 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4034): Terminating (SIGTERM) 14:59:02.243480 --- ParallelTerminationStrategy: PID 4028 died... 14:59:02.263517 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4028): Terminated: ok {rc=0} 14:59:02.309679 --- ParallelTerminationStrategy: PID 4031 died... 14:59:02.329280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4031): Terminated: ok {rc=0} 14:59:02.375709 --- ParallelTerminationStrategy: PID 4034 died... 14:59:02.395211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4034): Terminated: ok {rc=0} 14:59:02.483809 bus /sierra_3: Setting Powered False 14:59:03.582963 bus /sierra_3: Setting Powered False 14:59:04.699400 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 14:59:05.949888 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:59:05.955887 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 14:59:05.988485 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 14:59:06.015702 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 14:59:06.067384 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 14:59:06.100379 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 14:59:06.127395 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 14:59:06.675260 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 14:59:06.723953 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:06.734704 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:59:06.802417 tst mo_mt_call.py: using LAC 41694 14:59:06.919741 tst mo_mt_call.py: using RAC 129 14:59:07.048396 tst mo_mt_call.py: using CellId 41694 14:59:07.179114 tst mo_mt_call.py: using BVCI 41695 14:59:07.296755 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:07.308254 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:07.319460 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:07.330514 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:07.341630 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:07.352730 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:59:07.469232 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:59:07.583673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:59:08.050305 run create_hlr_db(pid=4041): Launched 14:59:08.167109 bus /sierra_2: Setting Powered False 14:59:09.226975 run create_hlr_db(pid=4041): Terminated: ok {rc=0} 14:59:09.648195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4043): Launched 14:59:09.951919 run osmo-hlr_10.42.42.2(pid=4044): Launched 14:59:10.068187 run osmo-stp_10.42.42.5: Starting osmo-stp 14:59:10.598770 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4046): Launched 14:59:10.901085 run osmo-stp_10.42.42.5(pid=4047): Launched 14:59:11.016708 run osmo-msc_10.42.42.6: Starting osmo-msc 14:59:11.563069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4049): Launched 14:59:11.867023 run osmo-msc_10.42.42.6(pid=4050): Launched 14:59:12.037310 run osmo-stp_10.42.42.5(pid=4047): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4047)] 14:59:12.166610 run osmo-stp_10.42.42.5(pid=4047): stdout: | (launched: 2022-12-14_14:59:10.845934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:12.294620 run osmo-stp_10.42.42.5(pid=4047): stderr: | 20221214145911017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145911017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145911017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145911017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145911018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145911018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145911018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:12.419911 run osmo-stp_10.42.42.5(pid=4047): stdout: | (launched: 2022-12-14_14:59:10.845934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:12.539837 run osmo-stp_10.42.42.5(pid=4047): stderr: | 20221214145911017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145911017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145911017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145911017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145911018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145911018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145911018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:12.683261 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4047): Process ended prematurely: osmo-stp_10.42.42.5(pid=4047) [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4047)] [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 14:59:12.692118 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 14:59:12.718617 run osmo-hlr_10.42.42.2(pid=4044): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4044)] 14:59:12.766622 run osmo-hlr_10.42.42.2(pid=4044): stdout: | (launched: 2022-12-14_14:59:09.896441) 14:59:12.815684 run osmo-hlr_10.42.42.2(pid=4044): stderr: | 20221214145910072 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145910072 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145910073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145910073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145910073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145910073 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145910089 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145910098 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145910099 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145910099 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:59:12.884426 run osmo-msc_10.42.42.6(pid=4050): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4050)] 14:59:12.931802 run osmo-msc_10.42.42.6(pid=4050): stdout: | (launched: 2022-12-14_14:59:11.811214) 14:59:12.981192 run osmo-msc_10.42.42.6(pid=4050): stderr: | 20221214145912080 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145912080 DLGLOBAL DEBUG validating counter group 0x7f7d3aef9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145912080 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145912080 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145912080 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145912081 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145912082 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145912083 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145912083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145912083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:59:13.030601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4043): Terminating (SIGTERM) 14:59:13.070854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4046): Terminating (SIGTERM) 14:59:13.110698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4049): Terminating (SIGTERM) 14:59:13.150730 --- ParallelTerminationStrategy: PID 4043 died... 14:59:13.170036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4043): Terminated: ok {rc=0} 14:59:13.213935 --- ParallelTerminationStrategy: PID 4046 died... 14:59:13.232575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4046): Terminated: ok {rc=0} 14:59:13.276488 --- ParallelTerminationStrategy: PID 4049 died... 14:59:13.295281 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4049): Terminated: ok {rc=0} 14:59:13.382180 bus /sierra_3: Setting Powered False 14:59:14.481102 bus /sierra_3: Setting Powered False 14:59:15.593815 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 14:59:16.739830 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:16.752544 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 14:59:16.824773 tst mo_mt_call_osmux.py: using LAC 41695 14:59:16.946808 tst mo_mt_call_osmux.py: using RAC 130 14:59:17.077115 tst mo_mt_call_osmux.py: using CellId 41695 14:59:17.223655 tst mo_mt_call_osmux.py: using BVCI 41696 14:59:17.343318 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:17.355129 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:17.366276 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:17.377526 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:17.388574 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 14:59:17.399821 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:59:17.521033 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 14:59:17.638086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:59:18.108812 run create_hlr_db(pid=4052): Launched 14:59:18.225690 bus /sierra_2: Setting Powered False 14:59:19.286512 run create_hlr_db(pid=4052): Terminated: ok {rc=0} 14:59:19.732588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Launched 14:59:20.057095 run osmo-hlr_10.42.42.2(pid=4055): Launched 14:59:20.180796 run osmo-stp_10.42.42.5: Starting osmo-stp 14:59:20.744772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Launched 14:59:21.071391 run osmo-stp_10.42.42.5(pid=4058): Launched 14:59:21.194834 run osmo-msc_10.42.42.6: Starting osmo-msc 14:59:21.786273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Launched 14:59:22.111470 run osmo-msc_10.42.42.6(pid=4061): Launched 14:59:22.292418 run osmo-stp_10.42.42.5(pid=4058): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] 14:59:22.428554 run osmo-stp_10.42.42.5(pid=4058): stdout: | (launched: 2022-12-14_14:59:21.010289) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:22.565748 run osmo-stp_10.42.42.5(pid=4058): stderr: | 20221214145921204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145921205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145921205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145921205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145921206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145921206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145921206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:22.702062 run osmo-stp_10.42.42.5(pid=4058): stdout: | (launched: 2022-12-14_14:59:21.010289) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:22.830968 run osmo-stp_10.42.42.5(pid=4058): stderr: | 20221214145921204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145921205 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145921205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145921205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145921206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145921206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145921206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:22.985179 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4058): Process ended prematurely: osmo-stp_10.42.42.5(pid=4058) [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 14:59:22.994785 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 14:59:23.022733 run osmo-hlr_10.42.42.2(pid=4055): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4055)] 14:59:23.072640 run osmo-hlr_10.42.42.2(pid=4055): stdout: | (launched: 2022-12-14_14:59:19.998266) 14:59:23.124543 run osmo-hlr_10.42.42.2(pid=4055): stderr: | 20221214145920197 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145920197 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145920197 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145920197 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145920197 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145920197 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145920210 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145920218 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145920218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145920218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:59:23.196745 run osmo-msc_10.42.42.6(pid=4061): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4061)] 14:59:23.246590 run osmo-msc_10.42.42.6(pid=4061): stdout: | (launched: 2022-12-14_14:59:22.052328) 14:59:23.298070 run osmo-msc_10.42.42.6(pid=4061): stderr: | 20221214145922375 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145922375 DLGLOBAL DEBUG validating counter group 0x7f7529d10c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145922375 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145922375 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145922375 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145922376 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145922377 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145922378 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145922378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145922378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:59:23.349951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Terminating (SIGTERM) 14:59:23.391541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Terminating (SIGTERM) 14:59:23.433091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Terminating (SIGTERM) 14:59:23.474983 --- ParallelTerminationStrategy: PID 4054 died... 14:59:23.494917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Terminated: ok {rc=0} 14:59:23.540900 --- ParallelTerminationStrategy: PID 4057 died... 14:59:23.560734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Terminated: ok {rc=0} 14:59:23.606525 --- ParallelTerminationStrategy: PID 4060 died... 14:59:23.626110 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Terminated: ok {rc=0} 14:59:23.714456 bus /sierra_3: Setting Powered False 14:59:24.810640 bus /sierra_3: Setting Powered False 14:59:25.926770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 14:59:27.175535 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:59:27.181389 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 14:59:27.212812 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 14:59:27.240219 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 14:59:27.289244 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 14:59:27.320880 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 14:59:27.347255 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 14:59:27.901207 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 14:59:27.950102 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:27.961329 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:59:28.011768 tst mo_mt_call.py: using LAC 41696 14:59:28.137685 tst mo_mt_call.py: using RAC 131 14:59:28.263608 tst mo_mt_call.py: using CellId 41696 14:59:28.381633 tst mo_mt_call.py: using BVCI 41697 14:59:28.499916 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:28.511621 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:28.523293 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:28.535324 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:28.547177 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:28.558885 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:59:28.674704 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:59:28.794188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:59:29.296831 run create_hlr_db(pid=4066): Launched 14:59:29.428760 bus /sierra_2: Setting Powered False 14:59:30.492605 run create_hlr_db(pid=4066): Terminated: ok {rc=0} 14:59:30.953427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4068): Launched 14:59:31.293759 run osmo-hlr_10.42.42.2(pid=4069): Launched 14:59:31.535129 run osmo-stp_10.42.42.5: Starting osmo-stp 14:59:32.184345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4071): Launched 14:59:32.501513 run osmo-stp_10.42.42.5(pid=4072): Launched 14:59:32.619356 run osmo-msc_10.42.42.6: Starting osmo-msc 14:59:33.167224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4074): Launched 14:59:33.471076 run osmo-msc_10.42.42.6(pid=4075): Launched 14:59:33.642100 run osmo-stp_10.42.42.5(pid=4072): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4072)] 14:59:33.771807 run osmo-stp_10.42.42.5(pid=4072): stdout: | (launched: 2022-12-14_14:59:32.445860) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:33.900643 run osmo-stp_10.42.42.5(pid=4072): stderr: | 20221214145932615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145932616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145932616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145932616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145932617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145932617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145932617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:34.027021 run osmo-stp_10.42.42.5(pid=4072): stdout: | (launched: 2022-12-14_14:59:32.445860) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:34.147020 run osmo-stp_10.42.42.5(pid=4072): stderr: | 20221214145932615 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145932616 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145932616 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145932616 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145932617 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145932617 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145932617 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:34.290957 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4072): Process ended prematurely: osmo-stp_10.42.42.5(pid=4072) [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4072)] [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 14:59:34.299651 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 14:59:34.326564 run osmo-hlr_10.42.42.2(pid=4069): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4069)] 14:59:34.374732 run osmo-hlr_10.42.42.2(pid=4069): stdout: | (launched: 2022-12-14_14:59:31.223197) 14:59:34.424052 run osmo-hlr_10.42.42.2(pid=4069): stderr: | 20221214145931571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145931571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145931571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145931571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145931571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145931572 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145931591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145931607 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145931608 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145931608 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:59:34.493283 run osmo-msc_10.42.42.6(pid=4075): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4075)] 14:59:34.540338 run osmo-msc_10.42.42.6(pid=4075): stdout: | (launched: 2022-12-14_14:59:33.414969) 14:59:34.589575 run osmo-msc_10.42.42.6(pid=4075): stderr: | 20221214145933703 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145933704 DLGLOBAL DEBUG validating counter group 0x7fe44879fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145933704 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145933704 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145933704 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145933704 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145933706 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145933706 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145933706 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145933706 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:59:34.639183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4068): Terminating (SIGTERM) 14:59:34.678847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4071): Terminating (SIGTERM) 14:59:34.718582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4074): Terminating (SIGTERM) 14:59:34.758640 --- ParallelTerminationStrategy: PID 4068 died... 14:59:34.777984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4068): Terminated: ok {rc=0} 14:59:34.821887 --- ParallelTerminationStrategy: PID 4071 died... 14:59:34.841186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4071): Terminated: ok {rc=0} 14:59:34.885090 --- ParallelTerminationStrategy: PID 4074 died... 14:59:34.903968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4074): Terminated: ok {rc=0} 14:59:34.989548 bus /sierra_3: Setting Powered False 14:59:36.088763 bus /sierra_3: Setting Powered False 14:59:37.206772 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 14:59:38.351564 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:38.363484 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 14:59:38.414641 tst mo_mt_call_osmux.py: using LAC 41697 14:59:38.535247 tst mo_mt_call_osmux.py: using RAC 132 14:59:38.655169 tst mo_mt_call_osmux.py: using CellId 41697 14:59:38.775273 tst mo_mt_call_osmux.py: using BVCI 41698 14:59:38.886041 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:38.897268 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:38.908218 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:38.919153 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:38.930663 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 14:59:38.942008 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:59:39.062084 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 14:59:39.180342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:59:39.650653 run create_hlr_db(pid=4077): Launched 14:59:39.766453 bus /sierra_2: Setting Powered False 14:59:40.825787 run create_hlr_db(pid=4077): Terminated: ok {rc=0} 14:59:41.267856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4079): Launched 14:59:41.591811 run osmo-hlr_10.42.42.2(pid=4080): Launched 14:59:41.715599 run osmo-stp_10.42.42.5: Starting osmo-stp 14:59:42.276102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4083): Launched 14:59:42.601287 run osmo-stp_10.42.42.5(pid=4084): Launched 14:59:42.726384 run osmo-msc_10.42.42.6: Starting osmo-msc 14:59:43.312937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4086): Launched 14:59:43.637644 run osmo-msc_10.42.42.6(pid=4087): Launched 14:59:43.819450 run osmo-stp_10.42.42.5(pid=4084): ERR: Terminated: ERROR {rc=1} [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4084)] 14:59:43.955881 run osmo-stp_10.42.42.5(pid=4084): stdout: | (launched: 2022-12-14_14:59:42.542437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:44.093282 run osmo-stp_10.42.42.5(pid=4084): stderr: | 20221214145942736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145942736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145942737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145942737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145942738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145942738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145942738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:44.230467 run osmo-stp_10.42.42.5(pid=4084): stdout: | (launched: 2022-12-14_14:59:42.542437) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:44.359099 run osmo-stp_10.42.42.5(pid=4084): stderr: | 20221214145942736 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145942736 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145942737 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145942737 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145942738 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145942738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145942738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:44.513268 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4084): Process ended prematurely: osmo-stp_10.42.42.5(pid=4084) [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4084)] [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 14:59:44.523021 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 14:59:44.550559 run osmo-hlr_10.42.42.2(pid=4080): ERR: Terminated: ERROR {rc=237} [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4080)] 14:59:44.600156 run osmo-hlr_10.42.42.2(pid=4080): stdout: | (launched: 2022-12-14_14:59:41.533324) 14:59:44.651606 run osmo-hlr_10.42.42.2(pid=4080): stderr: | 20221214145941731 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145941731 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145941731 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145941731 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145941731 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145941731 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145941752 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145941762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145941762 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145941762 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:59:44.723319 run osmo-msc_10.42.42.6(pid=4087): ERR: Terminated: ERROR {rc=2} [trial-2406↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4087)] 14:59:44.773040 run osmo-msc_10.42.42.6(pid=4087): stdout: | (launched: 2022-12-14_14:59:43.578595) 14:59:44.824100 run osmo-msc_10.42.42.6(pid=4087): stderr: | 20221214145943899 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145943900 DLGLOBAL DEBUG validating counter group 0x7f0cbc0f5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145943900 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145943900 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145943900 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145943900 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145943902 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145943902 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145943902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145943902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:59:44.875541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4079): Terminating (SIGTERM) 14:59:44.916709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4083): Terminating (SIGTERM) 14:59:44.957866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4086): Terminating (SIGTERM) 14:59:44.999399 --- ParallelTerminationStrategy: PID 4079 died... 14:59:45.019555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4079): Terminated: ok {rc=0} 14:59:45.065691 --- ParallelTerminationStrategy: PID 4083 died... 14:59:45.085776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4083): Terminated: ok {rc=0} 14:59:45.131461 --- ParallelTerminationStrategy: PID 4086 died... 14:59:45.151064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4086): Terminated: ok {rc=0} 14:59:45.238600 bus /sierra_3: Setting Powered False 14:59:46.333121 bus /sierra_3: Setting Powered False 14:59:47.446403 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2406 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2406 emergency:trx-umtrx --------------------------------------------------------------------- 14:59:48.697642 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 14:59:48.702448 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 14:59:48.735874 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 14:59:48.763494 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 14:59:48.849410 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 14:59:48.882335 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 14:59:48.909326 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 14:59:49.492869 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2406 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 14:59:49.498331 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:59:49.509601 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 14:59:49.558891 tst emergency_mo_mt_call.py: using LAC 41698 14:59:49.684638 tst emergency_mo_mt_call.py: using RAC 133 14:59:49.801724 tst emergency_mo_mt_call.py: using CellId 41698 14:59:49.920737 tst emergency_mo_mt_call.py: using BVCI 41699 14:59:50.027914 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:59:50.038741 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:59:50.049258 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:59:50.059788 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:59:50.070151 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:59:50.081528 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 14:59:50.199725 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 14:59:50.319286 run osmo-hlr_10.42.42.2: Starting osmo-hlr 14:59:50.815547 run create_hlr_db(pid=4092): Launched 14:59:50.946049 bus /sierra_2: Setting Powered False 14:59:52.009926 run create_hlr_db(pid=4092): Terminated: ok {rc=0} 14:59:52.437240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4094): Launched 14:59:52.735411 run osmo-hlr_10.42.42.2(pid=4095): Launched 14:59:52.849157 run osmo-stp_10.42.42.5: Starting osmo-stp 14:59:53.373336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4097): Launched 14:59:53.671548 run osmo-stp_10.42.42.5(pid=4098): Launched 14:59:53.798279 tst emergency_mo_mt_call.py: using MSISDN 8743 14:59:53.951012 run osmo-msc_10.42.42.6: Starting osmo-msc 14:59:54.487730 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4100): Launched 14:59:54.787002 run osmo-msc_10.42.42.6(pid=4101): Launched 14:59:54.954838 run osmo-stp_10.42.42.5(pid=4098): ERR: Terminated: ERROR {rc=1} [trial-2406↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4098)] 14:59:55.081887 run osmo-stp_10.42.42.5(pid=4098): stdout: | (launched: 2022-12-14_14:59:53.616931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:55.208751 run osmo-stp_10.42.42.5(pid=4098): stderr: | 20221214145953785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145953785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145953785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145953786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145953789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145953789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145953789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:55.334053 run osmo-stp_10.42.42.5(pid=4098): stdout: | (launched: 2022-12-14_14:59:53.616931) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 14:59:55.452130 run osmo-stp_10.42.42.5(pid=4098): stderr: | 20221214145953785 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221214145953785 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221214145953785 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221214145953786 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221214145953789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221214145953789 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221214145953789 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 14:59:55.594517 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4098): Process ended prematurely: osmo-stp_10.42.42.5(pid=4098) [trial-2406↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4098)] [trial-2406↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 14:59:55.602819 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 14:59:55.629078 run osmo-hlr_10.42.42.2(pid=4095): ERR: Terminated: ERROR {rc=237} [trial-2406↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4095)] 14:59:55.677575 run osmo-hlr_10.42.42.2(pid=4095): stdout: | (launched: 2022-12-14_14:59:52.681386) 14:59:55.727992 run osmo-hlr_10.42.42.2(pid=4095): stderr: | 20221214145952859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221214145952859 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221214145952859 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221214145952859 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221214145952859 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221214145952859 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221214145952873 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2406/run.2022-12-14_14-20-43/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221214145952882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221214145952882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221214145952882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 14:59:55.798111 run osmo-msc_10.42.42.6(pid=4101): ERR: Terminated: ERROR {rc=2} [trial-2406↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4101)] 14:59:55.846124 run osmo-msc_10.42.42.6(pid=4101): stdout: | (launched: 2022-12-14_14:59:54.732380) 14:59:55.896325 run osmo-msc_10.42.42.6(pid=4101): stderr: | 20221214145955002 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221214145955002 DLGLOBAL DEBUG validating counter group 0x7f486b04dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221214145955002 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221214145955002 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221214145955002 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221214145955002 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221214145955004 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221214145955005 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221214145955005 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221214145955005 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 14:59:55.946846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4094): Terminating (SIGTERM) 14:59:55.987312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4097): Terminating (SIGTERM) 14:59:56.027904 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4100): Terminating (SIGTERM) 14:59:56.068510 --- ParallelTerminationStrategy: PID 4094 died... 14:59:56.088176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4094): Terminated: ok {rc=0} 14:59:56.132449 --- ParallelTerminationStrategy: PID 4097 died... 14:59:56.151416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4097): Terminated: ok {rc=0} 14:59:56.195652 --- ParallelTerminationStrategy: PID 4100 died... 14:59:56.214863 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4100): Terminated: ok {rc=0} 14:59:56.301841 bus /sierra_3: Setting Powered False 14:59:57.400451 bus /sierra_3: Setting Powered False 14:59:58.515563 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2406 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 14:59:59.601873 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 14:59:59.613823 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 14:59:59.664645 tst emergency_preemptive_call.py: using LAC 41699 14:59:59.783018 tst emergency_preemptive_call.py: using RAC 134 14:59:59.901341 tst emergency_preemptive_call.py: using CellId 41699 15:00:00.020776 tst emergency_preemptive_call.py: using BVCI 41700 15:00:00.128194 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 15:00:00.139087 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 15:00:00.149715 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 15:00:00.160009 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 15:00:00.171009 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 15:00:00.181864 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) Build was aborted Aborted by Oliver Smith Archiving artifacts 15:00:00.328423 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) killed by signal 15Recording test results 15:00:00.366636 tst emergency_preemptive_call.py:12: ERR: TEST RUN ABORTED: SystemExit [trial-2406↪emergency:trx-umtrx↪emergency_preemptive_call.py:12] 15:00:00.378726 bus /sierra_2: Setting Powered False No test report files were found. Configuration error? None of the test reports contained any result [Checks API] No suitable checks publisher found. Finished: ABORTED